-- Logs begin at Tue 2022-07-12 02:11:58 UTC, end at Tue 2022-07-12 03:44:18 UTC. -- Jul 12 03:13:47.571157 dv-cinder-847730-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 12 03:13:47.580633 dv-cinder-847730-4-smb devstack@keystone.service[80387]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 12 03:13:47.582054 dv-cinder-847730-4-smb devstack@keystone.service[80387]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 03:13:47 2022] *** Jul 12 03:13:47.582054 dv-cinder-847730-4-smb devstack@keystone.service[80387]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 03:13:47.582054 dv-cinder-847730-4-smb devstack@keystone.service[80387]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 03:13:47.582054 dv-cinder-847730-4-smb devstack@keystone.service[80387]: nodename: dv-cinder-847730-4-smb Jul 12 03:13:47.582054 dv-cinder-847730-4-smb devstack@keystone.service[80387]: machine: x86_64 Jul 12 03:13:47.582054 dv-cinder-847730-4-smb devstack@keystone.service[80387]: clock source: unix Jul 12 03:13:47.582054 dv-cinder-847730-4-smb devstack@keystone.service[80387]: pcre jit disabled Jul 12 03:13:47.582054 dv-cinder-847730-4-smb devstack@keystone.service[80387]: detected number of CPU cores: 4 Jul 12 03:13:47.582054 dv-cinder-847730-4-smb devstack@keystone.service[80387]: current working directory: / Jul 12 03:13:47.582054 dv-cinder-847730-4-smb devstack@keystone.service[80387]: detected binary path: /usr/bin/uwsgi-core Jul 12 03:13:47.582054 dv-cinder-847730-4-smb devstack@keystone.service[80387]: your processes number limit is 47680 Jul 12 03:13:47.583360 dv-cinder-847730-4-smb devstack@keystone.service[80387]: your memory page size is 4096 bytes Jul 12 03:13:47.583360 dv-cinder-847730-4-smb devstack@keystone.service[80387]: detected max file descriptor number: 2048 Jul 12 03:13:47.583360 dv-cinder-847730-4-smb devstack@keystone.service[80387]: lock engine: pthread robust mutexes Jul 12 03:13:47.583360 dv-cinder-847730-4-smb devstack@keystone.service[80387]: thunder lock: enabled Jul 12 03:13:47.583360 dv-cinder-847730-4-smb devstack@keystone.service[80387]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 12 03:13:47.583360 dv-cinder-847730-4-smb devstack@keystone.service[80387]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 03:13:47.627222 dv-cinder-847730-4-smb devstack@keystone.service[80387]: Python main interpreter initialized at 0x55b8ee2dd9c0 Jul 12 03:13:47.627222 dv-cinder-847730-4-smb devstack@keystone.service[80387]: python threads support enabled Jul 12 03:13:47.627222 dv-cinder-847730-4-smb devstack@keystone.service[80387]: your server socket listen backlog is limited to 100 connections Jul 12 03:13:47.627222 dv-cinder-847730-4-smb devstack@keystone.service[80387]: your mercy for graceful operations on workers is 90 seconds Jul 12 03:13:47.627604 dv-cinder-847730-4-smb devstack@keystone.service[80387]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 03:13:47.627604 dv-cinder-847730-4-smb devstack@keystone.service[80387]: *** Operational MODE: preforking *** Jul 12 03:13:47.627917 dv-cinder-847730-4-smb devstack@keystone.service[80387]: *** uWSGI is running in multiple interpreter mode *** Jul 12 03:13:47.627917 dv-cinder-847730-4-smb devstack@keystone.service[80387]: spawned uWSGI master process (pid: 80387) Jul 12 03:13:47.628096 dv-cinder-847730-4-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 12 03:13:47.630425 dv-cinder-847730-4-smb devstack@keystone.service[80387]: spawned uWSGI worker 1 (pid: 80397, cores: 1) Jul 12 03:13:47.630425 dv-cinder-847730-4-smb devstack@keystone.service[80387]: spawned uWSGI worker 2 (pid: 80398, cores: 1) Jul 12 03:13:47.630425 dv-cinder-847730-4-smb devstack@keystone.service[80387]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 03:13:53.041497 dv-cinder-847730-4-smb devstack@keystone.service[80397]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 03:13:53.041497 dv-cinder-847730-4-smb devstack@keystone.service[80397]: from cryptography.utils import int_from_bytes Jul 12 03:13:53.042292 dv-cinder-847730-4-smb devstack@keystone.service[80398]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 03:13:53.042292 dv-cinder-847730-4-smb devstack@keystone.service[80398]: from cryptography.utils import int_from_bytes Jul 12 03:13:53.042292 dv-cinder-847730-4-smb devstack@keystone.service[80398]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 03:13:53.042292 dv-cinder-847730-4-smb devstack@keystone.service[80398]: from cryptography.utils import int_from_bytes Jul 12 03:13:53.042801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 03:13:53.042801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: from cryptography.utils import int_from_bytes Jul 12 03:13:53.089714 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 03:13:53.089914 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 03:13:53.090108 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] command line args: [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 03:13:53.090387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 03:13:53.090591 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ================================================================================ {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 03:13:53.090836 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] admin_token = **** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.091106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] config_dir = [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.091411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.091569 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] config_source = [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.091760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] debug = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.091965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.092221 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 03:13:53.092299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.092366 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 03:13:53.092500 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.092655 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] command line args: [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 03:13:53.092765 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.092859 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 03:13:53.092949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.093046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ================================================================================ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 03:13:53.093183 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] list_limit = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.093304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] admin_token = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.093412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] log_config_append = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.093505 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] config_dir = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.093601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.093739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.094283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] log_dir = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.094444 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] config_source = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.094523 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] log_file = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.094643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] debug = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.094724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.094795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.094896 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.095017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.095094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.095214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.095294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.095294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.095526 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.095607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.095678 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.095748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.095818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.095934 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.096016 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_config_append = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.096087 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.096204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.096278 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.096387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_dir = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.096387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.096601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.096725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.096806 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.096876 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.096945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.097019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.097100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.097213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.097292 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.097403 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.097573 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.097707 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.097797 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.097871 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] publish_errors = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.098005 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.098096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.098572 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.098725 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.098840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.098948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.099051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.099171 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.099288 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.099404 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.099517 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] standard_threads = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.099623 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.099738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.099856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.099972 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.100093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.100212 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.100212 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] use_journal = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.100447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] use_json = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.100591 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.100712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] use_stderr = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.100712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] use_syslog = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.100984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] publish_errors = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.101105 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.101218 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.101327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.101436 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.101552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.101663 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.101778 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.101888 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.101888 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.102099 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.102222 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] standard_threads = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.102339 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.102455 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.102565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.102681 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.102797 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.102915 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.103025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.103134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_journal = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.103244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.103354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_json = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.103354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_stderr = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.103573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.103684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_syslog = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.103793 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.103902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:13:53.104010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.104126 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.104244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.104362 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.104478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.104602 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.104711 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.104831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.104952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.105069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.105178 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.105287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.105397 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.105511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.105630 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.105747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.105861 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.105971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.106087 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.106207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.106399 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.106514 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.106514 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.106718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.106827 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.106942 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.107060 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.107171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.107280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.107389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.107389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.107607 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.107734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.107845 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.107955 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.108063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.108171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.108280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.108396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.108508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.108653 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.108762 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.108871 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.108981 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.109102 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.109213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.109328 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.109808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.110016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.110131 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.110251 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.110364 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.110476 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.110588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.110703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.110822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.110933 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.111042 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.111157 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.111157 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.111363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.111479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.111590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.111703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.111813 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.111922 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.112037 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.112229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.112349 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.112460 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.112586 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.112698 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.112808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.112935 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.113048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.113157 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.113266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.113375 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.113484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.113602 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.113713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.113823 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.113933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.114042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.114153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.114270 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.114381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.114490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.114599 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.114708 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.114817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.114934 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.115045 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.115139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.115230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.115328 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.115455 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.115563 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.115658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.115750 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.115858 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.115953 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.116053 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.116164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.116164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.116372 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.116488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.116665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.116766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.116889 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.117010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.117114 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.117231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.117343 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.117445 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.117553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.117671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.117789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.117906 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.118017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.118127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.118227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.118346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.118458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.118559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.118667 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.118776 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.118885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.118996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.119118 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.119230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.119340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.119450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.119559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.119660 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.119779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.119891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.120001 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.120111 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.120228 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.120348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.120458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.120580 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.120693 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.120803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.120913 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.121034 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.121148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.121258 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.121374 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.121485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.121601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.121721 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.121832 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.121942 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.122051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.122161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.122271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.122389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.122501 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.122610 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.122610 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.122815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.122924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.123112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.123229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.123339 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.123456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.123567 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.123683 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.123802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.123922 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.124047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.124160 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.124278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.124389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.124500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.124655 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.124781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.124781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.125054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.125672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.125815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.125931 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.126052 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] auth.external = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.126052 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.126262 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.126262 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.126472 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.126592 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.126704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.126704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] auth.password = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.126911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.127021 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] auth.token = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.127132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.127249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.127362 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.127473 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.127589 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.127701 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.127817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.127936 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.128081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.128203 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.128325 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.128439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.128564 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.128677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.128788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.128915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] credential.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.129041 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.129154 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.129265 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.external = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.129376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.129489 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.129607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.129720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.129831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.129942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.130052 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.130164 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.password = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.130282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.130395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.token = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.130513 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.130632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.130743 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.130858 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.130978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.131090 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.131209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.131322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.131432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.131543 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.131662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.131780 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.131899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.132011 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.132122 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.132232 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.132350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.132463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.132613 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] federation.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.132729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.132839 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.132949 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.133068 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.133181 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.133299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.133413 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.133531 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.133645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.133764 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.133878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.133989 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.134100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.134210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.134327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.134447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.134566 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.134679 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.134791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.134902 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.135019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.135139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.135252 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.135374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.135486 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.135597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.135708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.135828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.135941 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.136052 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.136163 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.136273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.136383 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.136502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.136644 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.136767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.136886 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.136998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.137109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.137300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.137415 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.137526 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.137636 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.137749 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.137749 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.137968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.138087 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.138199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.138309 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.138419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.138540 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.138653 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.138763 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.138873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.138983 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.139093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.139212 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.139331 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.139443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.139554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.139664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.139776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.139894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.140008 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.140119 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.140229 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.140339 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.140449 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.140651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.141228 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.141361 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.141476 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.141588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.141700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.141820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.141935 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.142048 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.142166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.142279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.142391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.142581 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.142699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.142811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.142923 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.143034 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.143146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.143266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.143379 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.143490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.143608 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.143608 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.143818 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.143938 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.144051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.144163 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.144274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.144385 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.144496 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.144638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.144752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.144864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.144974 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.145085 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.145197 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.145316 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.145429 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.145540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.145650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.145760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.145871 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.145990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.146102 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.146218 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.146338 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.146451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.146563 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.146682 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.146795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.146906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.147017 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.147017 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.147225 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.147346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.147459 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.147569 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.147679 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.147790 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.147901 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.147901 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.148129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.148129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.148339 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.148339 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.148599 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.148727 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.148841 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.148951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.149061 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.149061 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.149268 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.149388 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.149501 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.149612 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.149723 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.149833 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.149952 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.150064 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.150174 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.150285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.150395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.150506 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.150625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.150737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.150850 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.150961 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.151071 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.151181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.151299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.151412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.151524 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.151634 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.151744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.151855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.151973 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.152086 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.152200 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.152310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.152427 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.152554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.152680 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.152793 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.152904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.153015 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.153125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.153235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.153354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.153467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.153579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.153579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.153786 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.153786 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.154001 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.154114 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.154225 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.154336 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.154447 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.154556 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.154679 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.154792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.154903 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.155014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.155124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.155235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.155354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.155467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.155578 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.155689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.155806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.155918 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] resource.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.156036 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.156153 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.156282 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.156876 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.157004 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.157117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.157244 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.157359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.157471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.157582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.157693 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.157805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.157927 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.158041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.158153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.158264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.158375 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.158486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.158605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.158719 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] role.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.158831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.158942 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] role.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.159053 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.159163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.159282 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.159395 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.159507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.159618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.159730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.159841 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.160035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.160035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.160248 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.160360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.160470 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.160616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.160742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.160857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.160969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.161081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.161191 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.161302 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.161421 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.161534 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.161645 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.161756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.161866 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.161978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.162097 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.162210 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] role.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.162322 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.162433 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] role.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.162433 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.162647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.162760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.162878 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.162991 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.163102 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.163213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.163332 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.163445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.163556 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.163667 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.163778 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.163888 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.164008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.164122 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.164233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.164344 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.164454 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.164580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.164705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.164820 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.164930 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.165048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.165162 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.165272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.165399 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.165513 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.165623 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.165623 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.165830 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.165940 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.166058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.166172 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.166283 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.166394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.166509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.166618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.166737 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.166850 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] token.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.166961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.167072 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.167189 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.167301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.167420 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.167533 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.167643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.167753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.167864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.167981 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.168095 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.168205 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.168316 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.168426 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.168555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.168680 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.168794 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.168904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.169014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.169124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.169234 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.169353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.169353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.169353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.169658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.169775 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.169886 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.170005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.170118 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.170229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.170340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.170340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.170548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.170666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.170783 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.connection = **** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.170904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.171025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.171138 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.171249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.171359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.171470 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.171589 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.171708 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.171868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.172363 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.172363 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.172614 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.172743 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.172859 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.172969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.173080 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.173190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.173300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.173419 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.173533 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.173643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.173753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.173863 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.173973 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.174097 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.174210 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.174321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.174432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.174543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.174654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.174773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.174887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.175007 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.175129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.175248 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.175248 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 03:13:53.175458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.175458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.175458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.175458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.175458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.175458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.175458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.175458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.175458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.176359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.176359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.176359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.176359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.176359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.176359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.176359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.176359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:13:53.176359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 03:13:53.202610 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.202833 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.203088 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.205389 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.205617 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.205841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.211580 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.214016 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.239895 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.240130 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.240352 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.240573 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.385586 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.386592 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.433413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.433649 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.434154 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.434384 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.497231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.497401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.497477 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.497654 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.497802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.497888 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.497963 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.498036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.498106 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.498265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.498359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.498514 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.521931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.522169 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.522286 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.522368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.522562 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.522690 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.522771 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.522859 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.522924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.522996 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.523144 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.523271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.523347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.523579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.534397 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.534524 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.547116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.547341 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.547531 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.547628 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.547777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.547904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.547981 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.548063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.548139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.548246 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.548336 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.548482 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.548716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.548933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 03:13:53.565561 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.565772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 03:13:53.566096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.566220 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.566318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 03:13:53.566398 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 03:13:53.566540 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.566666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.566775 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.566864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 03:13:53.567051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.567177 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.567254 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.567328 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.567566 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.567813 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.577878 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.578167 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.578431 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.578701 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.578844 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.579026 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.579292 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.579568 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.586762 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.587665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.590004 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.590299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.590549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.590825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.590919 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.591106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.591195 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.591347 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.591478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.591606 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.591698 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.591871 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.591960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.592130 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.592218 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.592390 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.592481 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.592670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.592755 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.592970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.593235 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.593497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.619110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.620001 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.620716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.620990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.621607 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.621882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.626335 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.626606 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.626993 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.627117 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.627380 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.627639 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.634173 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.634448 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.634882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.635167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.638910 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.639131 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.639404 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.639528 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.639652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.639859 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.639983 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.640060 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.640173 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.640335 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.640483 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.640723 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.641124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.641200 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.641273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.641413 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.659515 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.659752 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.659879 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.659989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.664268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.664396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.667856 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.668089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.668216 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.668355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.673243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.673920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.676818 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.677493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.680383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.680673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.680985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.681182 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.681364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.681527 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.681671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.681804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.681933 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.682064 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.682192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.682436 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.700563 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.700854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.701090 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.701258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.701412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.701547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.701776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.702006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.709170 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.710102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.710851 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.711094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.711767 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.712044 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.714262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.714543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.714782 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.715077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.715272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.715431 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.715568 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.715702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.715960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.716244 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.728872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.729147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.729402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.729690 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.729886 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.730042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.730180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.730312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.730483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.730780 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.731070 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.731278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.731632 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.731915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.749546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.750488 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.752857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.753757 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.756091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.757020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.757825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.758587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.759428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.759676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.759982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.760321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.760599 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.760908 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.767254 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.768025 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.769002 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.769641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.772163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.772447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.772847 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.773072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.773228 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.773382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.773643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.773919 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.782495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.782747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.783060 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.783358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.783597 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.783847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.790769 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.790995 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.791282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.791647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.791839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 03:13:53.791976 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.792152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.792299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.792442 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.792606 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.792854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.792996 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.793138 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.793270 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.793399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.793632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.793824 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.793994 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.794145 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.794291 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.794576 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.794735 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.794866 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.795045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.795185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.795316 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.795516 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.795996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 03:13:53.833233 dv-cinder-847730-4-smb devstack@keystone.service[80398]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b8ee2dd9c0 pid: 80398 (default app) Jul 12 03:13:53.836666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a62609-16f5-4f70-8763-c793321444e6 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:13:53.836927 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a62609-16f5-4f70-8763-c793321444e6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:13:53.837234 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a62609-16f5-4f70-8763-c793321444e6 None None] PATH_INFO: `/v3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:13:53.838434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b8ee2dd9c0 pid: 80397 (default app) Jul 12 03:13:53.841446 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Tue Jul 12 03:13:53 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:01.519948 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699de05d-8e23-49f3-b5db-ceb7f2c40ecc None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:01.520913 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699de05d-8e23-49f3-b5db-ceb7f2c40ecc None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:01.520913 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699de05d-8e23-49f3-b5db-ceb7f2c40ecc None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:01.528022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:01 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:01.533540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e4afd-ae5e-4fa3-9183-8046b39857d9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:01.533971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e4afd-ae5e-4fa3-9183-8046b39857d9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:01.534061 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e4afd-ae5e-4fa3-9183-8046b39857d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:01.603156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: INFO dbcounter [None req-e30e4afd-ae5e-4fa3-9183-8046b39857d9 None None] Registered counter for database keystone Jul 12 03:14:01.628317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG oslo_db.sqlalchemy.engines [None req-e30e4afd-ae5e-4fa3-9183-8046b39857d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:14:01.640216 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writer thread running {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:14:01.818411 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG passlib.handlers.bcrypt [None req-e30e4afd-ae5e-4fa3-9183-8046b39857d9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80398) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 03:14:01.818823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG passlib.handlers.bcrypt [None req-e30e4afd-ae5e-4fa3-9183-8046b39857d9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80398) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 03:14:01.874074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e30e4afd-ae5e-4fa3-9183-8046b39857d9 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:01.875752 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e30e4afd-ae5e-4fa3-9183-8046b39857d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:02.012764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 12 03:14:02.261357 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699de05d-8e23-49f3-b5db-ceb7f2c40ecc None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:02.334211 dv-cinder-847730-4-smb devstack@keystone.service[80397]: INFO dbcounter [None req-699de05d-8e23-49f3-b5db-ceb7f2c40ecc None None] Registered counter for database keystone Jul 12 03:14:02.356306 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG oslo_db.sqlalchemy.engines [None req-699de05d-8e23-49f3-b5db-ceb7f2c40ecc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80397) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:14:02.365053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writer thread running {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:14:02.485581 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699de05d-8e23-49f3-b5db-ceb7f2c40ecc None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:02.491113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb80e2-77ee-45a1-8d41-4950f118a68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:02.491784 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb80e2-77ee-45a1-8d41-4950f118a68b admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:02.492061 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb80e2-77ee-45a1-8d41-4950f118a68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:02.492322 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb80e2-77ee-45a1-8d41-4950f118a68b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:02.501507 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb80e2-77ee-45a1-8d41-4950f118a68b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:02.553865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7bbb80e2-77ee-45a1-8d41-4950f118a68b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 03:14:02.554432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb80e2-77ee-45a1-8d41-4950f118a68b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:02.564868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Tue Jul 12 03:14:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 03:14:02.572130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e4afd-ae5e-4fa3-9183-8046b39857d9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:02.595897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e4afd-ae5e-4fa3-9183-8046b39857d9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:02.602680 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8affb-f33e-4a7b-95f4-bbc83406d6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:02.603827 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8affb-f33e-4a7b-95f4-bbc83406d6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:02.604106 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8affb-f33e-4a7b-95f4-bbc83406d6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:02.604376 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8affb-f33e-4a7b-95f4-bbc83406d6c1 admin admin] PATH_INFO: `/v3/projects/75f65be69d944055b21e27b7afc48f60` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:02.608772 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8affb-f33e-4a7b-95f4-bbc83406d6c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=75f65be69d944055b21e27b7afc48f60)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:02.659760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e0b8affb-f33e-4a7b-95f4-bbc83406d6c1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 03:14:02.660098 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8affb-f33e-4a7b-95f4-bbc83406d6c1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:02.664786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Tue Jul 12 03:14:02 2022] GET /identity/v3/projects/75f65be69d944055b21e27b7afc48f60 => generated 344 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:04.657681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d653604-ca12-4863-8bb2-329ac17c63c5 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:04.658562 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d653604-ca12-4863-8bb2-329ac17c63c5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:04.658562 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d653604-ca12-4863-8bb2-329ac17c63c5 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:04.665382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:04 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:04.674335 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743c0f5-6c8e-41ec-a512-aba18feae110 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:04.674760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743c0f5-6c8e-41ec-a512-aba18feae110 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:04.674861 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743c0f5-6c8e-41ec-a512-aba18feae110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:04.694296 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6743c0f5-6c8e-41ec-a512-aba18feae110 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:04.695813 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6743c0f5-6c8e-41ec-a512-aba18feae110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:04.704653 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 12 03:14:04.728061 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d653604-ca12-4863-8bb2-329ac17c63c5 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:04.745128 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d653604-ca12-4863-8bb2-329ac17c63c5 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:04.750336 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496df63-8342-4c7e-8303-00b94ed3476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:04.750978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496df63-8342-4c7e-8303-00b94ed3476a admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:04.751263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496df63-8342-4c7e-8303-00b94ed3476a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:04.751539 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496df63-8342-4c7e-8303-00b94ed3476a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:04.760238 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496df63-8342-4c7e-8303-00b94ed3476a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:04.762079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496df63-8342-4c7e-8303-00b94ed3476a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:04.772136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Tue Jul 12 03:14:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 03:14:04.781486 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743c0f5-6c8e-41ec-a512-aba18feae110 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:04.795443 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743c0f5-6c8e-41ec-a512-aba18feae110 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:04.804932 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23812545-3772-436f-a519-cf284a19644e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:04.806320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23812545-3772-436f-a519-cf284a19644e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:04.806764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23812545-3772-436f-a519-cf284a19644e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:04.807200 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23812545-3772-436f-a519-cf284a19644e admin admin] PATH_INFO: `/v3/users/91f07a0a44be4b2f8401d0649c1ba808` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:04.809753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23812545-3772-436f-a519-cf284a19644e admin admin] RBAC: Authorizing `identity:get_user(user_id=91f07a0a44be4b2f8401d0649c1ba808)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:04.812718 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23812545-3772-436f-a519-cf284a19644e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:04.814317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Tue Jul 12 03:14:04 2022] GET /identity/v3/users/91f07a0a44be4b2f8401d0649c1ba808 => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:06.876339 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c187a13-d719-4de1-8357-7d2fbc2d9aee None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:06.876947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c187a13-d719-4de1-8357-7d2fbc2d9aee None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:06.876947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c187a13-d719-4de1-8357-7d2fbc2d9aee None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:06.878458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:06.883577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e2347-3257-40d6-8ddf-8e062168e61f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:06.884002 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e2347-3257-40d6-8ddf-8e062168e61f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:06.884091 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e2347-3257-40d6-8ddf-8e062168e61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:06.901195 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6c6e2347-3257-40d6-8ddf-8e062168e61f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:06.902358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6c6e2347-3257-40d6-8ddf-8e062168e61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:06.949409 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467549e-0756-4574-9f54-25e3029860f0 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:06.949697 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467549e-0756-4574-9f54-25e3029860f0 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:06.949973 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467549e-0756-4574-9f54-25e3029860f0 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:06.951345 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:06.956771 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c187e-2e81-46c6-b1e9-492f82aaadbb None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:06.957050 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c187e-2e81-46c6-b1e9-492f82aaadbb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:06.957384 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c187e-2e81-46c6-b1e9-492f82aaadbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:06.988192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:06.997430 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG passlib.handlers.bcrypt [None req-a67c187e-2e81-46c6-b1e9-492f82aaadbb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80397) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 03:14:06.997848 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG passlib.handlers.bcrypt [None req-a67c187e-2e81-46c6-b1e9-492f82aaadbb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80397) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 03:14:07.010962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e2347-3257-40d6-8ddf-8e062168e61f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:07.035872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:07.043032 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a67c187e-2e81-46c6-b1e9-492f82aaadbb None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:07.044656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a67c187e-2e81-46c6-b1e9-492f82aaadbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:07.118381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e2347-3257-40d6-8ddf-8e062168e61f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:07.147803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:07.152436 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466d805-8a7d-40c3-be98-5a4bf0840eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:07.153275 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466d805-8a7d-40c3-be98-5a4bf0840eaa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:07.153560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466d805-8a7d-40c3-be98-5a4bf0840eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:07.153841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466d805-8a7d-40c3-be98-5a4bf0840eaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:07.165368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466d805-8a7d-40c3-be98-5a4bf0840eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:07.170932 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c187e-2e81-46c6-b1e9-492f82aaadbb None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:07.176695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-8466d805-8a7d-40c3-be98-5a4bf0840eaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:07.176695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:07.176695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:07.176695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:07.176695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:07.176695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:07.176695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:07.176695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:07.176695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:07.176695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:07.176695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:07.176695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:07.176695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:07.176695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:07.176695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:07.176695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:07.177666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:07.177666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:07.177666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:07.177666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:07.177666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:07.177666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:07.177666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:07.177666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:07.177666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:07.177666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:07.177666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:07.177666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:07.177666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:07.177666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:07.177666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:07.177666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:07.178457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:07.178457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:07.178457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:07.178457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:07.178457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:07.178457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:07.178457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:07.178457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:07.178457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:07.178457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:07.178457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:07.178457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:07.178457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:14:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:07.183806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466d805-8a7d-40c3-be98-5a4bf0840eaa None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:07.265484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:07.272878 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c187e-2e81-46c6-b1e9-492f82aaadbb None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:07.275366 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:07.285906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466d805-8a7d-40c3-be98-5a4bf0840eaa None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:07.311690 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b11cb-d6ed-4e2b-bdcf-c2fc89613d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:07.312693 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b11cb-d6ed-4e2b-bdcf-c2fc89613d7c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:07.312973 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b11cb-d6ed-4e2b-bdcf-c2fc89613d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:07.313239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b11cb-d6ed-4e2b-bdcf-c2fc89613d7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:07.319153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e028a-aeeb-4f40-940f-a7f36feefdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:07.319819 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e028a-aeeb-4f40-940f-a7f36feefdaa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:07.320097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e028a-aeeb-4f40-940f-a7f36feefdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:07.320373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e028a-aeeb-4f40-940f-a7f36feefdaa None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:07.321162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e028a-aeeb-4f40-940f-a7f36feefdaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:07.321464 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e028a-aeeb-4f40-940f-a7f36feefdaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:07.322865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e028a-aeeb-4f40-940f-a7f36feefdaa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:07.334856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:07.340340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e028a-aeeb-4f40-940f-a7f36feefdaa None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:07.382265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b11cb-d6ed-4e2b-bdcf-c2fc89613d7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:07.383807 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b11cb-d6ed-4e2b-bdcf-c2fc89613d7c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:07.443519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e028a-aeeb-4f40-940f-a7f36feefdaa None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:07.477129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42fa80-64b1-4c44-af2e-222fdad509df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:07.478006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42fa80-64b1-4c44-af2e-222fdad509df None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:07.478311 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42fa80-64b1-4c44-af2e-222fdad509df None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:07.478580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42fa80-64b1-4c44-af2e-222fdad509df None admin] PATH_INFO: `/v3/users/91f07a0a44be4b2f8401d0649c1ba808` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:07.479753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42fa80-64b1-4c44-af2e-222fdad509df None admin] RBAC: Authorizing `identity:get_user(user_id=91f07a0a44be4b2f8401d0649c1ba808)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:07.481263 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42fa80-64b1-4c44-af2e-222fdad509df None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:07.482883 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 9/16] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:07 2022] GET /identity/v3/users/91f07a0a44be4b2f8401d0649c1ba808 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:07.488399 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 8/17] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:07.488892 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42fa80-64b1-4c44-af2e-222fdad509df None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:07.489413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b11cb-d6ed-4e2b-bdcf-c2fc89613d7c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:07.492160 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:07.504150 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:07.587676 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42fa80-64b1-4c44-af2e-222fdad509df None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:07.587847 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b11cb-d6ed-4e2b-bdcf-c2fc89613d7c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:07.622910 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe4afd-4220-469f-b058-2f08e82b4be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:07.623709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe4afd-4220-469f-b058-2f08e82b4be2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:07.623807 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb24717-12fb-474d-8f36-13f1457f0641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:07.623986 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe4afd-4220-469f-b058-2f08e82b4be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:07.624254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe4afd-4220-469f-b058-2f08e82b4be2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:07.624558 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb24717-12fb-474d-8f36-13f1457f0641 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:07.624892 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb24717-12fb-474d-8f36-13f1457f0641 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:07.625179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb24717-12fb-474d-8f36-13f1457f0641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:07.625714 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe4afd-4220-469f-b058-2f08e82b4be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:07.627192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe4afd-4220-469f-b058-2f08e82b4be2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:07.628816 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 10/18] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:14:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:07.634555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe4afd-4220-469f-b058-2f08e82b4be2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:07.645046 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb24717-12fb-474d-8f36-13f1457f0641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:07.646515 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb24717-12fb-474d-8f36-13f1457f0641 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:07.666705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-5bb24717-12fb-474d-8f36-13f1457f0641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:14:07.666705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:07.666705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:07.666705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:07.666705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:07.666705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:07.666705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:07.666705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:07.666705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:07.666705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:07.666705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:07.666705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:07.666705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:14:07.666705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:14:07.666705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:14:07.667544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:14:07.667544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:07.667544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:07.667544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:07.667544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:07.667544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:07.667544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:07.667544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:07.667544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:07.667544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:07.667544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:07.667544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:07.667544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:07.667544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:07.667544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:07.667544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:07.667544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:07.668352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:14:07.668352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:14:07.668352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:14:07.668352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:07.668352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 9/19] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:07.673828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb24717-12fb-474d-8f36-13f1457f0641 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:07.716545 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:07.728877 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:07.737636 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe4afd-4220-469f-b058-2f08e82b4be2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:07.770788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb735b-ca18-4096-9327-57e6da53cfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:07.771085 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb24717-12fb-474d-8f36-13f1457f0641 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:07.771440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb735b-ca18-4096-9327-57e6da53cfd5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:07.771718 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb735b-ca18-4096-9327-57e6da53cfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:07.771992 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb735b-ca18-4096-9327-57e6da53cfd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:07.772865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb735b-ca18-4096-9327-57e6da53cfd5 None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.domain.id=default, user.id=91f07a0a44be4b2f8401d0649c1ba808) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:07.773178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb735b-ca18-4096-9327-57e6da53cfd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:07.774614 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb735b-ca18-4096-9327-57e6da53cfd5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:07.781389 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Tue Jul 12 03:14:07 2022] GET /identity/v3/role_assignments?user.id=91f07a0a44be4b2f8401d0649c1ba808&scope.domain.id=default&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:07.805087 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f544b5-5332-4324-92c1-7fa9bdcb3746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:07.805770 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f544b5-5332-4324-92c1-7fa9bdcb3746 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:07.806047 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f544b5-5332-4324-92c1-7fa9bdcb3746 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:07.806316 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f544b5-5332-4324-92c1-7fa9bdcb3746 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:07.807063 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f544b5-5332-4324-92c1-7fa9bdcb3746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:07.807364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f544b5-5332-4324-92c1-7fa9bdcb3746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:07.808841 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f544b5-5332-4324-92c1-7fa9bdcb3746 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:07.827880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:10.119935 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3cf87-a568-4643-bc64-f48b84d60625 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:10.120999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3cf87-a568-4643-bc64-f48b84d60625 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:10.121577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3cf87-a568-4643-bc64-f48b84d60625 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:10.123160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:10.128971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56e9cd-6889-4d11-92ba-0666007e2ac4 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:10.129799 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56e9cd-6889-4d11-92ba-0666007e2ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:10.130466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56e9cd-6889-4d11-92ba-0666007e2ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:10.153504 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9c56e9cd-6889-4d11-92ba-0666007e2ac4 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:10.155080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9c56e9cd-6889-4d11-92ba-0666007e2ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:10.189758 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d474146-aadd-437f-a679-b6b2b44baca6 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:10.190370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d474146-aadd-437f-a679-b6b2b44baca6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:10.190854 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d474146-aadd-437f-a679-b6b2b44baca6 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:10.192437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 13/23] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:14:10.197377 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825bda7-ec5d-4c46-980b-be9e02cf1513 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:10.197885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825bda7-ec5d-4c46-980b-be9e02cf1513 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:10.198352 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825bda7-ec5d-4c46-980b-be9e02cf1513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:10.228336 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5825bda7-ec5d-4c46-980b-be9e02cf1513 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:10.231751 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5825bda7-ec5d-4c46-980b-be9e02cf1513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:10.293334 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 11/24] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:10.337593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56e9cd-6889-4d11-92ba-0666007e2ac4 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:10.397909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 14/25] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:10.435844 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:10.449584 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825bda7-ec5d-4c46-980b-be9e02cf1513 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:10.568921 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56e9cd-6889-4d11-92ba-0666007e2ac4 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:10.605175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:10.636457 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94593943-67ab-46bf-bc91-7b15c892170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:10.637300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94593943-67ab-46bf-bc91-7b15c892170f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:10.637582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94593943-67ab-46bf-bc91-7b15c892170f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:10.637858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94593943-67ab-46bf-bc91-7b15c892170f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:10.663213 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94593943-67ab-46bf-bc91-7b15c892170f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:10.673285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-94593943-67ab-46bf-bc91-7b15c892170f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:10.673285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:10.673285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:10.673285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:10.673285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:10.673285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:10.673285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:10.673285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:10.673285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:10.673285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:10.673285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:10.673285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:10.673285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:10.673285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:10.673285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:10.673285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:10.674348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:10.674348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:10.674348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:10.674348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:10.674348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:10.674348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:10.674348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:10.674348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:10.674348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:10.674348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:10.674348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:10.674348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:10.674348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:10.674348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:10.674348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:10.674348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:10.675289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:10.675289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:10.675289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:10.675289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:10.675289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:10.675289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:10.675289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:10.675289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:10.675289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:10.675289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:10.675289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:10.675289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:10.676022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825bda7-ec5d-4c46-980b-be9e02cf1513 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:10.683558 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 12/26] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:14:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:14:10.690220 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94593943-67ab-46bf-bc91-7b15c892170f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:10.761220 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a266eb-0189-41ff-8f6f-c559d228ffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:10.762028 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a266eb-0189-41ff-8f6f-c559d228ffab None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:10.762316 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a266eb-0189-41ff-8f6f-c559d228ffab None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:10.762583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a266eb-0189-41ff-8f6f-c559d228ffab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:10.781261 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a266eb-0189-41ff-8f6f-c559d228ffab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:10.782764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a266eb-0189-41ff-8f6f-c559d228ffab None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:10.819561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-12a266eb-0189-41ff-8f6f-c559d228ffab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:14:10.819561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:10.819561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:10.819561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:10.819561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:10.819561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:10.819561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:10.819561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:10.819561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:10.819561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:10.819561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:10.819561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:10.819561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:14:10.819561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:14:10.819561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:14:10.820638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:14:10.820638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:10.820638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:10.820638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:10.820638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:10.820638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:10.820638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:10.820638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:10.820638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:10.820638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:10.820638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:10.820638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:10.820638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:10.820638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:10.820638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:10.820638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:10.820638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:10.821469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:14:10.821469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:14:10.821469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:14:10.821469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:10.823211 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 15/27] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:14:10.824831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af49a8-f10e-4304-97aa-f0fe7625ee3e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:10.825271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af49a8-f10e-4304-97aa-f0fe7625ee3e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:10.826182 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af49a8-f10e-4304-97aa-f0fe7625ee3e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:10.827885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 16/28] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:10.832901 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af49a8-f10e-4304-97aa-f0fe7625ee3e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:10.894442 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94593943-67ab-46bf-bc91-7b15c892170f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:10.920979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:10.955954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0856e-567b-45f8-8b89-50c918092644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:10.956909 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0856e-567b-45f8-8b89-50c918092644 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:10.957332 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0856e-567b-45f8-8b89-50c918092644 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:10.957771 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0856e-567b-45f8-8b89-50c918092644 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:10.958676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0856e-567b-45f8-8b89-50c918092644 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:10.959137 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0856e-567b-45f8-8b89-50c918092644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:10.960715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0856e-567b-45f8-8b89-50c918092644 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:10.974206 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 13/29] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:10.980612 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922db72-f47a-4c7c-9e86-17402866cfaa None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:10.981062 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922db72-f47a-4c7c-9e86-17402866cfaa None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:10.981510 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922db72-f47a-4c7c-9e86-17402866cfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:10.998239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af49a8-f10e-4304-97aa-f0fe7625ee3e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:11.000669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5922db72-f47a-4c7c-9e86-17402866cfaa None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:11.001894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5922db72-f47a-4c7c-9e86-17402866cfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:11.026190 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:11.035933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbb6ce-db0b-4b3f-8b12-03af2fb0163b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:11.036886 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbb6ce-db0b-4b3f-8b12-03af2fb0163b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:11.037308 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbb6ce-db0b-4b3f-8b12-03af2fb0163b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:11.037753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbb6ce-db0b-4b3f-8b12-03af2fb0163b None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:11.038635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbb6ce-db0b-4b3f-8b12-03af2fb0163b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:11.039119 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbb6ce-db0b-4b3f-8b12-03af2fb0163b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:11.040737 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbb6ce-db0b-4b3f-8b12-03af2fb0163b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:11.059818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 17/30] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:11.061646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73f6a8-bb55-4dc1-9bf9-f204566e3eee None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:11.062167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73f6a8-bb55-4dc1-9bf9-f204566e3eee None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:11.062658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73f6a8-bb55-4dc1-9bf9-f204566e3eee None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:11.064067 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 18/31] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:11.064976 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73f6a8-bb55-4dc1-9bf9-f204566e3eee None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:11.084553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 14/32] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:11.084553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922db72-f47a-4c7c-9e86-17402866cfaa None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:11.181555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:11.185773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922db72-f47a-4c7c-9e86-17402866cfaa None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:11.208922 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73f6a8-bb55-4dc1-9bf9-f204566e3eee None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:11.221420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f78d3c-17e1-400a-86b2-996acfd51754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:11.222100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f78d3c-17e1-400a-86b2-996acfd51754 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:11.222386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f78d3c-17e1-400a-86b2-996acfd51754 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:11.222649 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f78d3c-17e1-400a-86b2-996acfd51754 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:11.223972 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f78d3c-17e1-400a-86b2-996acfd51754 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:11.225500 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f78d3c-17e1-400a-86b2-996acfd51754 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:11.250702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef235b-8234-443b-bb00-b8d2ac5d438a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:11.252039 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef235b-8234-443b-bb00-b8d2ac5d438a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:11.252538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef235b-8234-443b-bb00-b8d2ac5d438a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:11.253072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef235b-8234-443b-bb00-b8d2ac5d438a None admin] PATH_INFO: `/v3/users/91f07a0a44be4b2f8401d0649c1ba808` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:11.254489 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef235b-8234-443b-bb00-b8d2ac5d438a None admin] RBAC: Authorizing `identity:get_user(user_id=91f07a0a44be4b2f8401d0649c1ba808)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:11.256250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef235b-8234-443b-bb00-b8d2ac5d438a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:11.258215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 19/33] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:11 2022] GET /identity/v3/users/91f07a0a44be4b2f8401d0649c1ba808 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:11.259914 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb3cf2-c713-4c94-a512-c5ddf5bc0c43 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:11.260441 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb3cf2-c713-4c94-a512-c5ddf5bc0c43 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:11.260953 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb3cf2-c713-4c94-a512-c5ddf5bc0c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:11.279606 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-60bb3cf2-c713-4c94-a512-c5ddf5bc0c43 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:11.281214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-60bb3cf2-c713-4c94-a512-c5ddf5bc0c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:11.335548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:11.355055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 20/34] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:11.356372 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb3cf2-c713-4c94-a512-c5ddf5bc0c43 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:11.394118 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 15/35] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 03:14:11 2022] POST /identity/v3/projects => generated 301 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:14:11.395041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f78d3c-17e1-400a-86b2-996acfd51754 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:11.501786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb3cf2-c713-4c94-a512-c5ddf5bc0c43 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:11.511794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f78d3c-17e1-400a-86b2-996acfd51754 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:11.554344 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dffe18-3f8a-4ca9-ab5e-ef99f91e7196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:11.555403 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dffe18-3f8a-4ca9-ab5e-ef99f91e7196 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:11.555872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dffe18-3f8a-4ca9-ab5e-ef99f91e7196 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:11.556358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dffe18-3f8a-4ca9-ab5e-ef99f91e7196 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:11.557346 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dffe18-3f8a-4ca9-ab5e-ef99f91e7196 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:11.557942 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c120c1f-8d1a-44ab-9edf-4d919a4110e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:11.558779 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c120c1f-8d1a-44ab-9edf-4d919a4110e1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:11.559067 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c120c1f-8d1a-44ab-9edf-4d919a4110e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:11.559347 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c120c1f-8d1a-44ab-9edf-4d919a4110e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:11.559829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dffe18-3f8a-4ca9-ab5e-ef99f91e7196 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:11.560725 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c120c1f-8d1a-44ab-9edf-4d919a4110e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:11.562398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c120c1f-8d1a-44ab-9edf-4d919a4110e1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:11.564748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 16/36] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:14:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:11.565323 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c120c1f-8d1a-44ab-9edf-4d919a4110e1 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:11.596472 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:11.685594 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c120c1f-8d1a-44ab-9edf-4d919a4110e1 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:11.693209 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 21/37] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Jul 12 03:14:11 2022] POST /identity/v3/roles => generated 219 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:14:11.694782 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ded15a-f62d-4649-b6b8-93fb2a130866 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:11.695026 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ded15a-f62d-4649-b6b8-93fb2a130866 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:11.695511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ded15a-f62d-4649-b6b8-93fb2a130866 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:11.696842 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 22/38] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:11.697361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ded15a-f62d-4649-b6b8-93fb2a130866 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:11.732359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbe7d9-8c45-4551-ae79-f5724906fce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:11.733098 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbe7d9-8c45-4551-ae79-f5724906fce1 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:11.733358 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbe7d9-8c45-4551-ae79-f5724906fce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:11.733632 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbe7d9-8c45-4551-ae79-f5724906fce1 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:11.734452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbe7d9-8c45-4551-ae79-f5724906fce1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:11.735998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbe7d9-8c45-4551-ae79-f5724906fce1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:11.754846 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 17/39] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Jul 12 03:14:11 2022] POST /identity/v3/roles => generated 225 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:14:11.758229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4faed-f464-4d0a-8537-cb8f5175ecb5 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:11.758536 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4faed-f464-4d0a-8537-cb8f5175ecb5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:11.758789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4faed-f464-4d0a-8537-cb8f5175ecb5 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:11.764893 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 18/40] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:11.764893 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98862c3f-815a-4d59-ae3f-e4b4a85a8b25 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:11.764893 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98862c3f-815a-4d59-ae3f-e4b4a85a8b25 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:11.764893 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98862c3f-815a-4d59-ae3f-e4b4a85a8b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:11.768363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:11.794851 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-98862c3f-815a-4d59-ae3f-e4b4a85a8b25 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:11.798305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-98862c3f-815a-4d59-ae3f-e4b4a85a8b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:11.850704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ded15a-f62d-4649-b6b8-93fb2a130866 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:11.894757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 19/41] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:11.896199 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a7704-b852-4432-9f59-72fa2456f3bb None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:11.896494 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a7704-b852-4432-9f59-72fa2456f3bb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:11.896798 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a7704-b852-4432-9f59-72fa2456f3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:11.907212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4076100-6bbe-4bdb-b871-5967392f7cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:11.908237 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4076100-6bbe-4bdb-b871-5967392f7cad None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:11.908643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4076100-6bbe-4bdb-b871-5967392f7cad None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:11.908941 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4076100-6bbe-4bdb-b871-5967392f7cad None admin] PATH_INFO: `/v3/domains/default/users/91f07a0a44be4b2f8401d0649c1ba808/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:11.912243 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4076100-6bbe-4bdb-b871-5967392f7cad None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=91f07a0a44be4b2f8401d0649c1ba808, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:11.914023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4076100-6bbe-4bdb-b871-5967392f7cad None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:11.925990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c85a7704-b852-4432-9f59-72fa2456f3bb None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:11.927375 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c85a7704-b852-4432-9f59-72fa2456f3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:11.930342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:11.937691 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 23/42] 10.222.0.26 () {58 vars in 1361 bytes} [Tue Jul 12 03:14:11 2022] PUT /identity/v3/domains/default/users/91f07a0a44be4b2f8401d0649c1ba808/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:14:11.938939 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4076100-6bbe-4bdb-b871-5967392f7cad None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:12.048461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 20/43] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:12.085320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a7704-b852-4432-9f59-72fa2456f3bb None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:12.230359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a7704-b852-4432-9f59-72fa2456f3bb None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:12.240209 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4076100-6bbe-4bdb-b871-5967392f7cad None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:12.243633 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:12.269091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fd4f5-57ea-4bb6-bbe8-870752b386f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:12.269847 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fd4f5-57ea-4bb6-bbe8-870752b386f1 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:12.270193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fd4f5-57ea-4bb6-bbe8-870752b386f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:12.272907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fd4f5-57ea-4bb6-bbe8-870752b386f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:12.272907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fd4f5-57ea-4bb6-bbe8-870752b386f1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:12.273089 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fd4f5-57ea-4bb6-bbe8-870752b386f1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:12.285260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06ea6d-e18c-4898-ba38-7274fb6bb5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:12.285572 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:12.286545 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06ea6d-e18c-4898-ba38-7274fb6bb5ec None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:12.286777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06ea6d-e18c-4898-ba38-7274fb6bb5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:12.287038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06ea6d-e18c-4898-ba38-7274fb6bb5ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:12.288318 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06ea6d-e18c-4898-ba38-7274fb6bb5ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:12.289925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06ea6d-e18c-4898-ba38-7274fb6bb5ec None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:12.291741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 24/44] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:14:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:12.293410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 21/45] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Jul 12 03:14:12 2022] POST /identity/v3/roles => generated 223 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:14:12.303036 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06ea6d-e18c-4898-ba38-7274fb6bb5ec None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:12.459614 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06ea6d-e18c-4898-ba38-7274fb6bb5ec None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:12.505262 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c90603-37ad-4996-ae1f-e2571da5e5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:12.505949 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c90603-37ad-4996-ae1f-e2571da5e5d0 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:12.506291 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c90603-37ad-4996-ae1f-e2571da5e5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:12.506558 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c90603-37ad-4996-ae1f-e2571da5e5d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:12.507322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c90603-37ad-4996-ae1f-e2571da5e5d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:12.509058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c90603-37ad-4996-ae1f-e2571da5e5d0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:12.543933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 25/46] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 03:14:12 2022] POST /identity/v3/projects => generated 312 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:14:14.043867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cbd69-0279-4596-b5d5-a732d073973e None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:14.043867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cbd69-0279-4596-b5d5-a732d073973e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:14.043867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cbd69-0279-4596-b5d5-a732d073973e None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:14.045275 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 22/47] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:14.051648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012faeb-7b12-412f-be98-97d3abb351ed None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:14.052090 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012faeb-7b12-412f-be98-97d3abb351ed None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:14.052432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012faeb-7b12-412f-be98-97d3abb351ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:14.074933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8012faeb-7b12-412f-be98-97d3abb351ed None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:14.076464 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8012faeb-7b12-412f-be98-97d3abb351ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:14.096466 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:14.149603 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 26/48] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:14.173625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cbd69-0279-4596-b5d5-a732d073973e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:14.278755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cbd69-0279-4596-b5d5-a732d073973e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:14.314739 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e063d-75aa-4616-b4e2-29d9e372a36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:14.315633 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e063d-75aa-4616-b4e2-29d9e372a36a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:14.315920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e063d-75aa-4616-b4e2-29d9e372a36a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:14.316224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e063d-75aa-4616-b4e2-29d9e372a36a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:14.328203 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e063d-75aa-4616-b4e2-29d9e372a36a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:14.336502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-6e7e063d-75aa-4616-b4e2-29d9e372a36a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:14.336502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:14.336502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:14.336502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:14.336502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:14.336502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:14.336502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:14.336502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:14.336502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:14.336502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:14.336502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:14.336502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:14.336502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:14.336502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:14.336502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:14.336502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:14.337348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:14.337348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:14.337348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:14.337348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:14.337348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:14.337348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:14.337348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:14.337348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:14.337348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:14.337348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:14.337348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:14.337348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:14.337348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:14.337348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:14.337348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:14.337348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:14.338082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:14.338082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:14.338082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:14.338082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:14.338082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:14.338082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:14.338082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:14.338082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:14.338082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:14.338082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:14.338082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:14.338082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:14.340651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 23/49] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:14:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:14.344593 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012faeb-7b12-412f-be98-97d3abb351ed None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:14.450484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012faeb-7b12-412f-be98-97d3abb351ed None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:14.488385 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b7c22-434e-4fbd-9576-b308d1eaedb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:14.489092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b7c22-434e-4fbd-9576-b308d1eaedb0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:14.489374 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b7c22-434e-4fbd-9576-b308d1eaedb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:14.489649 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b7c22-434e-4fbd-9576-b308d1eaedb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:14.490409 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b7c22-434e-4fbd-9576-b308d1eaedb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:14.490685 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b7c22-434e-4fbd-9576-b308d1eaedb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:14.492195 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b7c22-434e-4fbd-9576-b308d1eaedb0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:14.500771 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 27/50] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:14.506523 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e063d-75aa-4616-b4e2-29d9e372a36a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:14.567320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:14.606762 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bf8e9-88ae-47a6-9cd9-0cc2f388170f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:14.607051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bf8e9-88ae-47a6-9cd9-0cc2f388170f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:14.607349 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bf8e9-88ae-47a6-9cd9-0cc2f388170f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:14.609271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 28/51] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:14.612283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e063d-75aa-4616-b4e2-29d9e372a36a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:14.613665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4d918-dcf4-428e-9816-92360c7aac06 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:14.613962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4d918-dcf4-428e-9816-92360c7aac06 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:14.614237 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4d918-dcf4-428e-9816-92360c7aac06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:14.631582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5ab4d918-dcf4-428e-9816-92360c7aac06 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:14.632818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5ab4d918-dcf4-428e-9816-92360c7aac06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:14.643709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:14.648199 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b3939-6bd2-4f24-9894-2e80ea52fcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:14.649136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b3939-6bd2-4f24-9894-2e80ea52fcd2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:14.649424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b3939-6bd2-4f24-9894-2e80ea52fcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:14.649701 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b3939-6bd2-4f24-9894-2e80ea52fcd2 None admin] PATH_INFO: `/v3/users/91f07a0a44be4b2f8401d0649c1ba808` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:14.651177 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b3939-6bd2-4f24-9894-2e80ea52fcd2 None admin] RBAC: Authorizing `identity:get_user(user_id=91f07a0a44be4b2f8401d0649c1ba808)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:14.652673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b3939-6bd2-4f24-9894-2e80ea52fcd2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:14.654664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 24/52] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:14 2022] GET /identity/v3/users/91f07a0a44be4b2f8401d0649c1ba808 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:14.659842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b3939-6bd2-4f24-9894-2e80ea52fcd2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:14.703726 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 29/53] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:14.727314 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4d918-dcf4-428e-9816-92360c7aac06 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:14.834173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4d918-dcf4-428e-9816-92360c7aac06 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:14.869315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b3939-6bd2-4f24-9894-2e80ea52fcd2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:14.870191 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e93c1-980c-4342-986b-09dee51d5951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:14.870997 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e93c1-980c-4342-986b-09dee51d5951 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:14.871278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e93c1-980c-4342-986b-09dee51d5951 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:14.871526 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e93c1-980c-4342-986b-09dee51d5951 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:14.872719 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e93c1-980c-4342-986b-09dee51d5951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:14.874223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e93c1-980c-4342-986b-09dee51d5951 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:14.875887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 30/54] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:14:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:14.881442 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e93c1-980c-4342-986b-09dee51d5951 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:14.896710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:14.896981 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:14.908648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c7a34-f713-4826-8297-06b9cdff4160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:14.910025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c7a34-f713-4826-8297-06b9cdff4160 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:14.910534 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c7a34-f713-4826-8297-06b9cdff4160 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:14.911036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c7a34-f713-4826-8297-06b9cdff4160 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:14.913109 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c7a34-f713-4826-8297-06b9cdff4160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:14.915084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c7a34-f713-4826-8297-06b9cdff4160 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:14.916752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 25/55] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:14:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:14.922727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c7a34-f713-4826-8297-06b9cdff4160 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:14.987319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e93c1-980c-4342-986b-09dee51d5951 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:15.021516 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c7a34-f713-4826-8297-06b9cdff4160 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:15.023265 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737ee75-5507-42d8-94de-515e67d44d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:15.023933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737ee75-5507-42d8-94de-515e67d44d42 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:15.024214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737ee75-5507-42d8-94de-515e67d44d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:15.024486 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737ee75-5507-42d8-94de-515e67d44d42 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:15.025239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737ee75-5507-42d8-94de-515e67d44d42 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:15.026686 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737ee75-5507-42d8-94de-515e67d44d42 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:15.052648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 31/56] 10.222.0.26 () {60 vars in 1140 bytes} [Tue Jul 12 03:14:14 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:14:15.054737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d153f7-d9fc-488d-b729-c646d0284937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:15.055476 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d153f7-d9fc-488d-b729-c646d0284937 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:15.055832 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d153f7-d9fc-488d-b729-c646d0284937 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:15.056101 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d153f7-d9fc-488d-b729-c646d0284937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:15.056985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d153f7-d9fc-488d-b729-c646d0284937 None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.domain.id=default, user.id=91f07a0a44be4b2f8401d0649c1ba808) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:15.057298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d153f7-d9fc-488d-b729-c646d0284937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:15.058812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d153f7-d9fc-488d-b729-c646d0284937 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:15.068972 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 26/57] 10.222.0.26 () {56 vars in 1322 bytes} [Tue Jul 12 03:14:14 2022] GET /identity/v3/role_assignments?user.id=91f07a0a44be4b2f8401d0649c1ba808&scope.domain.id=default&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:17.065403 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f3238-b445-4def-9eb1-c5e4b0e20e70 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:17.066262 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f3238-b445-4def-9eb1-c5e4b0e20e70 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:17.066262 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f3238-b445-4def-9eb1-c5e4b0e20e70 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:17.068488 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 32/58] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:17.073840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2475a-f8d1-47f0-a440-f30c3fcdf8a8 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:17.074276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2475a-f8d1-47f0-a440-f30c3fcdf8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:17.074362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2475a-f8d1-47f0-a440-f30c3fcdf8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:17.098682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-80c2475a-f8d1-47f0-a440-f30c3fcdf8a8 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:17.099874 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-80c2475a-f8d1-47f0-a440-f30c3fcdf8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:17.163369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:17.181124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 27/59] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:17.206485 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f3238-b445-4def-9eb1-c5e4b0e20e70 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:17.277022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:17.324502 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f3238-b445-4def-9eb1-c5e4b0e20e70 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:17.360433 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08fef8-de6c-4f0c-a43f-73cf6707bc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:17.361270 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08fef8-de6c-4f0c-a43f-73cf6707bc00 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:17.361557 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08fef8-de6c-4f0c-a43f-73cf6707bc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:17.361839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08fef8-de6c-4f0c-a43f-73cf6707bc00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:17.363092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08fef8-de6c-4f0c-a43f-73cf6707bc00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:17.364565 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08fef8-de6c-4f0c-a43f-73cf6707bc00 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:17.366247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 33/60] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:14:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:17.372053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2475a-f8d1-47f0-a440-f30c3fcdf8a8 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:17.477689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2475a-f8d1-47f0-a440-f30c3fcdf8a8 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:17.522639 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e45926-2d16-4555-8826-2f881f19a201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:17.523312 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e45926-2d16-4555-8826-2f881f19a201 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:17.523596 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e45926-2d16-4555-8826-2f881f19a201 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:17.523877 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e45926-2d16-4555-8826-2f881f19a201 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:17.524617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e45926-2d16-4555-8826-2f881f19a201 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:17.526104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e45926-2d16-4555-8826-2f881f19a201 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:17.557529 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 28/61] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:14:17 2022] POST /identity/v3/users => generated 275 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:14:20.673187 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e009a4-dce7-49f8-b61b-bf99dc09f7da None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:20.674274 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e009a4-dce7-49f8-b61b-bf99dc09f7da None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:20.674782 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e009a4-dce7-49f8-b61b-bf99dc09f7da None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:20.676476 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 34/62] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:14:20.687597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac1b9-5b70-40f3-8b79-b6f1c249021f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:20.688546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac1b9-5b70-40f3-8b79-b6f1c249021f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:20.689074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac1b9-5b70-40f3-8b79-b6f1c249021f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:20.704110 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f4c8b-99a3-4fe4-b8cf-3d4fd9957639 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:20.707191 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f4c8b-99a3-4fe4-b8cf-3d4fd9957639 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:20.707680 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f4c8b-99a3-4fe4-b8cf-3d4fd9957639 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:20.710702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 35/63] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:20.714976 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ceb4d-344f-48d1-af04-ac03166bbcd9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:20.715493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ceb4d-344f-48d1-af04-ac03166bbcd9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:20.716005 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ceb4d-344f-48d1-af04-ac03166bbcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:20.721561 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-99bac1b9-5b70-40f3-8b79-b6f1c249021f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:20.723634 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-99bac1b9-5b70-40f3-8b79-b6f1c249021f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:20.734171 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-188ceb4d-344f-48d1-af04-ac03166bbcd9 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:20.735741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-188ceb4d-344f-48d1-af04-ac03166bbcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:20.781647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:20.829621 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 29/64] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:20.844979 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 36/65] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:20.862332 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bac1b9-5b70-40f3-8b79-b6f1c249021f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:20.876477 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ceb4d-344f-48d1-af04-ac03166bbcd9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:20.988571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:21.024556 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bac1b9-5b70-40f3-8b79-b6f1c249021f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:21.070338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ceb4d-344f-48d1-af04-ac03166bbcd9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:21.088633 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d905313-ff39-4f43-ba1f-5fe478c38368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:21.089931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d905313-ff39-4f43-ba1f-5fe478c38368 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:21.090494 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d905313-ff39-4f43-ba1f-5fe478c38368 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:21.090905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d905313-ff39-4f43-ba1f-5fe478c38368 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:21.105059 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d905313-ff39-4f43-ba1f-5fe478c38368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:21.110592 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab81542-2361-4c0a-9944-1760702ab8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:21.111577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab81542-2361-4c0a-9944-1760702ab8cd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:21.111995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab81542-2361-4c0a-9944-1760702ab8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:21.112401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab81542-2361-4c0a-9944-1760702ab8cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:21.113880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7d905313-ff39-4f43-ba1f-5fe478c38368 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:21.113880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:21.113880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:21.113880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:21.113880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:21.113880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:21.113880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:21.113880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:21.113880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:21.113880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:21.113880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:21.113880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:21.113880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:21.113880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:21.113880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:21.113880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:21.114883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:21.114883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:21.114883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:21.114883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:21.114883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:21.114883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:21.114883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:21.114883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:21.114883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:21.114883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:21.114883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:21.114883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:21.114883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:21.114883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:21.114883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:21.114883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:21.115811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:21.115811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:21.115811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:21.115811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:21.115811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:21.115811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:21.115811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:21.115811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:21.115811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:21.115811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:21.115811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:21.115811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:21.115811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 30/66] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:21.116565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fcbd1-00a2-4867-8c05-95ef5aab3b31 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:21.116788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fcbd1-00a2-4867-8c05-95ef5aab3b31 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:21.117068 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fcbd1-00a2-4867-8c05-95ef5aab3b31 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:21.123177 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 31/67] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:21.124158 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fcbd1-00a2-4867-8c05-95ef5aab3b31 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:21.130999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab81542-2361-4c0a-9944-1760702ab8cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:21.140960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-eab81542-2361-4c0a-9944-1760702ab8cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:21.140960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:21.140960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:21.140960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:21.140960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:21.140960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:21.140960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:21.140960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:21.140960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:21.140960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:21.140960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:21.140960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:21.140960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:21.140960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:21.140960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:21.140960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:21.141855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:21.141855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:21.141855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:21.141855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:21.141855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:21.141855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:21.141855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:21.141855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:21.141855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:21.141855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:21.141855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:21.141855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:21.141855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:21.141855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:21.141855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:21.141855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:21.142632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:21.142632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:21.142632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:21.142632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:21.142632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:21.142632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:21.142632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:21.142632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:21.142632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:21.142632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:21.142632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:21.142632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:21.145684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 37/68] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:14:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:14:21.151631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cdc7e-bc70-4a58-8e47-beccb2e2ef83 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:21.151631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cdc7e-bc70-4a58-8e47-beccb2e2ef83 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:21.151631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cdc7e-bc70-4a58-8e47-beccb2e2ef83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:21.170800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:21.173095 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-018cdc7e-bc70-4a58-8e47-beccb2e2ef83 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:21.174517 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-018cdc7e-bc70-4a58-8e47-beccb2e2ef83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:21.250805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fcbd1-00a2-4867-8c05-95ef5aab3b31 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:21.276047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 38/69] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:21.281402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cdc7e-bc70-4a58-8e47-beccb2e2ef83 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:21.305865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d840e-ef6c-4fdf-b57d-ab7bdfab8fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:21.306552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d840e-ef6c-4fdf-b57d-ab7bdfab8fad None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:21.307046 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d840e-ef6c-4fdf-b57d-ab7bdfab8fad None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:21.307188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d840e-ef6c-4fdf-b57d-ab7bdfab8fad None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:21.307861 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d840e-ef6c-4fdf-b57d-ab7bdfab8fad None admin] RBAC: Adding query filter params (name=member) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:21.308172 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d840e-ef6c-4fdf-b57d-ab7bdfab8fad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:21.309609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d840e-ef6c-4fdf-b57d-ab7bdfab8fad None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:21.319706 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 32/70] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:21.321039 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f706a2-c54c-44db-86da-ef17741ae8f1 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:21.321325 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f706a2-c54c-44db-86da-ef17741ae8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:21.321597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f706a2-c54c-44db-86da-ef17741ae8f1 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:21.324637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 33/71] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:21.325381 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f706a2-c54c-44db-86da-ef17741ae8f1 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:21.348472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:21.394765 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cdc7e-bc70-4a58-8e47-beccb2e2ef83 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:21.424784 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:21.429029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d5809-1036-45f2-a7b7-815d81042978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:21.429705 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d5809-1036-45f2-a7b7-815d81042978 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:21.429987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d5809-1036-45f2-a7b7-815d81042978 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:21.430261 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d5809-1036-45f2-a7b7-815d81042978 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:21.431020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d5809-1036-45f2-a7b7-815d81042978 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:21.431322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d5809-1036-45f2-a7b7-815d81042978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:21.432459 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f706a2-c54c-44db-86da-ef17741ae8f1 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:21.432741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d5809-1036-45f2-a7b7-815d81042978 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:21.440962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 39/72] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:21.441758 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d5809-1036-45f2-a7b7-815d81042978 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:21.472613 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a57b1-ef2d-4d6e-8683-f708046c5c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:21.473989 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a57b1-ef2d-4d6e-8683-f708046c5c1c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:21.474294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a57b1-ef2d-4d6e-8683-f708046c5c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:21.474595 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a57b1-ef2d-4d6e-8683-f708046c5c1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:21.485007 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a57b1-ef2d-4d6e-8683-f708046c5c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:21.493393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-804a57b1-ef2d-4d6e-8683-f708046c5c1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:14:21.493393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:21.493393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:21.493393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:21.493393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:21.493393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:21.493393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:21.493393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:21.493393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:21.493393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:21.493393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:21.493393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:21.493393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:21.493393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:21.493393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:21.493393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:21.494387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:21.494387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:21.494387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:21.494387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:21.494387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:21.494387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:21.494387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:21.494387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:21.494387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:21.494387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:21.494387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:21.494387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:21.494387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:21.494387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:21.494387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:21.494387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:21.495150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:21.495150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:21.495150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:21.495150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:21.495150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:21.495150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:21.495150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:21.495150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:21.495150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:21.495150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:21.495150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:14:21.495150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:21.495150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 34/73] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:14:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:21.495911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688b8fd-ea26-43b4-9dc8-885eacc81e89 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:21.496203 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688b8fd-ea26-43b4-9dc8-885eacc81e89 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:21.496482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688b8fd-ea26-43b4-9dc8-885eacc81e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:21.512779 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-7688b8fd-ea26-43b4-9dc8-885eacc81e89 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:21.513911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7688b8fd-ea26-43b4-9dc8-885eacc81e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:21.547872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d5809-1036-45f2-a7b7-815d81042978 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:21.563981 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:21.581683 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d7e91-3a07-4a44-b57e-390433630cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:21.582569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d7e91-3a07-4a44-b57e-390433630cde None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:21.582849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d7e91-3a07-4a44-b57e-390433630cde None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:21.583119 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d7e91-3a07-4a44-b57e-390433630cde None admin] PATH_INFO: `/v3/users/b1f6a3270f434dc79c93cb4804c35e56` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:21.584373 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 35/74] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:21.589936 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75330a4-2ddf-43d1-8ca3-c2e0ba60635a None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:21.590226 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75330a4-2ddf-43d1-8ca3-c2e0ba60635a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:21.590489 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75330a4-2ddf-43d1-8ca3-c2e0ba60635a None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:21.592024 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 36/75] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:21.596763 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75330a4-2ddf-43d1-8ca3-c2e0ba60635a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:21.596998 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d7e91-3a07-4a44-b57e-390433630cde None admin] RBAC: Authorizing `identity:get_user(user_id=b1f6a3270f434dc79c93cb4804c35e56)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:21.598834 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d7e91-3a07-4a44-b57e-390433630cde None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:21.604893 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 40/76] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:21 2022] GET /identity/v3/users/b1f6a3270f434dc79c93cb4804c35e56 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:21.604893 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d7e91-3a07-4a44-b57e-390433630cde None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:21.681994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:21.698372 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75330a4-2ddf-43d1-8ca3-c2e0ba60635a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:21.702972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d7e91-3a07-4a44-b57e-390433630cde None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:21.735136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96982990-0dfb-4a34-94d4-94df522675e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:21.736023 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96982990-0dfb-4a34-94d4-94df522675e1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:21.736136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86983b0-3df8-4c53-bc6b-77e22fbbaef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:21.736305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96982990-0dfb-4a34-94d4-94df522675e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:21.736605 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96982990-0dfb-4a34-94d4-94df522675e1 None admin] PATH_INFO: `/v3/users/91f07a0a44be4b2f8401d0649c1ba808` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:21.736931 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86983b0-3df8-4c53-bc6b-77e22fbbaef3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:21.737257 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86983b0-3df8-4c53-bc6b-77e22fbbaef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:21.737532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86983b0-3df8-4c53-bc6b-77e22fbbaef3 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:21.737929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96982990-0dfb-4a34-94d4-94df522675e1 None admin] RBAC: Authorizing `identity:get_user(user_id=91f07a0a44be4b2f8401d0649c1ba808)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:21.738287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86983b0-3df8-4c53-bc6b-77e22fbbaef3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:21.738596 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86983b0-3df8-4c53-bc6b-77e22fbbaef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:21.739409 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96982990-0dfb-4a34-94d4-94df522675e1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:21.739957 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86983b0-3df8-4c53-bc6b-77e22fbbaef3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:21.744700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 37/77] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:21 2022] GET /identity/v3/users/91f07a0a44be4b2f8401d0649c1ba808 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:21.744700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773db4c-d3e7-4b2e-b188-b4bf473b2c8d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:21.744700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773db4c-d3e7-4b2e-b188-b4bf473b2c8d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:21.744700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773db4c-d3e7-4b2e-b188-b4bf473b2c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:21.755076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 41/78] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:14:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:21.756186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86983b0-3df8-4c53-bc6b-77e22fbbaef3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:21.760081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c773db4c-d3e7-4b2e-b188-b4bf473b2c8d None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:21.761314 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c773db4c-d3e7-4b2e-b188-b4bf473b2c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:21.798272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:21.833258 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 38/79] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:21.834185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773db4c-d3e7-4b2e-b188-b4bf473b2c8d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:21.866293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86983b0-3df8-4c53-bc6b-77e22fbbaef3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:21.901911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12491556-26c0-49b1-bc2d-cb06af78d989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:21.902577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12491556-26c0-49b1-bc2d-cb06af78d989 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:21.902861 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12491556-26c0-49b1-bc2d-cb06af78d989 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:21.903139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12491556-26c0-49b1-bc2d-cb06af78d989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:21.926209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:21.943511 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773db4c-d3e7-4b2e-b188-b4bf473b2c8d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:21.973367 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12491556-26c0-49b1-bc2d-cb06af78d989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:21.974894 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12491556-26c0-49b1-bc2d-cb06af78d989 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:21.978068 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066065e-6f0e-45a4-89d6-91a44519c530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:21.978868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066065e-6f0e-45a4-89d6-91a44519c530 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:21.979150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066065e-6f0e-45a4-89d6-91a44519c530 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:21.979432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066065e-6f0e-45a4-89d6-91a44519c530 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:21.980685 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066065e-6f0e-45a4-89d6-91a44519c530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:21.982129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066065e-6f0e-45a4-89d6-91a44519c530 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:21.983836 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 39/80] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:14:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:21.988857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066065e-6f0e-45a4-89d6-91a44519c530 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:22.014367 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:22.079640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 42/81] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:22.084297 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12491556-26c0-49b1-bc2d-cb06af78d989 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:22.091026 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066065e-6f0e-45a4-89d6-91a44519c530 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:22.125360 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48155c-361a-4050-b16c-1a0aa40f1821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:22.126036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48155c-361a-4050-b16c-1a0aa40f1821 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:22.126315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48155c-361a-4050-b16c-1a0aa40f1821 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:22.126592 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48155c-361a-4050-b16c-1a0aa40f1821 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:22.148876 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:22.185587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12491556-26c0-49b1-bc2d-cb06af78d989 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:22.202514 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48155c-361a-4050-b16c-1a0aa40f1821 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:22.204370 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48155c-361a-4050-b16c-1a0aa40f1821 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:22.218826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae5380-76de-4dfd-9f80-e69248163b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:22.219727 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae5380-76de-4dfd-9f80-e69248163b7d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:22.220012 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae5380-76de-4dfd-9f80-e69248163b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:22.220282 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae5380-76de-4dfd-9f80-e69248163b7d None admin] PATH_INFO: `/v3/users/b1f6a3270f434dc79c93cb4804c35e56` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:22.221500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae5380-76de-4dfd-9f80-e69248163b7d None admin] RBAC: Authorizing `identity:get_user(user_id=b1f6a3270f434dc79c93cb4804c35e56)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:22.223303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae5380-76de-4dfd-9f80-e69248163b7d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:22.224991 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 43/82] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:22 2022] GET /identity/v3/users/b1f6a3270f434dc79c93cb4804c35e56 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:22.225745 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae5380-76de-4dfd-9f80-e69248163b7d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:22.229675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:22.307024 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 40/83] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:22.307853 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48155c-361a-4050-b16c-1a0aa40f1821 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:22.331147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae5380-76de-4dfd-9f80-e69248163b7d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:22.357481 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:22.364913 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08352447-79c4-446d-a5a6-b1835b83ebec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:22.365717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08352447-79c4-446d-a5a6-b1835b83ebec None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:22.365994 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08352447-79c4-446d-a5a6-b1835b83ebec None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:22.366262 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08352447-79c4-446d-a5a6-b1835b83ebec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:22.377066 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08352447-79c4-446d-a5a6-b1835b83ebec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:22.384672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-08352447-79c4-446d-a5a6-b1835b83ebec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:22.384672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:22.384672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:22.384672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:22.384672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:22.384672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:22.384672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:22.384672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:22.384672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:22.384672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:22.384672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:22.384672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:22.384672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:22.384672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:22.384672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:22.384672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:22.385582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:22.385582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:22.385582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:22.385582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:22.385582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:22.385582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:22.385582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:22.385582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:22.385582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:22.385582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:22.385582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:22.385582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:22.385582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:22.385582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:22.385582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:22.385582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:22.391625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:22.391625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:22.391625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:22.391625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:22.391625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:22.391625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:22.391625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:22.391625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:22.391625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:22.391625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:22.391625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:22.391625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:22.391625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 44/84] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:22.391625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08352447-79c4-446d-a5a6-b1835b83ebec None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:22.405858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48155c-361a-4050-b16c-1a0aa40f1821 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:22.439539 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eaa23c-f3f8-4d37-b1e6-288e633d89b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:22.440220 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eaa23c-f3f8-4d37-b1e6-288e633d89b9 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:22.440504 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eaa23c-f3f8-4d37-b1e6-288e633d89b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:22.440805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eaa23c-f3f8-4d37-b1e6-288e633d89b9 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:22.441528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eaa23c-f3f8-4d37-b1e6-288e633d89b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:22.443005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eaa23c-f3f8-4d37-b1e6-288e633d89b9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:22.447996 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:22.463726 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 41/85] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:14:22 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:14:22.464696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eaa23c-f3f8-4d37-b1e6-288e633d89b9 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:22.502145 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08352447-79c4-446d-a5a6-b1835b83ebec None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:22.548728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5dc48-c6f3-41c4-b3d7-260ce2771af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:22.549738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5dc48-c6f3-41c4-b3d7-260ce2771af0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:22.550074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5dc48-c6f3-41c4-b3d7-260ce2771af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:22.550358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5dc48-c6f3-41c4-b3d7-260ce2771af0 None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:22.551780 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5dc48-c6f3-41c4-b3d7-260ce2771af0 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:22.553428 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5dc48-c6f3-41c4-b3d7-260ce2771af0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:22.560355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 45/86] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:22 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:22.560355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5dc48-c6f3-41c4-b3d7-260ce2771af0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:22.588300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eaa23c-f3f8-4d37-b1e6-288e633d89b9 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:22.600337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:22.633073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450bbdc-4091-4ba9-9419-bd63f090b6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:22.633319 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450bbdc-4091-4ba9-9419-bd63f090b6ee None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:22.633542 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450bbdc-4091-4ba9-9419-bd63f090b6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:22.633825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450bbdc-4091-4ba9-9419-bd63f090b6ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:22.682375 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5dc48-c6f3-41c4-b3d7-260ce2771af0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:22.714347 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450bbdc-4091-4ba9-9419-bd63f090b6ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:22.716405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450bbdc-4091-4ba9-9419-bd63f090b6ee None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:22.729776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:22.739112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373aca28-e4fe-437d-9967-33a16575f7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:22.740138 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373aca28-e4fe-437d-9967-33a16575f7ba None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:22.740545 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373aca28-e4fe-437d-9967-33a16575f7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:22.740906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373aca28-e4fe-437d-9967-33a16575f7ba None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:22.743160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373aca28-e4fe-437d-9967-33a16575f7ba None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:22.744648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373aca28-e4fe-437d-9967-33a16575f7ba None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:22.746665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 46/87] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:22 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:22.747283 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373aca28-e4fe-437d-9967-33a16575f7ba None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:22.843890 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 42/88] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:22.845452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450bbdc-4091-4ba9-9419-bd63f090b6ee None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:22.859579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:22.870598 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373aca28-e4fe-437d-9967-33a16575f7ba None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:22.908213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6aae52-4774-4076-b291-92e06e20436a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:22.909303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6aae52-4774-4076-b291-92e06e20436a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:22.909728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6aae52-4774-4076-b291-92e06e20436a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:22.910265 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6aae52-4774-4076-b291-92e06e20436a None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:22.911471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6aae52-4774-4076-b291-92e06e20436a None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:22.911923 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6aae52-4774-4076-b291-92e06e20436a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:22.913499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6aae52-4774-4076-b291-92e06e20436a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:22.925373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 47/89] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:22.926506 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6aae52-4774-4076-b291-92e06e20436a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:22.970266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450bbdc-4091-4ba9-9419-bd63f090b6ee None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:23.007119 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:23.022191 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a090e-9875-4e7e-a336-356e96d6eaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:23.022854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a090e-9875-4e7e-a336-356e96d6eaef None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:23.023134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a090e-9875-4e7e-a336-356e96d6eaef None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:23.023405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a090e-9875-4e7e-a336-356e96d6eaef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:23.024321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a090e-9875-4e7e-a336-356e96d6eaef None admin] RBAC: Adding query filter params (role.id=713f175e9435403f9e39528c805bd956, scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a, user.id=b1f6a3270f434dc79c93cb4804c35e56) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:23.024566 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a090e-9875-4e7e-a336-356e96d6eaef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:23.026073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a090e-9875-4e7e-a336-356e96d6eaef None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:23.034026 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 43/90] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:22 2022] GET /identity/v3/role_assignments?user.id=b1f6a3270f434dc79c93cb4804c35e56&scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a&role.id=713f175e9435403f9e39528c805bd956 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:23.035017 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a090e-9875-4e7e-a336-356e96d6eaef None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:23.060718 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6aae52-4774-4076-b291-92e06e20436a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:23.184800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:23.196547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6d7cb-a58a-4552-b1fb-b5654359c36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:23.196547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6d7cb-a58a-4552-b1fb-b5654359c36c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:23.196547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6d7cb-a58a-4552-b1fb-b5654359c36c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:23.196547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6d7cb-a58a-4552-b1fb-b5654359c36c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:23.197188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6d7cb-a58a-4552-b1fb-b5654359c36c None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a, user.id=91f07a0a44be4b2f8401d0649c1ba808) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:23.197188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6d7cb-a58a-4552-b1fb-b5654359c36c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:23.198388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6d7cb-a58a-4552-b1fb-b5654359c36c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:23.208739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 48/91] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:22 2022] GET /identity/v3/role_assignments?user.id=91f07a0a44be4b2f8401d0649c1ba808&scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:23.209609 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6d7cb-a58a-4552-b1fb-b5654359c36c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:23.294363 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a090e-9875-4e7e-a336-356e96d6eaef None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:23.449136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac2f2d-1958-4001-97be-4acb227a694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:23.449987 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac2f2d-1958-4001-97be-4acb227a694a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:23.450271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac2f2d-1958-4001-97be-4acb227a694a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:23.450549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac2f2d-1958-4001-97be-4acb227a694a None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:23.456545 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac2f2d-1958-4001-97be-4acb227a694a None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:23.456545 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac2f2d-1958-4001-97be-4acb227a694a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:23.456545 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 44/92] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:23 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:23.462117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac2f2d-1958-4001-97be-4acb227a694a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:23.523192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6d7cb-a58a-4552-b1fb-b5654359c36c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:23.561269 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:23.574272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17197c-468f-49da-84e0-f3c7cdecec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:23.575152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17197c-468f-49da-84e0-f3c7cdecec32 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:23.575427 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17197c-468f-49da-84e0-f3c7cdecec32 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:23.575690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17197c-468f-49da-84e0-f3c7cdecec32 None admin] PATH_INFO: `/v3/users/b1f6a3270f434dc79c93cb4804c35e56` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:23.576935 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17197c-468f-49da-84e0-f3c7cdecec32 None admin] RBAC: Authorizing `identity:get_user(user_id=b1f6a3270f434dc79c93cb4804c35e56)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:23.578923 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17197c-468f-49da-84e0-f3c7cdecec32 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:23.581004 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 49/93] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:23 2022] GET /identity/v3/users/b1f6a3270f434dc79c93cb4804c35e56 => generated 275 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:23.589512 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17197c-468f-49da-84e0-f3c7cdecec32 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:23.694348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac2f2d-1958-4001-97be-4acb227a694a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:23.796224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018af28d-1f74-4e6e-a567-7e97143f48a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:23.797005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018af28d-1f74-4e6e-a567-7e97143f48a4 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:23.797251 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018af28d-1f74-4e6e-a567-7e97143f48a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:23.797478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018af28d-1f74-4e6e-a567-7e97143f48a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:23.801657 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018af28d-1f74-4e6e-a567-7e97143f48a4 None admin] RBAC: Adding query filter params (role.id=690fc625fea1445fa7e0e8f40ae2246c, scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a, user.id=b1f6a3270f434dc79c93cb4804c35e56) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:23.802854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018af28d-1f74-4e6e-a567-7e97143f48a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:23.804605 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018af28d-1f74-4e6e-a567-7e97143f48a4 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:23.822714 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 45/94] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:23 2022] GET /identity/v3/role_assignments?user.id=b1f6a3270f434dc79c93cb4804c35e56&scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a&role.id=690fc625fea1445fa7e0e8f40ae2246c => generated 259 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:23.906885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17197c-468f-49da-84e0-f3c7cdecec32 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:23.975679 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b626fa-81d6-4680-94d7-db16d4c35a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:23.976279 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b626fa-81d6-4680-94d7-db16d4c35a0c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:23.976589 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b626fa-81d6-4680-94d7-db16d4c35a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:23.976874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b626fa-81d6-4680-94d7-db16d4c35a0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:24.082588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:24.091503 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b626fa-81d6-4680-94d7-db16d4c35a0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:24.093098 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b626fa-81d6-4680-94d7-db16d4c35a0c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:24.214630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 50/95] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:24.220246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018af28d-1f74-4e6e-a567-7e97143f48a4 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:24.224651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:24.362211 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018af28d-1f74-4e6e-a567-7e97143f48a4 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:24.408693 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488c5fa-7556-45c9-8551-5d2da3a156bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:24.409579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488c5fa-7556-45c9-8551-5d2da3a156bb None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:24.409857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488c5fa-7556-45c9-8551-5d2da3a156bb None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:24.410132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488c5fa-7556-45c9-8551-5d2da3a156bb None admin] PATH_INFO: `/v3/projects/4e578004e4be45908ee26181fd2d422f` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:24.411338 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488c5fa-7556-45c9-8551-5d2da3a156bb None admin] RBAC: Authorizing `identity:get_project(project_id=4e578004e4be45908ee26181fd2d422f)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:24.412818 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488c5fa-7556-45c9-8551-5d2da3a156bb None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:24.418245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 46/96] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:24 2022] GET /identity/v3/projects/4e578004e4be45908ee26181fd2d422f => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:24.424299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b626fa-81d6-4680-94d7-db16d4c35a0c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:24.536106 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:24.543217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b626fa-81d6-4680-94d7-db16d4c35a0c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:24.591978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff9236-b290-4109-bc49-0f13861e071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:24.592767 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff9236-b290-4109-bc49-0f13861e071b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:24.593116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff9236-b290-4109-bc49-0f13861e071b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:24.593606 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff9236-b290-4109-bc49-0f13861e071b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:24.594471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff9236-b290-4109-bc49-0f13861e071b None admin] RBAC: Adding query filter params (role.id=713f175e9435403f9e39528c805bd956, scope.project.id=4e578004e4be45908ee26181fd2d422f, user.id=b1f6a3270f434dc79c93cb4804c35e56) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:24.594784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff9236-b290-4109-bc49-0f13861e071b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:24.596249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff9236-b290-4109-bc49-0f13861e071b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:24.606506 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 51/97] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:24 2022] GET /identity/v3/role_assignments?user.id=b1f6a3270f434dc79c93cb4804c35e56&scope.project.id=4e578004e4be45908ee26181fd2d422f&role.id=713f175e9435403f9e39528c805bd956 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:25.178398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2877c5-e1b2-4f43-9731-d7d7f9a24647 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:25.179106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2877c5-e1b2-4f43-9731-d7d7f9a24647 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:25.179106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2877c5-e1b2-4f43-9731-d7d7f9a24647 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:25.180610 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 47/98] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:25.185526 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509db8f-b629-4f30-93e4-062514f3c76b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:25.186024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509db8f-b629-4f30-93e4-062514f3c76b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:25.186190 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509db8f-b629-4f30-93e4-062514f3c76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:25.207133 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a509db8f-b629-4f30-93e4-062514f3c76b None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:25.208327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a509db8f-b629-4f30-93e4-062514f3c76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:25.294028 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 52/99] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:25.325173 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2877c5-e1b2-4f43-9731-d7d7f9a24647 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:25.380415 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1266850-62c1-4219-93df-c5760a99a68f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:25.380918 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1266850-62c1-4219-93df-c5760a99a68f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:25.381375 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1266850-62c1-4219-93df-c5760a99a68f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:25.384187 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 53/100] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:25.389922 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb053b-ad6e-43aa-91f7-a8a2037bf8fc None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:25.390347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb053b-ad6e-43aa-91f7-a8a2037bf8fc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:25.390629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb053b-ad6e-43aa-91f7-a8a2037bf8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:25.421817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cfdb053b-ad6e-43aa-91f7-a8a2037bf8fc None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:25.423149 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cfdb053b-ad6e-43aa-91f7-a8a2037bf8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:25.453099 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:25.521292 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2877c5-e1b2-4f43-9731-d7d7f9a24647 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:25.548899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 54/101] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:25.591054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48568663-6723-42b0-92de-ba2b5f01ea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:25.591869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568663-6723-42b0-92de-ba2b5f01ea0e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:25.592158 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568663-6723-42b0-92de-ba2b5f01ea0e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:25.592435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568663-6723-42b0-92de-ba2b5f01ea0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:25.597242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48568663-6723-42b0-92de-ba2b5f01ea0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:25.599073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48568663-6723-42b0-92de-ba2b5f01ea0e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:25.605628 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 48/102] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:14:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:25.612472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb053b-ad6e-43aa-91f7-a8a2037bf8fc None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:25.621538 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48568663-6723-42b0-92de-ba2b5f01ea0e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:25.643682 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:25.791611 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb053b-ad6e-43aa-91f7-a8a2037bf8fc None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:25.847275 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917df130-55cb-4f9e-811c-7a04a2d513a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:25.848692 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917df130-55cb-4f9e-811c-7a04a2d513a1 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:25.849177 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917df130-55cb-4f9e-811c-7a04a2d513a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:25.849644 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917df130-55cb-4f9e-811c-7a04a2d513a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:25.850554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917df130-55cb-4f9e-811c-7a04a2d513a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:25.852214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917df130-55cb-4f9e-811c-7a04a2d513a1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:25.899314 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48568663-6723-42b0-92de-ba2b5f01ea0e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:25.912943 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 55/103] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 03:14:25 2022] POST /identity/v3/projects => generated 302 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:14:25.946771 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8d540-9227-436d-890a-0d061374bcbe None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:25.947589 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8d540-9227-436d-890a-0d061374bcbe None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:25.948084 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8d540-9227-436d-890a-0d061374bcbe None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:25.950192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 56/104] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:14:25.956366 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ab4fa-e568-48e4-b873-25ca10a6797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:25.957263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ab4fa-e568-48e4-b873-25ca10a6797b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:25.957591 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ab4fa-e568-48e4-b873-25ca10a6797b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:25.957831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f3672-5bdd-4d74-9922-6a2aa2a4b07b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:25.957954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ab4fa-e568-48e4-b873-25ca10a6797b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:25.958507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f3672-5bdd-4d74-9922-6a2aa2a4b07b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:25.959107 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f3672-5bdd-4d74-9922-6a2aa2a4b07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:25.985004 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ab4fa-e568-48e4-b873-25ca10a6797b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:25.993903 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3c8f3672-5bdd-4d74-9922-6a2aa2a4b07b None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:25.995514 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3c8f3672-5bdd-4d74-9922-6a2aa2a4b07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:25.998149 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:26.000682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-255ab4fa-e568-48e4-b873-25ca10a6797b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:26.000682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:26.000682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:26.000682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:26.000682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:26.000682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:26.000682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:26.000682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:26.000682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:26.000682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:26.000682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:26.000682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:26.000682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:26.000682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:26.000682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:26.000682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:26.001576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:26.001576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:26.001576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:26.001576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:26.001576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:26.001576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:26.001576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:26.001576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:26.001576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:26.001576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:26.001576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:26.001576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:26.001576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:26.001576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:26.001576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:26.001576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:26.002813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:26.002813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:26.002813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:26.002813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:26.002813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:26.002813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:26.002813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:26.002813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:26.002813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:26.002813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:26.002813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:26.002813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:26.002813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 49/105] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:14:26.008391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ab4fa-e568-48e4-b873-25ca10a6797b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:26.140105 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ab4fa-e568-48e4-b873-25ca10a6797b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:26.148893 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:26.154172 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 57/106] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:26.175858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e810-dba5-42e9-9ff5-d773222f3f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:26.176573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e810-dba5-42e9-9ff5-d773222f3f95 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:26.176862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e810-dba5-42e9-9ff5-d773222f3f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:26.177139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e810-dba5-42e9-9ff5-d773222f3f95 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:26.177917 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094e810-dba5-42e9-9ff5-d773222f3f95 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:26.178225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094e810-dba5-42e9-9ff5-d773222f3f95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:26.179634 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094e810-dba5-42e9-9ff5-d773222f3f95 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:26.189334 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 50/107] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:26.196805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e810-dba5-42e9-9ff5-d773222f3f95 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:26.197019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f3672-5bdd-4d74-9922-6a2aa2a4b07b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:26.263442 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:26.309443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e810-dba5-42e9-9ff5-d773222f3f95 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:26.344699 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d394b8-2fe4-4e92-a06e-a3b8b2987b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:26.345513 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d394b8-2fe4-4e92-a06e-a3b8b2987b90 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:26.345791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d394b8-2fe4-4e92-a06e-a3b8b2987b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:26.346060 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d394b8-2fe4-4e92-a06e-a3b8b2987b90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:26.357266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d394b8-2fe4-4e92-a06e-a3b8b2987b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:26.365179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-f4d394b8-2fe4-4e92-a06e-a3b8b2987b90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:26.365179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:26.365179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:26.365179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:26.365179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:26.365179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:26.365179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:26.365179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:26.365179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:26.365179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:26.365179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:26.365179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:26.365179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:26.365179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:26.365179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:26.365179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:26.366106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:26.366106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:26.366106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:26.366106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:26.366106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:26.366106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:26.366106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:26.366106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:26.366106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:26.366106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:26.366106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:26.366106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:26.366106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:26.366106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:26.366106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:26.366106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:26.368466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:26.368466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:26.368466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:26.368466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:26.368466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:26.368466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:26.368466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:26.368466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:26.368466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:26.368466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:26.368466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:26.368466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:26.368466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 51/108] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:26.377729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d394b8-2fe4-4e92-a06e-a3b8b2987b90 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:26.393142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f3672-5bdd-4d74-9922-6a2aa2a4b07b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:26.457833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34021db-1791-43a8-9ad7-af5252e42f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:26.458969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34021db-1791-43a8-9ad7-af5252e42f76 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:26.459256 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34021db-1791-43a8-9ad7-af5252e42f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:26.459537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34021db-1791-43a8-9ad7-af5252e42f76 None admin] PATH_INFO: `/v3/users/64d9750809ab423f853ee96e998330a8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:26.488658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34021db-1791-43a8-9ad7-af5252e42f76 None admin] RBAC: Authorizing `identity:get_user(user_id=64d9750809ab423f853ee96e998330a8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:26.490175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34021db-1791-43a8-9ad7-af5252e42f76 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:26.497493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 58/109] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:26 2022] GET /identity/v3/users/64d9750809ab423f853ee96e998330a8 => generated 289 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:26.502288 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34021db-1791-43a8-9ad7-af5252e42f76 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:26.568741 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d394b8-2fe4-4e92-a06e-a3b8b2987b90 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:26.606485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:26.629539 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb271ef-de28-49c0-bb7d-786fc8bda561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:26.630445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:26.631402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb271ef-de28-49c0-bb7d-786fc8bda561 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:26.631688 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb271ef-de28-49c0-bb7d-786fc8bda561 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:26.631969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb271ef-de28-49c0-bb7d-786fc8bda561 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:26.632773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb271ef-de28-49c0-bb7d-786fc8bda561 None admin] RBAC: Adding query filter params (name=member) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:26.633201 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb271ef-de28-49c0-bb7d-786fc8bda561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:26.635163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb271ef-de28-49c0-bb7d-786fc8bda561 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:26.651015 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 52/110] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:26.657376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb271ef-de28-49c0-bb7d-786fc8bda561 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:26.740017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34021db-1791-43a8-9ad7-af5252e42f76 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:26.788106 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea1a18-bb41-46dd-a8ec-18c807625e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:26.788812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea1a18-bb41-46dd-a8ec-18c807625e55 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:26.789102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea1a18-bb41-46dd-a8ec-18c807625e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:26.789382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea1a18-bb41-46dd-a8ec-18c807625e55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:26.823475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb271ef-de28-49c0-bb7d-786fc8bda561 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:26.858514 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85746326-81cb-49b5-bb0c-5a7c3dd15776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:26.860170 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85746326-81cb-49b5-bb0c-5a7c3dd15776 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:26.860894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85746326-81cb-49b5-bb0c-5a7c3dd15776 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:26.861357 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85746326-81cb-49b5-bb0c-5a7c3dd15776 None admin] PATH_INFO: `/v3/users/b1f6a3270f434dc79c93cb4804c35e56` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:26.863207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85746326-81cb-49b5-bb0c-5a7c3dd15776 None admin] RBAC: Authorizing `identity:get_user(user_id=b1f6a3270f434dc79c93cb4804c35e56)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:26.865309 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85746326-81cb-49b5-bb0c-5a7c3dd15776 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:26.867723 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 53/111] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:26 2022] GET /identity/v3/users/b1f6a3270f434dc79c93cb4804c35e56 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:26.869317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e42721-ff1b-4b3d-8415-6c7402a92f8e None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:26.869919 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e42721-ff1b-4b3d-8415-6c7402a92f8e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:26.870371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e42721-ff1b-4b3d-8415-6c7402a92f8e None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:26.872630 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 54/112] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:26.873472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea1a18-bb41-46dd-a8ec-18c807625e55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:26.874189 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720166f8-b779-4297-9b40-6e7d98266103 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:26.874636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720166f8-b779-4297-9b40-6e7d98266103 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:26.875137 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720166f8-b779-4297-9b40-6e7d98266103 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:26.876554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 55/113] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:26.877644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720166f8-b779-4297-9b40-6e7d98266103 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:26.879190 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea1a18-bb41-46dd-a8ec-18c807625e55 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:26.949007 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:26.956271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:27.001657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 59/114] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:27.002896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ab394-46de-463a-a511-58471e64f59c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:27.003191 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ab394-46de-463a-a511-58471e64f59c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:27.003470 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ab394-46de-463a-a511-58471e64f59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:27.017911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720166f8-b779-4297-9b40-6e7d98266103 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:27.025581 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8f8ab394-46de-463a-a511-58471e64f59c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:27.026789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8f8ab394-46de-463a-a511-58471e64f59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:27.058895 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3d9d7-ad0b-4a14-ac47-369527c2f39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:27.060169 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3d9d7-ad0b-4a14-ac47-369527c2f39e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:27.060720 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3d9d7-ad0b-4a14-ac47-369527c2f39e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:27.061205 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3d9d7-ad0b-4a14-ac47-369527c2f39e None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:27.062670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3d9d7-ad0b-4a14-ac47-369527c2f39e None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:27.064435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3d9d7-ad0b-4a14-ac47-369527c2f39e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:27.066461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 56/115] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:26 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:27.067983 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bffa4-9300-4f8a-ad4f-17d5aaffff54 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:27.068488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bffa4-9300-4f8a-ad4f-17d5aaffff54 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:27.068971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bffa4-9300-4f8a-ad4f-17d5aaffff54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:27.089284 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9d4bffa4-9300-4f8a-ad4f-17d5aaffff54 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:27.090661 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9d4bffa4-9300-4f8a-ad4f-17d5aaffff54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:27.110579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 60/116] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:27.111997 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ab394-46de-463a-a511-58471e64f59c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:27.171895 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 57/117] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:27.173226 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bffa4-9300-4f8a-ad4f-17d5aaffff54 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:27.224985 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:27.241174 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ab394-46de-463a-a511-58471e64f59c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:27.245889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:27.289441 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d799f0-f400-4612-a652-427df0005d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:27.291254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d799f0-f400-4612-a652-427df0005d5d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:27.291718 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d799f0-f400-4612-a652-427df0005d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:27.292395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d799f0-f400-4612-a652-427df0005d5d None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:27.294410 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d799f0-f400-4612-a652-427df0005d5d None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:27.297211 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d799f0-f400-4612-a652-427df0005d5d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:27.299084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bffa4-9300-4f8a-ad4f-17d5aaffff54 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:27.299353 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 61/118] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:27 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:27.300277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d799f0-f400-4612-a652-427df0005d5d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:27.341051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37e2cb-c651-48df-9b76-3b4a5438921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:27.341941 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37e2cb-c651-48df-9b76-3b4a5438921c None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:27.342284 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37e2cb-c651-48df-9b76-3b4a5438921c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:27.342653 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37e2cb-c651-48df-9b76-3b4a5438921c None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a/users/b1f6a3270f434dc79c93cb4804c35e56/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:27.345891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37e2cb-c651-48df-9b76-3b4a5438921c None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a, user_id=b1f6a3270f434dc79c93cb4804c35e56, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:27.346917 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37e2cb-c651-48df-9b76-3b4a5438921c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:27.372544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 58/119] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:14:27 2022] PUT /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a/users/b1f6a3270f434dc79c93cb4804c35e56/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:14:27.372544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37e2cb-c651-48df-9b76-3b4a5438921c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:27.479481 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d799f0-f400-4612-a652-427df0005d5d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:27.557655 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e37b1-d1d9-4408-9839-43f4807a9216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:27.559173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e37b1-d1d9-4408-9839-43f4807a9216 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:27.559679 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e37b1-d1d9-4408-9839-43f4807a9216 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:27.560168 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e37b1-d1d9-4408-9839-43f4807a9216 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:27.579602 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e37b1-d1d9-4408-9839-43f4807a9216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:27.580652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37e2cb-c651-48df-9b76-3b4a5438921c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:27.590905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-437e37b1-d1d9-4408-9839-43f4807a9216 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:27.590905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:27.590905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:27.590905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:27.590905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:27.590905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:27.590905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:27.590905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:27.590905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:27.590905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:27.590905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:27.590905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:27.590905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:27.590905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:27.590905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:27.590905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:27.591843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:27.591843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:27.591843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:27.591843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:27.591843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:27.591843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:27.591843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:27.591843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:27.591843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:27.591843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:27.591843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:27.591843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:27.591843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:27.591843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:27.591843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:27.591843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:27.592784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:27.592784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:27.592784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:27.592784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:27.592784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:27.592784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:27.592784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:27.592784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:27.592784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:27.592784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:27.592784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:27.592784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:27.592784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 62/120] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:14:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:27.593468 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e37b1-d1d9-4408-9839-43f4807a9216 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:27.594487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:27.628885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b6e55-0afc-4b6d-8a0d-94130cfb403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:27.630051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b6e55-0afc-4b6d-8a0d-94130cfb403c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:27.630500 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b6e55-0afc-4b6d-8a0d-94130cfb403c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:27.630951 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b6e55-0afc-4b6d-8a0d-94130cfb403c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:27.631049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:27.646663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b6e55-0afc-4b6d-8a0d-94130cfb403c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:27.655748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-e68b6e55-0afc-4b6d-8a0d-94130cfb403c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:14:27.655748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:27.655748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:27.655748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:27.655748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:27.655748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:27.655748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:27.655748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:27.655748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:27.655748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:27.655748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:27.655748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:27.655748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:27.655748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:27.655748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:27.655748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:27.656671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:27.656671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:27.656671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:27.656671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:27.656671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:27.656671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:27.656671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:27.656671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:27.656671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:27.656671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:27.656671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:27.656671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:27.656671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:27.656671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:27.656671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:27.656671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:27.657446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:27.657446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:27.657446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:27.657446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:27.657446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:27.657446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:27.657446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:27.657446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:27.657446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:27.657446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:27.657446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:14:27.657446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:27.659617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 59/121] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:14:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:27.660829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b6e55-0afc-4b6d-8a0d-94130cfb403c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:27.756403 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e37b1-d1d9-4408-9839-43f4807a9216 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:27.802351 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9e176-1718-460b-9a4a-95c89e41e808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:27.803035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9e176-1718-460b-9a4a-95c89e41e808 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:27.803317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9e176-1718-460b-9a4a-95c89e41e808 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:27.803433 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b6e55-0afc-4b6d-8a0d-94130cfb403c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:27.803589 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9e176-1718-460b-9a4a-95c89e41e808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:27.804545 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9e176-1718-460b-9a4a-95c89e41e808 None admin] RBAC: Adding query filter params (role.id=a96cd51936d549a3986a0e7e1f50f040, scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a, user.id=64d9750809ab423f853ee96e998330a8) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:27.805110 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9e176-1718-460b-9a4a-95c89e41e808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:27.807447 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9e176-1718-460b-9a4a-95c89e41e808 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:27.815347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 63/122] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:27 2022] GET /identity/v3/role_assignments?user.id=64d9750809ab423f853ee96e998330a8&scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a&role.id=a96cd51936d549a3986a0e7e1f50f040 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:27.816172 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9e176-1718-460b-9a4a-95c89e41e808 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:27.874168 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a13eec-91cb-43c0-92ac-8bfbc0ed0a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:27.876129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a13eec-91cb-43c0-92ac-8bfbc0ed0a7b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:27.876430 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a13eec-91cb-43c0-92ac-8bfbc0ed0a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:27.876739 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a13eec-91cb-43c0-92ac-8bfbc0ed0a7b None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:27.879127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a13eec-91cb-43c0-92ac-8bfbc0ed0a7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:27.879443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a13eec-91cb-43c0-92ac-8bfbc0ed0a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:27.880910 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a13eec-91cb-43c0-92ac-8bfbc0ed0a7b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:27.903185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 60/123] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:27.904900 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e269-f6e8-43ce-9b32-749ae76d7863 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:27.905221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e269-f6e8-43ce-9b32-749ae76d7863 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:27.905500 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e269-f6e8-43ce-9b32-749ae76d7863 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:27.908151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 61/124] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:27.916548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5e269-f6e8-43ce-9b32-749ae76d7863 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:27.951840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:28.005015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:28.033424 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9e176-1718-460b-9a4a-95c89e41e808 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:28.052893 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5e269-f6e8-43ce-9b32-749ae76d7863 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:28.085049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39615710-a536-41c5-84dd-584065c5cca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:28.086093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39615710-a536-41c5-84dd-584065c5cca8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:28.086579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39615710-a536-41c5-84dd-584065c5cca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:28.087084 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39615710-a536-41c5-84dd-584065c5cca8 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:28.087649 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd942d-33fc-4981-ba22-0906354a8887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:28.088430 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39615710-a536-41c5-84dd-584065c5cca8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:28.088579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd942d-33fc-4981-ba22-0906354a8887 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:28.088834 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd942d-33fc-4981-ba22-0906354a8887 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:28.089104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd942d-33fc-4981-ba22-0906354a8887 None admin] PATH_INFO: `/v3/users/91f07a0a44be4b2f8401d0649c1ba808` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:28.089516 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39615710-a536-41c5-84dd-584065c5cca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:28.090294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd942d-33fc-4981-ba22-0906354a8887 None admin] RBAC: Authorizing `identity:get_user(user_id=91f07a0a44be4b2f8401d0649c1ba808)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:28.091359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39615710-a536-41c5-84dd-584065c5cca8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:28.091732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd942d-33fc-4981-ba22-0906354a8887 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:28.100103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 62/125] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:27 2022] GET /identity/v3/users/91f07a0a44be4b2f8401d0649c1ba808 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:28.100103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d976e2a-9e58-40a2-8b94-d978af5e4606 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:28.100103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d976e2a-9e58-40a2-8b94-d978af5e4606 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:28.100103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d976e2a-9e58-40a2-8b94-d978af5e4606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:28.110157 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 64/126] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:14:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:28.111333 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39615710-a536-41c5-84dd-584065c5cca8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:28.117206 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9d976e2a-9e58-40a2-8b94-d978af5e4606 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:28.120373 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9d976e2a-9e58-40a2-8b94-d978af5e4606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:28.188413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 63/127] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:28.189366 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d976e2a-9e58-40a2-8b94-d978af5e4606 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:28.264932 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:28.311610 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39615710-a536-41c5-84dd-584065c5cca8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:28.315246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d976e2a-9e58-40a2-8b94-d978af5e4606 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:28.350857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341c318-2e43-4455-a70e-595ed56fd418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:28.351748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341c318-2e43-4455-a70e-595ed56fd418 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:28.352032 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341c318-2e43-4455-a70e-595ed56fd418 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:28.352307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341c318-2e43-4455-a70e-595ed56fd418 None admin] PATH_INFO: `/v3/users/b1f6a3270f434dc79c93cb4804c35e56` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:28.353616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341c318-2e43-4455-a70e-595ed56fd418 None admin] RBAC: Authorizing `identity:get_user(user_id=b1f6a3270f434dc79c93cb4804c35e56)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:28.355084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341c318-2e43-4455-a70e-595ed56fd418 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:28.357253 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 64/128] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:28 2022] GET /identity/v3/users/b1f6a3270f434dc79c93cb4804c35e56 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:28.358022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341c318-2e43-4455-a70e-595ed56fd418 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:28.373984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a88823-f8cf-4645-959f-8fffc787c899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:28.374922 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a88823-f8cf-4645-959f-8fffc787c899 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:28.375212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a88823-f8cf-4645-959f-8fffc787c899 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:28.375500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a88823-f8cf-4645-959f-8fffc787c899 None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:28.377249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a88823-f8cf-4645-959f-8fffc787c899 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:28.378796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a88823-f8cf-4645-959f-8fffc787c899 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:28.380656 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 65/129] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:28 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:28.389547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a88823-f8cf-4645-959f-8fffc787c899 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:28.409648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:28.473940 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341c318-2e43-4455-a70e-595ed56fd418 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:28.477884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:28.542948 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5ea2b-12b4-490b-8551-cc3ddb40d2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:28.543770 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ea2b-12b4-490b-8551-cc3ddb40d2ca None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:28.544057 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ea2b-12b4-490b-8551-cc3ddb40d2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:28.544335 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ea2b-12b4-490b-8551-cc3ddb40d2ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:28.565460 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5ea2b-12b4-490b-8551-cc3ddb40d2ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:28.573552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7ef5ea2b-12b4-490b-8551-cc3ddb40d2ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:28.573552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:28.573552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:28.573552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:28.573552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:28.573552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:28.573552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:28.573552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:28.573552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:28.573552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:28.573552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:28.573552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:28.573552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:28.573552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:28.573552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:28.573552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:28.574389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:28.574389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:28.574389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:28.574389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:28.574389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:28.574389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:28.574389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:28.574389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:28.574389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:28.574389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:28.574389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:28.574389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:28.574389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:28.574389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:28.574389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:28.574389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:28.575146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:28.575146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:28.575146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:28.575146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:28.575146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:28.575146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:28.575146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:28.575146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:28.575146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:28.575146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:28.575146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:28.575146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:28.575146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 65/130] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:28.575792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5ea2b-12b4-490b-8551-cc3ddb40d2ca None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:28.606688 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a88823-f8cf-4645-959f-8fffc787c899 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:28.680877 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5ea2b-12b4-490b-8551-cc3ddb40d2ca None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:28.686472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52af53-15d4-442b-bba6-1ca619b1d248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:28.687393 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52af53-15d4-442b-bba6-1ca619b1d248 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:28.687645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52af53-15d4-442b-bba6-1ca619b1d248 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:28.687917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52af53-15d4-442b-bba6-1ca619b1d248 None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:28.689175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52af53-15d4-442b-bba6-1ca619b1d248 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:28.690652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52af53-15d4-442b-bba6-1ca619b1d248 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:28.692748 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 66/131] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:28 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:28.693647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52af53-15d4-442b-bba6-1ca619b1d248 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:28.719108 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b698bbd-adf9-4ed6-8a12-152c8d2a9abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:28.720018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b698bbd-adf9-4ed6-8a12-152c8d2a9abf None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:28.720305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b698bbd-adf9-4ed6-8a12-152c8d2a9abf None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:28.720610 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b698bbd-adf9-4ed6-8a12-152c8d2a9abf None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a/users/91f07a0a44be4b2f8401d0649c1ba808/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:28.723815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b698bbd-adf9-4ed6-8a12-152c8d2a9abf None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a, user_id=91f07a0a44be4b2f8401d0649c1ba808, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:28.726020 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b698bbd-adf9-4ed6-8a12-152c8d2a9abf None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:28.745159 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 66/132] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:14:28 2022] PUT /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a/users/91f07a0a44be4b2f8401d0649c1ba808/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:14:28.754132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ece55-7499-44c4-855b-54f7d0289c00 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:28.754495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ece55-7499-44c4-855b-54f7d0289c00 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:28.754700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ece55-7499-44c4-855b-54f7d0289c00 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:28.756616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 67/133] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:28.757673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ece55-7499-44c4-855b-54f7d0289c00 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:28.789316 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:28.846600 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:28.901585 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52af53-15d4-442b-bba6-1ca619b1d248 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:28.962257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ece55-7499-44c4-855b-54f7d0289c00 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:28.979271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318891b-a4d2-4fa1-8bea-9bc2cdeb47cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:28.980061 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318891b-a4d2-4fa1-8bea-9bc2cdeb47cd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:28.980267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318891b-a4d2-4fa1-8bea-9bc2cdeb47cd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:28.980481 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318891b-a4d2-4fa1-8bea-9bc2cdeb47cd None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:28.981988 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318891b-a4d2-4fa1-8bea-9bc2cdeb47cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:28.982309 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318891b-a4d2-4fa1-8bea-9bc2cdeb47cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:28.983761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318891b-a4d2-4fa1-8bea-9bc2cdeb47cd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:28.993213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 67/134] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:28.994282 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5f0b4-e4bd-4002-bd7f-e60343149a47 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:28.994629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5f0b4-e4bd-4002-bd7f-e60343149a47 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:28.994851 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5f0b4-e4bd-4002-bd7f-e60343149a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:29.006511 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d800797-8404-4fff-936a-7578ef59df00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:29.007745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d800797-8404-4fff-936a-7578ef59df00 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:29.008227 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d800797-8404-4fff-936a-7578ef59df00 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:29.008751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d800797-8404-4fff-936a-7578ef59df00 None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a/users/b1f6a3270f434dc79c93cb4804c35e56/roles/690fc625fea1445fa7e0e8f40ae2246c` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:29.011801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d800797-8404-4fff-936a-7578ef59df00 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a, user_id=b1f6a3270f434dc79c93cb4804c35e56, role_id=690fc625fea1445fa7e0e8f40ae2246c)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:29.013830 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d800797-8404-4fff-936a-7578ef59df00 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:29.016894 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-00e5f0b4-e4bd-4002-bd7f-e60343149a47 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:29.018169 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-00e5f0b4-e4bd-4002-bd7f-e60343149a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:29.036391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 68/135] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:14:28 2022] PUT /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a/users/b1f6a3270f434dc79c93cb4804c35e56/roles/690fc625fea1445fa7e0e8f40ae2246c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:14:29.037879 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d800797-8404-4fff-936a-7578ef59df00 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:29.123740 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 68/136] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:29.141272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:29.165094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d800797-8404-4fff-936a-7578ef59df00 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:29.166502 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5f0b4-e4bd-4002-bd7f-e60343149a47 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:29.207516 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d361c-fed9-49dc-b4e7-5315983090a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:29.208465 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d361c-fed9-49dc-b4e7-5315983090a9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:29.208795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d361c-fed9-49dc-b4e7-5315983090a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:29.209076 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d361c-fed9-49dc-b4e7-5315983090a9 None admin] PATH_INFO: `/v3/users/b1f6a3270f434dc79c93cb4804c35e56` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:29.210539 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d361c-fed9-49dc-b4e7-5315983090a9 None admin] RBAC: Authorizing `identity:get_user(user_id=b1f6a3270f434dc79c93cb4804c35e56)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:29.212985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d361c-fed9-49dc-b4e7-5315983090a9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:29.215184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 69/137] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:29 2022] GET /identity/v3/users/b1f6a3270f434dc79c93cb4804c35e56 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:29.221105 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d361c-fed9-49dc-b4e7-5315983090a9 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:29.309132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:29.338104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d361c-fed9-49dc-b4e7-5315983090a9 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:29.376031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184cb1b-6f9f-425b-990e-837de3747c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:29.376712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5f0b4-e4bd-4002-bd7f-e60343149a47 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:29.377703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184cb1b-6f9f-425b-990e-837de3747c29 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:29.378131 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184cb1b-6f9f-425b-990e-837de3747c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:29.378656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184cb1b-6f9f-425b-990e-837de3747c29 None admin] PATH_INFO: `/v3/projects/4e578004e4be45908ee26181fd2d422f` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:29.380031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184cb1b-6f9f-425b-990e-837de3747c29 None admin] RBAC: Authorizing `identity:get_project(project_id=4e578004e4be45908ee26181fd2d422f)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:29.381668 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184cb1b-6f9f-425b-990e-837de3747c29 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:29.383558 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 70/138] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:29 2022] GET /identity/v3/projects/4e578004e4be45908ee26181fd2d422f => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:29.389374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184cb1b-6f9f-425b-990e-837de3747c29 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:29.409300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:29.453961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9e4cd-bd54-4d61-b11e-e9df0cbaf526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:29.454964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9e4cd-bd54-4d61-b11e-e9df0cbaf526 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:29.455315 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9e4cd-bd54-4d61-b11e-e9df0cbaf526 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:29.455693 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9e4cd-bd54-4d61-b11e-e9df0cbaf526 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:29.461259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9e4cd-bd54-4d61-b11e-e9df0cbaf526 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:29.462855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9e4cd-bd54-4d61-b11e-e9df0cbaf526 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:29.464831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 69/139] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:14:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:29.471177 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9e4cd-bd54-4d61-b11e-e9df0cbaf526 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:29.497188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184cb1b-6f9f-425b-990e-837de3747c29 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:29.533452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed986e-c4b0-46f8-85c8-fa33221a027a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:29.534839 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed986e-c4b0-46f8-85c8-fa33221a027a None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:29.535477 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed986e-c4b0-46f8-85c8-fa33221a027a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:29.536041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed986e-c4b0-46f8-85c8-fa33221a027a None admin] PATH_INFO: `/v3/projects/4e578004e4be45908ee26181fd2d422f/users/b1f6a3270f434dc79c93cb4804c35e56/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:29.538433 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed986e-c4b0-46f8-85c8-fa33221a027a None admin] RBAC: Authorizing `identity:create_grant(project_id=4e578004e4be45908ee26181fd2d422f, user_id=b1f6a3270f434dc79c93cb4804c35e56, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:29.540111 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed986e-c4b0-46f8-85c8-fa33221a027a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:29.563670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 71/140] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:14:29 2022] PUT /identity/v3/projects/4e578004e4be45908ee26181fd2d422f/users/b1f6a3270f434dc79c93cb4804c35e56/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:14:29.643512 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9e4cd-bd54-4d61-b11e-e9df0cbaf526 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:29.699529 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b6297-5e8b-4567-85fe-a82466a0ddf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:29.700238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b6297-5e8b-4567-85fe-a82466a0ddf9 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:29.700547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b6297-5e8b-4567-85fe-a82466a0ddf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:29.700841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b6297-5e8b-4567-85fe-a82466a0ddf9 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:29.701656 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b6297-5e8b-4567-85fe-a82466a0ddf9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:29.703197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b6297-5e8b-4567-85fe-a82466a0ddf9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:29.723975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:29.745444 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 70/141] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:14:29 2022] POST /identity/v3/users => generated 283 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:14:29.929640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e43e7-bab3-4f05-9fdc-6eec7d486590 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:29.929819 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e43e7-bab3-4f05-9fdc-6eec7d486590 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:29.930190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e43e7-bab3-4f05-9fdc-6eec7d486590 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:29.931721 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 72/142] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:29.937882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660cd0-684b-4968-90ae-96acab7161c6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:29.938189 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660cd0-684b-4968-90ae-96acab7161c6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:29.938446 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660cd0-684b-4968-90ae-96acab7161c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:29.965615 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-75660cd0-684b-4968-90ae-96acab7161c6 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:29.966828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-75660cd0-684b-4968-90ae-96acab7161c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:30.053358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 71/143] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:30.094293 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e43e7-bab3-4f05-9fdc-6eec7d486590 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:30.202641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:30.239789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e43e7-bab3-4f05-9fdc-6eec7d486590 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:30.285826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd3f6b-86e7-41e9-8d01-57317f112f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:30.286666 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd3f6b-86e7-41e9-8d01-57317f112f43 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:30.286947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd3f6b-86e7-41e9-8d01-57317f112f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:30.287219 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd3f6b-86e7-41e9-8d01-57317f112f43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:30.303177 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd3f6b-86e7-41e9-8d01-57317f112f43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:30.310996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-75bd3f6b-86e7-41e9-8d01-57317f112f43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:30.310996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:30.310996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:30.310996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:30.310996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:30.310996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:30.310996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:30.310996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:30.310996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:30.310996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:30.310996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:30.310996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:30.310996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:30.310996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:30.310996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:30.310996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:30.311958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:30.311958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:30.311958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:30.311958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:30.311958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:30.311958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:30.311958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:30.311958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:30.311958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:30.311958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:30.311958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:30.311958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:30.311958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:30.311958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:30.311958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:30.311958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:30.312712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:30.312712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:30.312712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:30.312712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:30.312712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:30.312712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:30.312712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:30.312712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:30.312712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:30.312712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:30.312712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:30.312712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:30.312712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 73/144] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:30.321668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75660cd0-684b-4968-90ae-96acab7161c6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:30.444564 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75660cd0-684b-4968-90ae-96acab7161c6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:30.472585 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:30.487296 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa17c1-c333-487c-a6ff-ce971ba6a668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:30.487985 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa17c1-c333-487c-a6ff-ce971ba6a668 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:30.488352 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa17c1-c333-487c-a6ff-ce971ba6a668 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:30.488671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa17c1-c333-487c-a6ff-ce971ba6a668 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:30.492666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa17c1-c333-487c-a6ff-ce971ba6a668 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:30.492666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa17c1-c333-487c-a6ff-ce971ba6a668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:30.492666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa17c1-c333-487c-a6ff-ce971ba6a668 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:30.504814 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 72/145] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:30.508104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd3f6b-86e7-41e9-8d01-57317f112f43 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:30.568996 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ec933-3b6f-403b-88df-f07b1663f4bc None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:30.569280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ec933-3b6f-403b-88df-f07b1663f4bc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:30.569561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ec933-3b6f-403b-88df-f07b1663f4bc None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:30.571188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 73/146] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:14:30.577738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6d87a-d444-4d46-8738-4d0b143fb82e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:30.578029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6d87a-d444-4d46-8738-4d0b143fb82e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:30.578304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6d87a-d444-4d46-8738-4d0b143fb82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:30.602556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-15d6d87a-d444-4d46-8738-4d0b143fb82e None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:30.603790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-15d6d87a-d444-4d46-8738-4d0b143fb82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:30.655453 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd3f6b-86e7-41e9-8d01-57317f112f43 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:30.687751 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 74/147] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:30.714491 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f91d7-0180-4f0d-be51-20671e806ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:30.715397 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f91d7-0180-4f0d-be51-20671e806ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:30.715674 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f91d7-0180-4f0d-be51-20671e806ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:30.715951 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f91d7-0180-4f0d-be51-20671e806ff1 None admin] PATH_INFO: `/v3/users/b1f6a3270f434dc79c93cb4804c35e56` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:30.718218 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f91d7-0180-4f0d-be51-20671e806ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=b1f6a3270f434dc79c93cb4804c35e56)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:30.719459 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6d87a-d444-4d46-8738-4d0b143fb82e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:30.719695 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f91d7-0180-4f0d-be51-20671e806ff1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:30.721603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 74/148] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:30 2022] GET /identity/v3/users/b1f6a3270f434dc79c93cb4804c35e56 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:30.733507 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f91d7-0180-4f0d-be51-20671e806ff1 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:30.736321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:30.833587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6d87a-d444-4d46-8738-4d0b143fb82e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:30.852092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:30.872589 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf2d6d-28ce-4510-9c68-190bbd315484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:30.873446 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf2d6d-28ce-4510-9c68-190bbd315484 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:30.874907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf2d6d-28ce-4510-9c68-190bbd315484 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:30.875333 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf2d6d-28ce-4510-9c68-190bbd315484 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:30.887227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf2d6d-28ce-4510-9c68-190bbd315484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:30.896340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f4bf2d6d-28ce-4510-9c68-190bbd315484 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:30.896340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:30.896340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:30.896340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:30.896340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:30.896340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:30.896340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:30.896340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:30.896340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:30.896340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:30.896340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:30.896340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:30.896340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:30.896340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:30.896340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:30.896340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:30.897251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:30.897251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:30.897251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:30.897251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:30.897251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:30.897251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:30.897251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:30.897251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:30.897251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:30.897251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:30.897251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:30.897251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:30.897251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:30.897251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:30.897251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:30.897251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:30.899457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:30.899457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:30.899457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:30.899457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:30.899457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:30.899457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:30.899457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:30.899457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:30.899457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:30.899457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:30.899457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:30.899457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:30.899457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 75/149] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:30.909864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf2d6d-28ce-4510-9c68-190bbd315484 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:30.954411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f91d7-0180-4f0d-be51-20671e806ff1 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:31.037390 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4d09e-8a3f-4b93-95fb-a431db3736fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:31.037972 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4d09e-8a3f-4b93-95fb-a431db3736fa None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:31.038251 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4d09e-8a3f-4b93-95fb-a431db3736fa None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:31.038527 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4d09e-8a3f-4b93-95fb-a431db3736fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:31.128889 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf2d6d-28ce-4510-9c68-190bbd315484 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:31.156387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4d09e-8a3f-4b93-95fb-a431db3736fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:31.158564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4d09e-8a3f-4b93-95fb-a431db3736fa None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:31.160557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:31.215096 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87845e-df8b-4692-b28d-c9bb88cb9add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:31.215782 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87845e-df8b-4692-b28d-c9bb88cb9add None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:31.216064 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87845e-df8b-4692-b28d-c9bb88cb9add None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:31.216341 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87845e-df8b-4692-b28d-c9bb88cb9add None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:31.217140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87845e-df8b-4692-b28d-c9bb88cb9add None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:31.217449 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87845e-df8b-4692-b28d-c9bb88cb9add None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:31.219145 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87845e-df8b-4692-b28d-c9bb88cb9add None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:31.240604 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 76/150] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:31.247098 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87845e-df8b-4692-b28d-c9bb88cb9add None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:31.318151 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:31.362202 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 75/151] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 03:14:31.369188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4d09e-8a3f-4b93-95fb-a431db3736fa None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:31.456065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87845e-df8b-4692-b28d-c9bb88cb9add None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:31.525697 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bb2da-238c-4632-819d-3f7866abb3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:31.526600 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bb2da-238c-4632-819d-3f7866abb3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:31.526888 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bb2da-238c-4632-819d-3f7866abb3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:31.527157 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bb2da-238c-4632-819d-3f7866abb3e5 None admin] PATH_INFO: `/v3/users/64d9750809ab423f853ee96e998330a8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:31.532965 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bb2da-238c-4632-819d-3f7866abb3e5 None admin] RBAC: Authorizing `identity:get_user(user_id=64d9750809ab423f853ee96e998330a8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:31.535363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bb2da-238c-4632-819d-3f7866abb3e5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:31.539699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 77/152] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:31 2022] GET /identity/v3/users/64d9750809ab423f853ee96e998330a8 => generated 289 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:31.546192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bb2da-238c-4632-819d-3f7866abb3e5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:31.589362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4d09e-8a3f-4b93-95fb-a431db3736fa None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:31.591607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:31.666105 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c645b-f4ad-488d-8272-9fd7f7621bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:31.667455 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c645b-f4ad-488d-8272-9fd7f7621bcc None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:31.667942 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c645b-f4ad-488d-8272-9fd7f7621bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:31.668389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c645b-f4ad-488d-8272-9fd7f7621bcc None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:31.669856 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c645b-f4ad-488d-8272-9fd7f7621bcc None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:31.671601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c645b-f4ad-488d-8272-9fd7f7621bcc None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:31.674023 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 76/153] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:31 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:31.680402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c645b-f4ad-488d-8272-9fd7f7621bcc None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:31.776423 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bb2da-238c-4632-819d-3f7866abb3e5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:31.786588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:31.857337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2ca54-5144-4b0d-9085-9b20c10faa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:31.858165 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2ca54-5144-4b0d-9085-9b20c10faa02 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:31.858453 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2ca54-5144-4b0d-9085-9b20c10faa02 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:31.858733 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2ca54-5144-4b0d-9085-9b20c10faa02 None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:31.860002 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2ca54-5144-4b0d-9085-9b20c10faa02 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:31.861523 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2ca54-5144-4b0d-9085-9b20c10faa02 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:31.863599 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 78/154] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:31 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:31.869969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2ca54-5144-4b0d-9085-9b20c10faa02 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:31.883318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c645b-f4ad-488d-8272-9fd7f7621bcc None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:31.946474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9c5d2-32b1-45f0-aead-dcc65887c75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:31.947162 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9c5d2-32b1-45f0-aead-dcc65887c75c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:31.947447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9c5d2-32b1-45f0-aead-dcc65887c75c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:31.947722 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9c5d2-32b1-45f0-aead-dcc65887c75c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:31.948596 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9c5d2-32b1-45f0-aead-dcc65887c75c None admin] RBAC: Adding query filter params (role.id=713f175e9435403f9e39528c805bd956, scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a, user.id=b1f6a3270f434dc79c93cb4804c35e56) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:31.949055 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9c5d2-32b1-45f0-aead-dcc65887c75c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:31.950534 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9c5d2-32b1-45f0-aead-dcc65887c75c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:31.961935 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 77/155] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:31 2022] GET /identity/v3/role_assignments?user.id=b1f6a3270f434dc79c93cb4804c35e56&scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a&role.id=713f175e9435403f9e39528c805bd956 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:32.072296 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2ca54-5144-4b0d-9085-9b20c10faa02 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:32.116811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1c1c6-e397-4e24-aebc-0586385f9e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:32.117653 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1c1c6-e397-4e24-aebc-0586385f9e95 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:32.117932 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1c1c6-e397-4e24-aebc-0586385f9e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:32.118207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1c1c6-e397-4e24-aebc-0586385f9e95 None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a/users/64d9750809ab423f853ee96e998330a8/roles/a96cd51936d549a3986a0e7e1f50f040` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:32.126156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1c1c6-e397-4e24-aebc-0586385f9e95 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a, user_id=64d9750809ab423f853ee96e998330a8, role_id=a96cd51936d549a3986a0e7e1f50f040)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:32.127872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1c1c6-e397-4e24-aebc-0586385f9e95 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:32.130804 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece87c24-e3da-471e-9422-f262fab52333 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:32.131092 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece87c24-e3da-471e-9422-f262fab52333 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:32.131368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece87c24-e3da-471e-9422-f262fab52333 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:32.132955 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 78/156] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:14:32.145638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b404a4-6e77-4323-a505-5e946b2844e3 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:32.146032 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b404a4-6e77-4323-a505-5e946b2844e3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:32.146342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b404a4-6e77-4323-a505-5e946b2844e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:32.163732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 79/157] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:14:31 2022] PUT /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a/users/64d9750809ab423f853ee96e998330a8/roles/a96cd51936d549a3986a0e7e1f50f040 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:14:32.174578 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-79b404a4-6e77-4323-a505-5e946b2844e3 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:32.175867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-79b404a4-6e77-4323-a505-5e946b2844e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:32.216552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:32.276463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 79/158] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:32.311828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1c1c6-e397-4e24-aebc-0586385f9e95 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:32.361109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:32.457289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1c1c6-e397-4e24-aebc-0586385f9e95 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:32.503142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff664126-7c5e-46c0-8151-bcc2c00729b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:32.503971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff664126-7c5e-46c0-8151-bcc2c00729b1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:32.504255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff664126-7c5e-46c0-8151-bcc2c00729b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:32.504553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff664126-7c5e-46c0-8151-bcc2c00729b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:32.522520 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff664126-7c5e-46c0-8151-bcc2c00729b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:32.530865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-ff664126-7c5e-46c0-8151-bcc2c00729b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:32.530865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:32.530865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:32.530865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:32.530865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:32.530865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:32.530865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:32.530865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:32.530865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:32.530865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:32.530865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:32.530865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:32.530865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:32.530865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:32.530865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:32.530865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:32.532971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:32.532971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:32.532971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:32.532971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:32.532971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:32.532971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:32.532971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:32.532971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:32.532971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:32.532971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:32.532971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:32.532971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:32.532971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:32.532971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:32.532971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:32.532971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:32.534904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:32.534904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:32.534904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:32.534904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:32.534904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:32.534904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:32.534904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:32.534904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:32.534904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:32.534904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:32.534904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:32.534904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:32.534904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 80/159] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:14:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:32.543992 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b404a4-6e77-4323-a505-5e946b2844e3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:32.692151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b404a4-6e77-4323-a505-5e946b2844e3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:32.739680 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455718b-2647-4c3f-9a4c-661969a1a60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:32.740289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455718b-2647-4c3f-9a4c-661969a1a60c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:32.740625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455718b-2647-4c3f-9a4c-661969a1a60c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:32.740880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455718b-2647-4c3f-9a4c-661969a1a60c None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:32.741650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455718b-2647-4c3f-9a4c-661969a1a60c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:32.741954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455718b-2647-4c3f-9a4c-661969a1a60c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:32.743354 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455718b-2647-4c3f-9a4c-661969a1a60c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:32.752917 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 80/160] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:32.761639 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff664126-7c5e-46c0-8151-bcc2c00729b1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:32.894440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:32.903067 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff664126-7c5e-46c0-8151-bcc2c00729b1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:32.954553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af055a4-6351-4728-b36a-42dbe394d383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:32.955456 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af055a4-6351-4728-b36a-42dbe394d383 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:32.955738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af055a4-6351-4728-b36a-42dbe394d383 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:32.956015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af055a4-6351-4728-b36a-42dbe394d383 None admin] PATH_INFO: `/v3/users/91f07a0a44be4b2f8401d0649c1ba808` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:32.961346 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af055a4-6351-4728-b36a-42dbe394d383 None admin] RBAC: Authorizing `identity:get_user(user_id=91f07a0a44be4b2f8401d0649c1ba808)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:32.962860 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af055a4-6351-4728-b36a-42dbe394d383 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:32.964962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 81/161] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:32 2022] GET /identity/v3/users/91f07a0a44be4b2f8401d0649c1ba808 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:32.970468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455718b-2647-4c3f-9a4c-661969a1a60c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:33.020752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:33.080019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cb049-e4ce-4f62-9d76-f6682924ce47 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:33.080709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cb049-e4ce-4f62-9d76-f6682924ce47 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:33.081210 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cb049-e4ce-4f62-9d76-f6682924ce47 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:33.083030 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 82/162] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:33.095238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ceb723-3b16-4905-b39f-0b7436727961 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:33.095848 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ceb723-3b16-4905-b39f-0b7436727961 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:33.096329 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ceb723-3b16-4905-b39f-0b7436727961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:33.115129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455718b-2647-4c3f-9a4c-661969a1a60c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:33.128880 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-88ceb723-3b16-4905-b39f-0b7436727961 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:33.130446 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-88ceb723-3b16-4905-b39f-0b7436727961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:33.160729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3d9a5-11c2-4502-a8c9-b5f314e66380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:33.161636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d9a5-11c2-4502-a8c9-b5f314e66380 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:33.162539 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d9a5-11c2-4502-a8c9-b5f314e66380 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:33.162968 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d9a5-11c2-4502-a8c9-b5f314e66380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:33.263033 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3d9a5-11c2-4502-a8c9-b5f314e66380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:33.265116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3d9a5-11c2-4502-a8c9-b5f314e66380 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:33.314211 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:33.402009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 81/163] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:33.403716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d38b14-6580-4d2d-863d-1dffb83160da None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:33.404218 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d38b14-6580-4d2d-863d-1dffb83160da None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:33.408760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d38b14-6580-4d2d-863d-1dffb83160da None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:33.410324 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 82/164] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:33.410497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 83/165] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:33.412303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ceb723-3b16-4905-b39f-0b7436727961 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:33.420950 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c6b93-f189-4ac3-8d8d-2c57667c7651 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:33.422564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c6b93-f189-4ac3-8d8d-2c57667c7651 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:33.423071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c6b93-f189-4ac3-8d8d-2c57667c7651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:33.453003 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5a4c6b93-f189-4ac3-8d8d-2c57667c7651 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:33.455135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5a4c6b93-f189-4ac3-8d8d-2c57667c7651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:33.567250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 83/166] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:33.568553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c6b93-f189-4ac3-8d8d-2c57667c7651 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:33.636909 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:33.700368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c6b93-f189-4ac3-8d8d-2c57667c7651 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:33.716774 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:33.734456 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ceb723-3b16-4905-b39f-0b7436727961 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:33.746289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6339c38-b8cc-4794-b720-04559e88262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:33.747125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6339c38-b8cc-4794-b720-04559e88262b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:33.747397 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6339c38-b8cc-4794-b720-04559e88262b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:33.747669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6339c38-b8cc-4794-b720-04559e88262b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:33.765768 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6339c38-b8cc-4794-b720-04559e88262b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:33.782210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d6339c38-b8cc-4794-b720-04559e88262b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:14:33.782210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:33.782210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:33.782210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:33.782210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:33.782210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:33.782210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:33.782210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:33.782210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:33.782210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:33.782210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:33.782210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:33.782210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:33.782210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:33.782210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:33.782210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:33.783096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:33.783096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:33.783096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:33.783096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:33.783096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:33.783096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:33.783096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:33.783096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:33.783096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:33.783096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:33.783096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:33.783096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:33.783096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:33.783096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:33.783096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:33.783096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:33.784116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:33.784116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:33.784116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:33.784116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:33.784116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:33.784116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:33.784116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:33.784116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:33.784116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:33.784116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:33.784116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:14:33.784116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:33.784732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 84/167] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:14:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:33.785575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6339c38-b8cc-4794-b720-04559e88262b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:33.805332 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa7b15-8ac8-47d6-98b3-d0d63fcc993a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:33.806219 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa7b15-8ac8-47d6-98b3-d0d63fcc993a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:33.806502 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa7b15-8ac8-47d6-98b3-d0d63fcc993a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:33.806774 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa7b15-8ac8-47d6-98b3-d0d63fcc993a None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:33.807980 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa7b15-8ac8-47d6-98b3-d0d63fcc993a None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:33.809494 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa7b15-8ac8-47d6-98b3-d0d63fcc993a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:33.811394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 84/168] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:33 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:33.811993 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa7b15-8ac8-47d6-98b3-d0d63fcc993a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:34.016370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa7b15-8ac8-47d6-98b3-d0d63fcc993a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:34.022692 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6339c38-b8cc-4794-b720-04559e88262b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:34.056331 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:34.083778 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752c0f1-63ee-4aad-baac-d386ea14288b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:34.084469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752c0f1-63ee-4aad-baac-d386ea14288b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:34.084778 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752c0f1-63ee-4aad-baac-d386ea14288b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:34.085283 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752c0f1-63ee-4aad-baac-d386ea14288b None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:34.086300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752c0f1-63ee-4aad-baac-d386ea14288b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:34.086829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752c0f1-63ee-4aad-baac-d386ea14288b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:34.088893 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752c0f1-63ee-4aad-baac-d386ea14288b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:34.092708 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870c011-135a-4671-8d32-020d7f7d5147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:34.093726 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870c011-135a-4671-8d32-020d7f7d5147 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:34.094159 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870c011-135a-4671-8d32-020d7f7d5147 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:34.094598 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870c011-135a-4671-8d32-020d7f7d5147 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:34.109451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 85/169] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:14:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:34.111791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870c011-135a-4671-8d32-020d7f7d5147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:34.114254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752c0f1-63ee-4aad-baac-d386ea14288b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:34.121262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-0870c011-135a-4671-8d32-020d7f7d5147 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:34.121262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:34.121262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:34.121262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:34.121262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:34.121262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:34.121262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:34.121262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:34.121262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:34.121262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:34.121262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:34.121262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:34.121262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:34.121262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:34.121262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:34.121262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:34.122221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:34.122221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:34.122221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:34.122221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:34.122221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:34.122221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:34.122221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:34.122221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:34.122221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:34.122221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:34.122221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:34.122221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:34.122221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:34.122221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:34.122221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:34.122221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:34.122970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:34.122970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:34.122970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:34.122970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:34.122970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:34.122970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:34.122970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:34.122970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:34.122970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:34.122970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:34.122970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:34.122970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:34.132995 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 85/170] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:34.137722 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870c011-135a-4671-8d32-020d7f7d5147 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:34.167491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:34.315006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752c0f1-63ee-4aad-baac-d386ea14288b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:34.342568 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870c011-135a-4671-8d32-020d7f7d5147 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:34.358147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4d3d4-b863-4f81-a7be-61a6e4dd122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:34.358907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4d3d4-b863-4f81-a7be-61a6e4dd122b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:34.359189 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4d3d4-b863-4f81-a7be-61a6e4dd122b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:34.359463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4d3d4-b863-4f81-a7be-61a6e4dd122b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:34.360312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4d3d4-b863-4f81-a7be-61a6e4dd122b None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a, user.id=91f07a0a44be4b2f8401d0649c1ba808) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:34.368819 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4d3d4-b863-4f81-a7be-61a6e4dd122b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:34.370362 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4d3d4-b863-4f81-a7be-61a6e4dd122b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:34.379213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 86/171] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:34 2022] GET /identity/v3/role_assignments?user.id=91f07a0a44be4b2f8401d0649c1ba808&scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:34.380217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4d3d4-b863-4f81-a7be-61a6e4dd122b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:34.388889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a6514-17dc-4ede-a51e-b1411654207c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:34.389803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a6514-17dc-4ede-a51e-b1411654207c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:34.390089 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a6514-17dc-4ede-a51e-b1411654207c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:34.390370 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a6514-17dc-4ede-a51e-b1411654207c None admin] PATH_INFO: `/v3/users/b1f6a3270f434dc79c93cb4804c35e56` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:34.393595 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a6514-17dc-4ede-a51e-b1411654207c None admin] RBAC: Authorizing `identity:get_user(user_id=b1f6a3270f434dc79c93cb4804c35e56)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:34.397190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a6514-17dc-4ede-a51e-b1411654207c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:34.397190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 86/172] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:34 2022] GET /identity/v3/users/b1f6a3270f434dc79c93cb4804c35e56 => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:34.400424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226749a5-601e-4382-b200-f3a0a2c5defd None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:34.400424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226749a5-601e-4382-b200-f3a0a2c5defd None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:34.400424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226749a5-601e-4382-b200-f3a0a2c5defd None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:34.400424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 87/173] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:34.401388 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995b56a-ad98-4620-96a1-88125abfc961 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:34.401670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995b56a-ad98-4620-96a1-88125abfc961 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:34.401945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995b56a-ad98-4620-96a1-88125abfc961 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:34.403446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 88/174] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:34.412075 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7afbd-1e58-4b32-a8c4-acd8cfc14be3 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:34.412075 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7afbd-1e58-4b32-a8c4-acd8cfc14be3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:34.412075 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7afbd-1e58-4b32-a8c4-acd8cfc14be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:34.445188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6dd7afbd-1e58-4b32-a8c4-acd8cfc14be3 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:34.449138 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6dd7afbd-1e58-4b32-a8c4-acd8cfc14be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:34.519274 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:34.535614 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4d3d4-b863-4f81-a7be-61a6e4dd122b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:34.539536 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:34.572191 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08092f91-0ea0-4471-ac2b-e7eb13a2edb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:34.572828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08092f91-0ea0-4471-ac2b-e7eb13a2edb0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:34.573275 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08092f91-0ea0-4471-ac2b-e7eb13a2edb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:34.573748 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08092f91-0ea0-4471-ac2b-e7eb13a2edb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:34.574684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08092f91-0ea0-4471-ac2b-e7eb13a2edb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:34.575131 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08092f91-0ea0-4471-ac2b-e7eb13a2edb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:34.577392 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08092f91-0ea0-4471-ac2b-e7eb13a2edb0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:34.587855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 87/175] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:34.589135 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08092f91-0ea0-4471-ac2b-e7eb13a2edb0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:34.609411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 89/176] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:34.617320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e3242-8673-44e8-96c7-7d875fc71399 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:34.617678 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e3242-8673-44e8-96c7-7d875fc71399 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:34.618125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e3242-8673-44e8-96c7-7d875fc71399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:34.639058 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-fa7e3242-8673-44e8-96c7-7d875fc71399 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:34.640561 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fa7e3242-8673-44e8-96c7-7d875fc71399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:34.713937 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08092f91-0ea0-4471-ac2b-e7eb13a2edb0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:34.732209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 90/177] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:34.735897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e3242-8673-44e8-96c7-7d875fc71399 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:34.775913 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4353653-233c-427d-977d-2bf24fc67277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:34.776725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4353653-233c-427d-977d-2bf24fc67277 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:34.777076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4353653-233c-427d-977d-2bf24fc67277 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:34.777439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4353653-233c-427d-977d-2bf24fc67277 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:34.808999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:34.870034 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4353653-233c-427d-977d-2bf24fc67277 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:34.871457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4353653-233c-427d-977d-2bf24fc67277 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:34.872283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e3242-8673-44e8-96c7-7d875fc71399 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:34.875790 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:34.909458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2c62c-5325-4f6a-92e6-4f86111f21dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:34.910423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2c62c-5325-4f6a-92e6-4f86111f21dd None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:34.910769 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2c62c-5325-4f6a-92e6-4f86111f21dd None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:34.911123 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2c62c-5325-4f6a-92e6-4f86111f21dd None admin] PATH_INFO: `/v3/users/b1f6a3270f434dc79c93cb4804c35e56` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:34.912369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2c62c-5325-4f6a-92e6-4f86111f21dd None admin] RBAC: Authorizing `identity:get_user(user_id=b1f6a3270f434dc79c93cb4804c35e56)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:34.913911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2c62c-5325-4f6a-92e6-4f86111f21dd None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:34.915794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 91/178] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:34 2022] GET /identity/v3/users/b1f6a3270f434dc79c93cb4804c35e56 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:34.920963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2c62c-5325-4f6a-92e6-4f86111f21dd None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:34.976497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 88/179] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:34.977382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4353653-233c-427d-977d-2bf24fc67277 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:35.026080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2c62c-5325-4f6a-92e6-4f86111f21dd None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:35.036715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:35.063309 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b62b1-f8bc-4f75-9b75-48c79f7a6efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:35.064139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b62b1-f8bc-4f75-9b75-48c79f7a6efd None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:35.064413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b62b1-f8bc-4f75-9b75-48c79f7a6efd None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:35.064706 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b62b1-f8bc-4f75-9b75-48c79f7a6efd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:35.074690 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b62b1-f8bc-4f75-9b75-48c79f7a6efd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:35.082952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-b28b62b1-f8bc-4f75-9b75-48c79f7a6efd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:14:35.082952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:35.082952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:35.082952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:35.082952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:35.082952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:35.082952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:35.082952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:35.082952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:35.082952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:35.082952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:35.082952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:35.082952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:35.082952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:35.082952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:35.082952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:35.084018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:35.084018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:35.084018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:35.084018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:35.084018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:35.084018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:35.084018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:35.084018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:35.084018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:35.084018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:35.084018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:35.084018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:35.084018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:35.084018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:35.084018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:35.084018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:35.084855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:35.084855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:35.084855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:35.084855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:35.084855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:35.084855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:35.084855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:35.084855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:35.084855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:35.084855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:35.084855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:14:35.084855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:35.084855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 92/180] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:14:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:35.085500 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf7823-0961-410b-9d94-fb1af0040189 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:35.085714 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf7823-0961-410b-9d94-fb1af0040189 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:35.086008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf7823-0961-410b-9d94-fb1af0040189 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:35.087384 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 93/181] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:35.087953 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf7823-0961-410b-9d94-fb1af0040189 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:35.105485 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4353653-233c-427d-977d-2bf24fc67277 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:35.122469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:35.142035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf224f-0d18-40a8-a16d-f8b0826c259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:35.142849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf224f-0d18-40a8-a16d-f8b0826c259d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:35.143131 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf224f-0d18-40a8-a16d-f8b0826c259d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:35.143435 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf224f-0d18-40a8-a16d-f8b0826c259d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:35.154643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf224f-0d18-40a8-a16d-f8b0826c259d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:35.162388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1ddf224f-0d18-40a8-a16d-f8b0826c259d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:35.162388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:35.162388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:35.162388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:35.162388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:35.162388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:35.162388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:35.162388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:35.162388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:35.162388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:35.162388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:35.162388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:35.162388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:35.162388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:35.162388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:35.162388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:35.163267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:35.163267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:35.163267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:35.163267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:35.163267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:35.163267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:35.163267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:35.163267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:35.163267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:35.163267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:35.163267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:35.163267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:35.163267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:35.163267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:35.163267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:35.163267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:35.164024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:35.164024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:35.164024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:35.164024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:35.164024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:35.164024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:35.164024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:35.164024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:35.164024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:35.164024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:35.164024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:35.164024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:35.164024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 89/182] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:14:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:35.164697 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf224f-0d18-40a8-a16d-f8b0826c259d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:35.215484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf7823-0961-410b-9d94-fb1af0040189 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:35.253503 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496500a-5873-41b2-92d0-a9e3d38ea5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:35.254495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496500a-5873-41b2-92d0-a9e3d38ea5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:35.254979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496500a-5873-41b2-92d0-a9e3d38ea5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:35.255430 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496500a-5873-41b2-92d0-a9e3d38ea5c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:35.273144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf224f-0d18-40a8-a16d-f8b0826c259d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:35.283592 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:35.310853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428a2a8-db20-4058-923a-4d759cfd8015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:35.311854 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428a2a8-db20-4058-923a-4d759cfd8015 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:35.312135 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428a2a8-db20-4058-923a-4d759cfd8015 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:35.312406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428a2a8-db20-4058-923a-4d759cfd8015 None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:35.313738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428a2a8-db20-4058-923a-4d759cfd8015 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:35.315232 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428a2a8-db20-4058-923a-4d759cfd8015 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:35.317002 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 90/183] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:35 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:35.317770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428a2a8-db20-4058-923a-4d759cfd8015 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:35.325402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496500a-5873-41b2-92d0-a9e3d38ea5c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:35.327209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496500a-5873-41b2-92d0-a9e3d38ea5c0 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:35.360637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:35.423847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428a2a8-db20-4058-923a-4d759cfd8015 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:35.429301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 94/184] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:35.430716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a195a-2d2e-4ecc-bc86-7f88c1c0e14b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:35.431009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a195a-2d2e-4ecc-bc86-7f88c1c0e14b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:35.431276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a195a-2d2e-4ecc-bc86-7f88c1c0e14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:35.447559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-990a195a-2d2e-4ecc-bc86-7f88c1c0e14b None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:35.448768 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-990a195a-2d2e-4ecc-bc86-7f88c1c0e14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:35.460466 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95f823-d9e5-41b4-bd55-7b4623a56959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:35.461173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95f823-d9e5-41b4-bd55-7b4623a56959 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:35.461459 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95f823-d9e5-41b4-bd55-7b4623a56959 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:35.461733 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95f823-d9e5-41b4-bd55-7b4623a56959 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:35.462485 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95f823-d9e5-41b4-bd55-7b4623a56959 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:35.462796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95f823-d9e5-41b4-bd55-7b4623a56959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:35.464192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95f823-d9e5-41b4-bd55-7b4623a56959 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:35.473272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 91/185] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:14:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:35.474065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95f823-d9e5-41b4-bd55-7b4623a56959 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:35.512167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:35.522613 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 95/186] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:35.524033 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63424370-7721-4d33-a7d8-37f738587f7d None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:35.524317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63424370-7721-4d33-a7d8-37f738587f7d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:35.524618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63424370-7721-4d33-a7d8-37f738587f7d None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:35.525888 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 96/187] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:35.530754 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63424370-7721-4d33-a7d8-37f738587f7d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:35.585794 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95f823-d9e5-41b4-bd55-7b4623a56959 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:35.593361 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:35.619214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39635656-ae2e-4dc3-ac8f-9b6cb25788a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:35.619888 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39635656-ae2e-4dc3-ac8f-9b6cb25788a1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:35.620165 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39635656-ae2e-4dc3-ac8f-9b6cb25788a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:35.620438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39635656-ae2e-4dc3-ac8f-9b6cb25788a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:35.621223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39635656-ae2e-4dc3-ac8f-9b6cb25788a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:35.621526 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39635656-ae2e-4dc3-ac8f-9b6cb25788a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:35.622919 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39635656-ae2e-4dc3-ac8f-9b6cb25788a1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:35.631046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 92/188] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:35.631842 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39635656-ae2e-4dc3-ac8f-9b6cb25788a1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:35.633471 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63424370-7721-4d33-a7d8-37f738587f7d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:35.668163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7541d-86c1-4c86-b283-4540eee7516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:35.668855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7541d-86c1-4c86-b283-4540eee7516c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:35.669135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7541d-86c1-4c86-b283-4540eee7516c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:35.669409 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7541d-86c1-4c86-b283-4540eee7516c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:35.670236 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7541d-86c1-4c86-b283-4540eee7516c None admin] RBAC: Adding query filter params (role.id=690fc625fea1445fa7e0e8f40ae2246c, scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a, user.id=b1f6a3270f434dc79c93cb4804c35e56) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:35.670543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7541d-86c1-4c86-b283-4540eee7516c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:35.672500 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7541d-86c1-4c86-b283-4540eee7516c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:35.678800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 97/189] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:35 2022] GET /identity/v3/role_assignments?user.id=b1f6a3270f434dc79c93cb4804c35e56&scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a&role.id=690fc625fea1445fa7e0e8f40ae2246c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:35.679230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7541d-86c1-4c86-b283-4540eee7516c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:35.741505 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:35.744951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39635656-ae2e-4dc3-ac8f-9b6cb25788a1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:35.780769 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5ad52-8b4f-4660-b03f-36933fff9f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:35.781669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5ad52-8b4f-4660-b03f-36933fff9f7b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:35.781951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5ad52-8b4f-4660-b03f-36933fff9f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:35.782242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5ad52-8b4f-4660-b03f-36933fff9f7b None admin] PATH_INFO: `/v3/projects/4e578004e4be45908ee26181fd2d422f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:35.783506 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5ad52-8b4f-4660-b03f-36933fff9f7b None admin] RBAC: Authorizing `identity:get_project(project_id=4e578004e4be45908ee26181fd2d422f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:35.785073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5ad52-8b4f-4660-b03f-36933fff9f7b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:35.791748 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 93/190] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:35 2022] GET /identity/v3/projects/4e578004e4be45908ee26181fd2d422f => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:35.791748 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc26ea-610b-46ec-bbd7-ea90da64c464 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:35.791748 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc26ea-610b-46ec-bbd7-ea90da64c464 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:35.791748 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc26ea-610b-46ec-bbd7-ea90da64c464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:35.807565 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d1dc26ea-610b-46ec-bbd7-ea90da64c464 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:35.809186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d1dc26ea-610b-46ec-bbd7-ea90da64c464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:35.809297 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7541d-86c1-4c86-b283-4540eee7516c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:35.838164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:35.849001 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32539072-58dd-4cac-b071-fbca37fb06e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:35.849931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32539072-58dd-4cac-b071-fbca37fb06e7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:35.850170 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32539072-58dd-4cac-b071-fbca37fb06e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:35.850435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32539072-58dd-4cac-b071-fbca37fb06e7 None admin] PATH_INFO: `/v3/users/7f4c715065904cfa9ee57d8e197dd7df` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:35.866820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32539072-58dd-4cac-b071-fbca37fb06e7 None admin] RBAC: Authorizing `identity:get_user(user_id=7f4c715065904cfa9ee57d8e197dd7df)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:35.869073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32539072-58dd-4cac-b071-fbca37fb06e7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:35.871354 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 98/191] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:35 2022] GET /identity/v3/users/7f4c715065904cfa9ee57d8e197dd7df => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:35.872078 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32539072-58dd-4cac-b071-fbca37fb06e7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:35.891740 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 94/192] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:35.892796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc26ea-610b-46ec-bbd7-ea90da64c464 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:35.979101 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32539072-58dd-4cac-b071-fbca37fb06e7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:35.993622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:35.997295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc26ea-610b-46ec-bbd7-ea90da64c464 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:36.013718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd2737-0ad8-4ba0-93e7-25fa38c858df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:36.015169 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd2737-0ad8-4ba0-93e7-25fa38c858df None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:36.015455 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd2737-0ad8-4ba0-93e7-25fa38c858df None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:36.015730 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd2737-0ad8-4ba0-93e7-25fa38c858df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:36.017039 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd2737-0ad8-4ba0-93e7-25fa38c858df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:36.018501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd2737-0ad8-4ba0-93e7-25fa38c858df None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:36.020203 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 99/193] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:14:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:36.020985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd2737-0ad8-4ba0-93e7-25fa38c858df None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:36.035302 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981d751-df78-4882-8688-63c84a1901ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:36.036189 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981d751-df78-4882-8688-63c84a1901ed None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:36.036460 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981d751-df78-4882-8688-63c84a1901ed None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:36.036840 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981d751-df78-4882-8688-63c84a1901ed None admin] PATH_INFO: `/v3/users/7f4c715065904cfa9ee57d8e197dd7df` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:36.038311 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981d751-df78-4882-8688-63c84a1901ed None admin] RBAC: Authorizing `identity:get_user(user_id=7f4c715065904cfa9ee57d8e197dd7df)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:36.039835 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981d751-df78-4882-8688-63c84a1901ed None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:36.041540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 95/194] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:35 2022] GET /identity/v3/users/7f4c715065904cfa9ee57d8e197dd7df => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:36.041540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981d751-df78-4882-8688-63c84a1901ed None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:36.080108 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:36.137709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd2737-0ad8-4ba0-93e7-25fa38c858df None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:36.143174 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981d751-df78-4882-8688-63c84a1901ed None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:36.172321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb3503-e30a-4df7-9171-929e404fb19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:36.173003 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb3503-e30a-4df7-9171-929e404fb19c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:36.173283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb3503-e30a-4df7-9171-929e404fb19c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:36.173550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb3503-e30a-4df7-9171-929e404fb19c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:36.174366 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb3503-e30a-4df7-9171-929e404fb19c None admin] RBAC: Adding query filter params (role.id=713f175e9435403f9e39528c805bd956, scope.project.id=4e578004e4be45908ee26181fd2d422f, user.id=b1f6a3270f434dc79c93cb4804c35e56) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:36.174672 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb3503-e30a-4df7-9171-929e404fb19c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:36.176128 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb3503-e30a-4df7-9171-929e404fb19c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:36.176908 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101b0ee-a1ea-4ea8-9acc-7c3c1ae689e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:36.177562 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101b0ee-a1ea-4ea8-9acc-7c3c1ae689e4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:36.177842 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101b0ee-a1ea-4ea8-9acc-7c3c1ae689e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:36.178115 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101b0ee-a1ea-4ea8-9acc-7c3c1ae689e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:36.181989 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 100/195] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:36 2022] GET /identity/v3/role_assignments?user.id=b1f6a3270f434dc79c93cb4804c35e56&scope.project.id=4e578004e4be45908ee26181fd2d422f&role.id=713f175e9435403f9e39528c805bd956 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:36.182777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb3503-e30a-4df7-9171-929e404fb19c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:36.224068 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:36.270224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101b0ee-a1ea-4ea8-9acc-7c3c1ae689e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:36.272202 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101b0ee-a1ea-4ea8-9acc-7c3c1ae689e4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:36.303503 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb3503-e30a-4df7-9171-929e404fb19c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:36.323727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:36.345895 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a9520-073e-4081-9043-47a5826e4a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:36.347005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a9520-073e-4081-9043-47a5826e4a5f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:36.347112 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a9520-073e-4081-9043-47a5826e4a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:36.347317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a9520-073e-4081-9043-47a5826e4a5f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:36.361650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a9520-073e-4081-9043-47a5826e4a5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:36.369582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-ac8a9520-073e-4081-9043-47a5826e4a5f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:36.369582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:36.369582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:36.369582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:36.369582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:36.369582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:36.369582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:36.369582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:36.369582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:36.369582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:36.369582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:36.369582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:36.369582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:36.369582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:36.369582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:36.369582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:36.370456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:36.370456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:36.370456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:36.370456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:36.370456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:36.370456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:36.370456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:36.370456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:36.370456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:36.370456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:36.370456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:36.370456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:36.370456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:36.370456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:36.370456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:36.370456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:36.371650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:36.371650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:36.371650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:36.371650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:36.371650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:36.371650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:36.371650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:36.371650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:36.371650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:36.371650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:36.371650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:36.371650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:36.371650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 101/196] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:36.371650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a9520-073e-4081-9043-47a5826e4a5f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:36.401914 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 96/197] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:36.403817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101b0ee-a1ea-4ea8-9acc-7c3c1ae689e4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:36.474685 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:36.486373 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a9520-073e-4081-9043-47a5826e4a5f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:36.510582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101b0ee-a1ea-4ea8-9acc-7c3c1ae689e4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:36.521436 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcacb7c-234e-47db-86ec-a41a01708de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:36.522047 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcacb7c-234e-47db-86ec-a41a01708de3 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:36.522320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcacb7c-234e-47db-86ec-a41a01708de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:36.522586 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcacb7c-234e-47db-86ec-a41a01708de3 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:36.523296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcacb7c-234e-47db-86ec-a41a01708de3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:36.524778 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcacb7c-234e-47db-86ec-a41a01708de3 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:36.545003 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914ad12-0b91-462b-b12a-645e7d5dc98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:36.546389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 102/198] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:14:36 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:14:36.546499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914ad12-0b91-462b-b12a-645e7d5dc98a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:36.546499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914ad12-0b91-462b-b12a-645e7d5dc98a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:36.546623 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914ad12-0b91-462b-b12a-645e7d5dc98a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:36.546688 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcacb7c-234e-47db-86ec-a41a01708de3 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:36.590436 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:36.630339 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914ad12-0b91-462b-b12a-645e7d5dc98a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:36.631850 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914ad12-0b91-462b-b12a-645e7d5dc98a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:36.667429 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcacb7c-234e-47db-86ec-a41a01708de3 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:36.705818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:36.712492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07698eca-bd5e-4445-b5de-45977394410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:36.713206 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07698eca-bd5e-4445-b5de-45977394410f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:36.713500 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07698eca-bd5e-4445-b5de-45977394410f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:36.713748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07698eca-bd5e-4445-b5de-45977394410f None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:36.714505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07698eca-bd5e-4445-b5de-45977394410f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:36.715395 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07698eca-bd5e-4445-b5de-45977394410f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:36.716452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07698eca-bd5e-4445-b5de-45977394410f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:36.728611 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 103/199] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:36.729549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07698eca-bd5e-4445-b5de-45977394410f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:36.758703 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 97/200] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:36.759559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914ad12-0b91-462b-b12a-645e7d5dc98a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:36.851726 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:36.859985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07698eca-bd5e-4445-b5de-45977394410f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:36.880705 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914ad12-0b91-462b-b12a-645e7d5dc98a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:36.905403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae69620-bdd7-4f4e-afcf-06393f45c5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:36.906330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae69620-bdd7-4f4e-afcf-06393f45c5bb None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:36.906612 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae69620-bdd7-4f4e-afcf-06393f45c5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:36.906879 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae69620-bdd7-4f4e-afcf-06393f45c5bb None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:36.909280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae69620-bdd7-4f4e-afcf-06393f45c5bb None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:36.910736 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae69620-bdd7-4f4e-afcf-06393f45c5bb None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:36.912455 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 104/201] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:36 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:36.913239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae69620-bdd7-4f4e-afcf-06393f45c5bb None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:36.925437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629951d-37a9-435c-bbfa-142239bba52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:36.926476 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629951d-37a9-435c-bbfa-142239bba52f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:36.926813 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629951d-37a9-435c-bbfa-142239bba52f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:36.927146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629951d-37a9-435c-bbfa-142239bba52f None admin] PATH_INFO: `/v3/users/64d9750809ab423f853ee96e998330a8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:36.928442 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629951d-37a9-435c-bbfa-142239bba52f None admin] RBAC: Authorizing `identity:get_user(user_id=64d9750809ab423f853ee96e998330a8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:36.930028 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629951d-37a9-435c-bbfa-142239bba52f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:36.932049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 98/202] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:36 2022] GET /identity/v3/users/64d9750809ab423f853ee96e998330a8 => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:36.932944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629951d-37a9-435c-bbfa-142239bba52f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:36.981118 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:37.027004 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae69620-bdd7-4f4e-afcf-06393f45c5bb None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:37.060614 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629951d-37a9-435c-bbfa-142239bba52f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:37.063397 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e49c0-9dd8-4b9b-aa9d-05f0265d70c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:37.064446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e49c0-9dd8-4b9b-aa9d-05f0265d70c1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:37.064847 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e49c0-9dd8-4b9b-aa9d-05f0265d70c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:37.065207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e49c0-9dd8-4b9b-aa9d-05f0265d70c1 None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:37.066593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e49c0-9dd8-4b9b-aa9d-05f0265d70c1 None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:37.068133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e49c0-9dd8-4b9b-aa9d-05f0265d70c1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:37.070174 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 105/203] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:36 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:37.070867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e49c0-9dd8-4b9b-aa9d-05f0265d70c1 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:37.102552 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88d04a-fea1-47f7-8026-421277b2206b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:37.103562 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88d04a-fea1-47f7-8026-421277b2206b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:37.104062 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:37.104593 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88d04a-fea1-47f7-8026-421277b2206b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:37.105754 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88d04a-fea1-47f7-8026-421277b2206b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:37.106843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88d04a-fea1-47f7-8026-421277b2206b None admin] RBAC: Adding query filter params (role.id=690fc625fea1445fa7e0e8f40ae2246c, scope.project.id=62c99d0f651845d884f137c894087eb1, user.id=7f4c715065904cfa9ee57d8e197dd7df) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:37.107351 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88d04a-fea1-47f7-8026-421277b2206b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:37.109705 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88d04a-fea1-47f7-8026-421277b2206b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:37.117386 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 99/204] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:36 2022] GET /identity/v3/role_assignments?user.id=7f4c715065904cfa9ee57d8e197dd7df&scope.project.id=62c99d0f651845d884f137c894087eb1&role.id=690fc625fea1445fa7e0e8f40ae2246c => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:37.118544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88d04a-fea1-47f7-8026-421277b2206b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:37.188184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e49c0-9dd8-4b9b-aa9d-05f0265d70c1 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:37.229490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac63f09-6adc-43cc-938c-861269116fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:37.230200 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac63f09-6adc-43cc-938c-861269116fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:37.230482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac63f09-6adc-43cc-938c-861269116fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:37.230759 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac63f09-6adc-43cc-938c-861269116fb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:37.309179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac63f09-6adc-43cc-938c-861269116fb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:37.310757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac63f09-6adc-43cc-938c-861269116fb2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:37.314994 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:37.320310 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88d04a-fea1-47f7-8026-421277b2206b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:37.371180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a25d4a-0510-4d76-98dd-0b0cf04db731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:37.371751 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a25d4a-0510-4d76-98dd-0b0cf04db731 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:37.372027 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a25d4a-0510-4d76-98dd-0b0cf04db731 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:37.372297 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a25d4a-0510-4d76-98dd-0b0cf04db731 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:37.373212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a25d4a-0510-4d76-98dd-0b0cf04db731 None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=62c99d0f651845d884f137c894087eb1, user.id=7f4c715065904cfa9ee57d8e197dd7df) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:37.373543 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a25d4a-0510-4d76-98dd-0b0cf04db731 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:37.375035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a25d4a-0510-4d76-98dd-0b0cf04db731 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:37.384887 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:37.394103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 100/205] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:37 2022] GET /identity/v3/role_assignments?user.id=7f4c715065904cfa9ee57d8e197dd7df&scope.project.id=62c99d0f651845d884f137c894087eb1&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:37.472154 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 106/206] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:37.478266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a25d4a-0510-4d76-98dd-0b0cf04db731 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:37.596728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a25d4a-0510-4d76-98dd-0b0cf04db731 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:37.638129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597afa1f-36c2-4fda-93ce-afe13e91cdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:37.639486 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597afa1f-36c2-4fda-93ce-afe13e91cdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:37.639967 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597afa1f-36c2-4fda-93ce-afe13e91cdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:37.640438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597afa1f-36c2-4fda-93ce-afe13e91cdc7 None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:37.641907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597afa1f-36c2-4fda-93ce-afe13e91cdc7 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:37.643572 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597afa1f-36c2-4fda-93ce-afe13e91cdc7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:37.645738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 101/207] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:37 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:37.651945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac63f09-6adc-43cc-938c-861269116fb2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:37.770435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac63f09-6adc-43cc-938c-861269116fb2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:37.801651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:37.804807 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f59acd-3b27-45dc-a724-6eec2f12f715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:37.805449 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f59acd-3b27-45dc-a724-6eec2f12f715 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:37.806105 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f59acd-3b27-45dc-a724-6eec2f12f715 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:37.806374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f59acd-3b27-45dc-a724-6eec2f12f715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:37.811288 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f59acd-3b27-45dc-a724-6eec2f12f715 None admin] RBAC: Adding query filter params (role.id=a96cd51936d549a3986a0e7e1f50f040, scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a, user.id=64d9750809ab423f853ee96e998330a8) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:37.811288 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f59acd-3b27-45dc-a724-6eec2f12f715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:37.811288 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f59acd-3b27-45dc-a724-6eec2f12f715 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:37.815415 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 107/208] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:37 2022] GET /identity/v3/role_assignments?user.id=64d9750809ab423f853ee96e998330a8&scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a&role.id=a96cd51936d549a3986a0e7e1f50f040 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:38.908151 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe70d-2e2c-49cf-a53b-aa0eee7ecc91 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:38.908709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe70d-2e2c-49cf-a53b-aa0eee7ecc91 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:38.908709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe70d-2e2c-49cf-a53b-aa0eee7ecc91 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:38.910385 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 102/209] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:38.915860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797bda0-6686-4967-9843-716ae8ee0933 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:38.916289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797bda0-6686-4967-9843-716ae8ee0933 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:38.916469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797bda0-6686-4967-9843-716ae8ee0933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:38.933842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-8797bda0-6686-4967-9843-716ae8ee0933 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:38.935056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8797bda0-6686-4967-9843-716ae8ee0933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:39.003231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 108/210] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:39.014013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07bc89-d60f-4d60-90c9-4eb6c9dff844 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:39.014498 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07bc89-d60f-4d60-90c9-4eb6c9dff844 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:39.015206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07bc89-d60f-4d60-90c9-4eb6c9dff844 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:39.016772 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 103/211] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:39.021704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a2e76-554c-4fd4-9f62-73e0f7e5d51d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:39.021997 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a2e76-554c-4fd4-9f62-73e0f7e5d51d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:39.022276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a2e76-554c-4fd4-9f62-73e0f7e5d51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:39.032139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07bc89-d60f-4d60-90c9-4eb6c9dff844 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:39.043191 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-631a2e76-554c-4fd4-9f62-73e0f7e5d51d None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:39.044458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-631a2e76-554c-4fd4-9f62-73e0f7e5d51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:39.064321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:39.112986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 109/212] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:39.137225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a2e76-554c-4fd4-9f62-73e0f7e5d51d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:39.141725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07bc89-d60f-4d60-90c9-4eb6c9dff844 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:39.176922 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d84407-8576-419a-b099-f196804e35c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:39.177744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d84407-8576-419a-b099-f196804e35c0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:39.178029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d84407-8576-419a-b099-f196804e35c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:39.178307 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d84407-8576-419a-b099-f196804e35c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:39.189484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d84407-8576-419a-b099-f196804e35c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:39.197838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-28d84407-8576-419a-b099-f196804e35c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:39.197838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:39.197838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:39.197838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:39.197838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:39.197838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:39.197838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:39.197838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:39.197838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:39.197838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:39.197838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:39.197838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:39.197838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:39.197838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:39.197838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:39.197838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:39.198702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:39.198702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:39.198702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:39.198702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:39.198702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:39.198702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:39.198702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:39.198702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:39.198702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:39.198702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:39.198702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:39.198702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:39.198702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:39.198702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:39.198702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:39.198702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:39.199457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:39.199457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:39.199457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:39.199457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:39.199457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:39.199457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:39.199457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:39.199457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:39.199457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:39.199457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:39.199457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:39.199457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:39.200060 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:39.205134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 104/213] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:39.206029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d84407-8576-419a-b099-f196804e35c0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:39.246525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a2e76-554c-4fd4-9f62-73e0f7e5d51d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:39.282952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fedc7f-2ce2-4dec-84fd-0be0771bf329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:39.283769 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fedc7f-2ce2-4dec-84fd-0be0771bf329 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:39.284110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fedc7f-2ce2-4dec-84fd-0be0771bf329 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:39.284463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fedc7f-2ce2-4dec-84fd-0be0771bf329 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:39.285730 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fedc7f-2ce2-4dec-84fd-0be0771bf329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:39.287244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fedc7f-2ce2-4dec-84fd-0be0771bf329 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:39.289378 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 110/214] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:14:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:39.293297 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabcbde-ffa3-4880-9632-f3110d6482e3 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:39.293574 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabcbde-ffa3-4880-9632-f3110d6482e3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:39.293844 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabcbde-ffa3-4880-9632-f3110d6482e3 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:39.295407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 111/215] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:14:39.295972 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabcbde-ffa3-4880-9632-f3110d6482e3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:39.308157 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:39.320103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d84407-8576-419a-b099-f196804e35c0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:39.354890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbaf37-a18b-4e23-abeb-ac068a5441c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:39.355561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbaf37-a18b-4e23-abeb-ac068a5441c1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:39.355842 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbaf37-a18b-4e23-abeb-ac068a5441c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:39.356122 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbaf37-a18b-4e23-abeb-ac068a5441c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:39.356912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbaf37-a18b-4e23-abeb-ac068a5441c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:39.357215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbaf37-a18b-4e23-abeb-ac068a5441c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:39.358755 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbaf37-a18b-4e23-abeb-ac068a5441c1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:39.370432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 105/216] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:39.370432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0917b09-10e3-439c-ba54-5d4a22a67fdb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:39.370432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0917b09-10e3-439c-ba54-5d4a22a67fdb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:39.370432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0917b09-10e3-439c-ba54-5d4a22a67fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:39.387775 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d0917b09-10e3-439c-ba54-5d4a22a67fdb None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:39.388991 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d0917b09-10e3-439c-ba54-5d4a22a67fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:39.409810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabcbde-ffa3-4880-9632-f3110d6482e3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:39.433852 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:39.445600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a98c8-cb84-4997-97c3-63e8f13038c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:39.446271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a98c8-cb84-4997-97c3-63e8f13038c6 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:39.446526 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a98c8-cb84-4997-97c3-63e8f13038c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:39.446811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a98c8-cb84-4997-97c3-63e8f13038c6 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:39.447486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a98c8-cb84-4997-97c3-63e8f13038c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:39.448956 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a98c8-cb84-4997-97c3-63e8f13038c6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:39.463556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 106/217] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:39.464760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0917b09-10e3-439c-ba54-5d4a22a67fdb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:39.490352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 112/218] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:14:39 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:14:39.491698 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a98c8-cb84-4997-97c3-63e8f13038c6 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:39.571095 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:39.599380 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0917b09-10e3-439c-ba54-5d4a22a67fdb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:39.621456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a98c8-cb84-4997-97c3-63e8f13038c6 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:39.652380 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531e208-8915-4b18-84e1-b621578b38d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:39.653310 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531e208-8915-4b18-84e1-b621578b38d0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:39.653591 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531e208-8915-4b18-84e1-b621578b38d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:39.653864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531e208-8915-4b18-84e1-b621578b38d0 None admin] PATH_INFO: `/v3/users/ece10ebdd1ae478aaac5f23c7dddda76` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:39.667489 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd7d12-3873-4d32-8aea-7c931e3489ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:39.668316 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd7d12-3873-4d32-8aea-7c931e3489ce None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:39.668637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd7d12-3873-4d32-8aea-7c931e3489ce None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:39.668908 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd7d12-3873-4d32-8aea-7c931e3489ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:39.673984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531e208-8915-4b18-84e1-b621578b38d0 None admin] RBAC: Authorizing `identity:get_user(user_id=ece10ebdd1ae478aaac5f23c7dddda76)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:39.676065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531e208-8915-4b18-84e1-b621578b38d0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:39.678063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 107/219] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:39 2022] GET /identity/v3/users/ece10ebdd1ae478aaac5f23c7dddda76 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:39.684623 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd7d12-3873-4d32-8aea-7c931e3489ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:39.685177 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531e208-8915-4b18-84e1-b621578b38d0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:39.693106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7efd7d12-3873-4d32-8aea-7c931e3489ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:14:39.693106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:39.693106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:39.693106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:39.693106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:39.693106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:39.693106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:39.693106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:39.693106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:39.693106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:39.693106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:39.693106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:39.693106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:39.693106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:39.693106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:39.693106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:39.694019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:39.694019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:39.694019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:39.694019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:39.694019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:39.694019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:39.694019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:39.694019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:39.694019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:39.694019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:39.694019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:39.694019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:39.694019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:39.694019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:39.694019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:39.694019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:39.695224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:39.695224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:39.695224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:39.695224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:39.695224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:39.695224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:39.695224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:39.695224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:39.695224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:39.695224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:39.695224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:14:39.695224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:39.695830 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 113/220] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:14:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:39.707007 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd7d12-3873-4d32-8aea-7c931e3489ce None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:39.760073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:39.825391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531e208-8915-4b18-84e1-b621578b38d0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:39.844551 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd7d12-3873-4d32-8aea-7c931e3489ce None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:39.867092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010f021-e3a3-472c-b806-e7a6e4158066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:39.867092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f021-e3a3-472c-b806-e7a6e4158066 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:39.867398 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f021-e3a3-472c-b806-e7a6e4158066 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:39.867612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f021-e3a3-472c-b806-e7a6e4158066 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:39.880767 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:39.885682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e01f7-d151-4d47-b2a1-af364ac16adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:39.886374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e01f7-d151-4d47-b2a1-af364ac16adb None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:39.886738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e01f7-d151-4d47-b2a1-af364ac16adb None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:39.887011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e01f7-d151-4d47-b2a1-af364ac16adb None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:39.887826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e01f7-d151-4d47-b2a1-af364ac16adb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:39.888129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e01f7-d151-4d47-b2a1-af364ac16adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:39.889748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e01f7-d151-4d47-b2a1-af364ac16adb None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:39.898636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 114/221] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:14:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:39.901729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b078f5a-10d8-4dcf-b8e1-cba455e3823a None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:39.902011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b078f5a-10d8-4dcf-b8e1-cba455e3823a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:39.902277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b078f5a-10d8-4dcf-b8e1-cba455e3823a None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:39.903808 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 115/222] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:39.905517 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b078f5a-10d8-4dcf-b8e1-cba455e3823a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:39.961792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010f021-e3a3-472c-b806-e7a6e4158066 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:39.963792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010f021-e3a3-472c-b806-e7a6e4158066 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:40.019034 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b078f5a-10d8-4dcf-b8e1-cba455e3823a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:40.020898 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:40.059903 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efec4e6-a89d-43ec-a3dc-571d87833bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:40.060825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efec4e6-a89d-43ec-a3dc-571d87833bfc None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:40.061287 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efec4e6-a89d-43ec-a3dc-571d87833bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:40.062142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efec4e6-a89d-43ec-a3dc-571d87833bfc None admin] PATH_INFO: `/v3/users/7f4c715065904cfa9ee57d8e197dd7df` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:40.063370 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efec4e6-a89d-43ec-a3dc-571d87833bfc None admin] RBAC: Authorizing `identity:get_user(user_id=7f4c715065904cfa9ee57d8e197dd7df)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:40.065068 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efec4e6-a89d-43ec-a3dc-571d87833bfc None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:40.066899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 116/223] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:39 2022] GET /identity/v3/users/7f4c715065904cfa9ee57d8e197dd7df => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:40.068200 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea06590-039b-4ba0-9a13-6c5615c46f42 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:40.068488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea06590-039b-4ba0-9a13-6c5615c46f42 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:40.068805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea06590-039b-4ba0-9a13-6c5615c46f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:40.087207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4ea06590-039b-4ba0-9a13-6c5615c46f42 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:40.088315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4ea06590-039b-4ba0-9a13-6c5615c46f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:40.093920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 108/224] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 03:14:40.094870 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010f021-e3a3-472c-b806-e7a6e4158066 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:40.138863 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:40.172658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 117/225] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:40.173600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea06590-039b-4ba0-9a13-6c5615c46f42 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:40.225116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010f021-e3a3-472c-b806-e7a6e4158066 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:40.273173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4687e-b821-4bf7-8438-d1f34ac7c451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:40.274404 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4687e-b821-4bf7-8438-d1f34ac7c451 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:40.274836 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4687e-b821-4bf7-8438-d1f34ac7c451 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:40.275232 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4687e-b821-4bf7-8438-d1f34ac7c451 None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:40.276617 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4687e-b821-4bf7-8438-d1f34ac7c451 None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:40.278723 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4687e-b821-4bf7-8438-d1f34ac7c451 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:40.281654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 109/226] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:40 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:40.282513 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4687e-b821-4bf7-8438-d1f34ac7c451 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:40.292921 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:40.299746 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea06590-039b-4ba0-9a13-6c5615c46f42 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:40.349637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dac762-d1f9-463e-96a1-7010ad412f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:40.350696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dac762-d1f9-463e-96a1-7010ad412f07 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:40.350973 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dac762-d1f9-463e-96a1-7010ad412f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:40.351882 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dac762-d1f9-463e-96a1-7010ad412f07 None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:40.353426 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dac762-d1f9-463e-96a1-7010ad412f07 None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:40.355510 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dac762-d1f9-463e-96a1-7010ad412f07 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:40.357858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 118/227] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:40 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:40.358607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dac762-d1f9-463e-96a1-7010ad412f07 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:40.415925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4687e-b821-4bf7-8438-d1f34ac7c451 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:40.428673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:40.457898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb49d1-1297-4a9f-a785-4cd20bd87a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:40.458702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb49d1-1297-4a9f-a785-4cd20bd87a4b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:40.458979 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb49d1-1297-4a9f-a785-4cd20bd87a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:40.459249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb49d1-1297-4a9f-a785-4cd20bd87a4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:40.470500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb49d1-1297-4a9f-a785-4cd20bd87a4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:40.479260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-febb49d1-1297-4a9f-a785-4cd20bd87a4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:40.479260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:40.479260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:40.479260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:40.479260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:40.479260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:40.479260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:40.479260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:40.479260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:40.479260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:40.479260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:40.479260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:40.479260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:40.479260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:40.479260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:40.479260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:40.481371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:40.481371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:40.481371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:40.481371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:40.481371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:40.481371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:40.481371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:40.481371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:40.481371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:40.481371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:40.481371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:40.481371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:40.481371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:40.481371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:40.481371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:40.481371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:40.483579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:40.483579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:40.483579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:40.483579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:40.483579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:40.483579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:40.483579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:40.483579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:40.483579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:40.483579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:40.483579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:40.483579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:40.483579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 110/228] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:14:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:40.483579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb49d1-1297-4a9f-a785-4cd20bd87a4b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:40.491227 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dac762-d1f9-463e-96a1-7010ad412f07 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:40.536827 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7288d-85ef-4abe-98c2-16c687e7a81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:40.537778 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7288d-85ef-4abe-98c2-16c687e7a81f None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:40.538056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7288d-85ef-4abe-98c2-16c687e7a81f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:40.538322 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7288d-85ef-4abe-98c2-16c687e7a81f None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1/users/7f4c715065904cfa9ee57d8e197dd7df/roles/690fc625fea1445fa7e0e8f40ae2246c` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:40.540575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7288d-85ef-4abe-98c2-16c687e7a81f None admin] RBAC: Authorizing `identity:create_grant(project_id=62c99d0f651845d884f137c894087eb1, user_id=7f4c715065904cfa9ee57d8e197dd7df, role_id=690fc625fea1445fa7e0e8f40ae2246c)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:40.542613 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7288d-85ef-4abe-98c2-16c687e7a81f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:40.561145 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 119/229] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:14:40 2022] PUT /identity/v3/projects/62c99d0f651845d884f137c894087eb1/users/7f4c715065904cfa9ee57d8e197dd7df/roles/690fc625fea1445fa7e0e8f40ae2246c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:14:40.562056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7288d-85ef-4abe-98c2-16c687e7a81f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:40.627554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb49d1-1297-4a9f-a785-4cd20bd87a4b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:40.634730 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:40.668023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfee49-9511-4ca8-bee2-308d879b6996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:40.668806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfee49-9511-4ca8-bee2-308d879b6996 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:40.669087 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfee49-9511-4ca8-bee2-308d879b6996 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:40.669358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfee49-9511-4ca8-bee2-308d879b6996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:40.670822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfee49-9511-4ca8-bee2-308d879b6996 None admin] RBAC: Adding query filter params (role.id=713f175e9435403f9e39528c805bd956, scope.project.id=62c99d0f651845d884f137c894087eb1, user.id=ece10ebdd1ae478aaac5f23c7dddda76) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:40.671146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfee49-9511-4ca8-bee2-308d879b6996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:40.672811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfee49-9511-4ca8-bee2-308d879b6996 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:40.684570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 111/230] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:40 2022] GET /identity/v3/role_assignments?user.id=ece10ebdd1ae478aaac5f23c7dddda76&scope.project.id=62c99d0f651845d884f137c894087eb1&role.id=713f175e9435403f9e39528c805bd956 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:40.754496 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7288d-85ef-4abe-98c2-16c687e7a81f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:40.803177 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a016a-e941-4397-baab-9312912e74bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:40.803871 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a016a-e941-4397-baab-9312912e74bd None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:40.804145 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a016a-e941-4397-baab-9312912e74bd None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:40.804413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a016a-e941-4397-baab-9312912e74bd None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:40.805221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a016a-e941-4397-baab-9312912e74bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:40.805518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a016a-e941-4397-baab-9312912e74bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:40.806926 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a016a-e941-4397-baab-9312912e74bd None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:40.817207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 120/231] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:40.824301 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfee49-9511-4ca8-bee2-308d879b6996 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:40.879074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:40.981783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfee49-9511-4ca8-bee2-308d879b6996 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:41.020326 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d8f74-1f64-4243-8bdf-050d841cd72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:41.021257 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d8f74-1f64-4243-8bdf-050d841cd72c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:41.021539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d8f74-1f64-4243-8bdf-050d841cd72c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:41.021805 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d8f74-1f64-4243-8bdf-050d841cd72c None admin] PATH_INFO: `/v3/users/7f4c715065904cfa9ee57d8e197dd7df` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:41.023074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d8f74-1f64-4243-8bdf-050d841cd72c None admin] RBAC: Authorizing `identity:get_user(user_id=7f4c715065904cfa9ee57d8e197dd7df)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:41.024606 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d8f74-1f64-4243-8bdf-050d841cd72c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:41.033137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 112/232] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:40 2022] GET /identity/v3/users/7f4c715065904cfa9ee57d8e197dd7df => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:41.038921 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a016a-e941-4397-baab-9312912e74bd None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:41.192056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:41.207135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a016a-e941-4397-baab-9312912e74bd None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:41.250285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57b58e-fb3d-43bc-ab4b-d47d7a798324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:41.251178 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57b58e-fb3d-43bc-ab4b-d47d7a798324 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:41.251462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57b58e-fb3d-43bc-ab4b-d47d7a798324 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:41.251736 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57b58e-fb3d-43bc-ab4b-d47d7a798324 None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:41.252942 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57b58e-fb3d-43bc-ab4b-d47d7a798324 None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:41.254458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57b58e-fb3d-43bc-ab4b-d47d7a798324 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:41.256172 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 121/233] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:41 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:41.262067 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d8f74-1f64-4243-8bdf-050d841cd72c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:41.387171 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:41.391163 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d8f74-1f64-4243-8bdf-050d841cd72c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:41.433181 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18c6b5-b2dc-4c96-b4b5-3a7573a03ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:41.434092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18c6b5-b2dc-4c96-b4b5-3a7573a03ac4 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:41.434373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18c6b5-b2dc-4c96-b4b5-3a7573a03ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:41.434646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18c6b5-b2dc-4c96-b4b5-3a7573a03ac4 None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1/users/7f4c715065904cfa9ee57d8e197dd7df/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:41.436696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18c6b5-b2dc-4c96-b4b5-3a7573a03ac4 None admin] RBAC: Authorizing `identity:create_grant(project_id=62c99d0f651845d884f137c894087eb1, user_id=7f4c715065904cfa9ee57d8e197dd7df, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:41.438152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18c6b5-b2dc-4c96-b4b5-3a7573a03ac4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:41.460705 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 113/234] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:14:41 2022] PUT /identity/v3/projects/62c99d0f651845d884f137c894087eb1/users/7f4c715065904cfa9ee57d8e197dd7df/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:14:41.900668 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2e677-9874-43f6-a87c-fbab94adb6c0 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:41.901049 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2e677-9874-43f6-a87c-fbab94adb6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:41.901219 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2e677-9874-43f6-a87c-fbab94adb6c0 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:41.902904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 122/235] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:41.907792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3ce69-a081-4516-9bdf-d513e1e0ebb3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:41.908092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3ce69-a081-4516-9bdf-d513e1e0ebb3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:41.908371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3ce69-a081-4516-9bdf-d513e1e0ebb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:41.926312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-85c3ce69-a081-4516-9bdf-d513e1e0ebb3 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:41.927582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-85c3ce69-a081-4516-9bdf-d513e1e0ebb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:42.023162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 114/236] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:42.066458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2e677-9874-43f6-a87c-fbab94adb6c0 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:42.152262 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b367b-c7b2-40c3-ae3c-e7db95bb4f10 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:42.152889 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b367b-c7b2-40c3-ae3c-e7db95bb4f10 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:42.153356 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b367b-c7b2-40c3-ae3c-e7db95bb4f10 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:42.155248 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 115/237] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:14:42.160477 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f304d55-5088-4a51-8b82-374187e66c9f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:42.161052 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f304d55-5088-4a51-8b82-374187e66c9f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:42.161513 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f304d55-5088-4a51-8b82-374187e66c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:42.193395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4f304d55-5088-4a51-8b82-374187e66c9f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:42.194832 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4f304d55-5088-4a51-8b82-374187e66c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:42.206446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2e677-9874-43f6-a87c-fbab94adb6c0 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:42.244596 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd03d98-0846-478a-a091-8067e8ecf347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:42.246093 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd03d98-0846-478a-a091-8067e8ecf347 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:42.246564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd03d98-0846-478a-a091-8067e8ecf347 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:42.246981 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd03d98-0846-478a-a091-8067e8ecf347 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:42.258948 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd03d98-0846-478a-a091-8067e8ecf347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:42.275682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-ffd03d98-0846-478a-a091-8067e8ecf347 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:42.275682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:42.275682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:42.275682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:42.275682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:42.275682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:42.275682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:42.275682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:42.275682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:42.275682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:42.275682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:42.275682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:42.275682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:42.275682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:42.275682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:42.275682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:42.276641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:42.276641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:42.276641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:42.276641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:42.276641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:42.276641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:42.276641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:42.276641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:42.276641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:42.276641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:42.276641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:42.276641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:42.276641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:42.276641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:42.276641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:42.276641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:42.277450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:42.277450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:42.277450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:42.277450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:42.277450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:42.277450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:42.277450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:42.277450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:42.277450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:42.277450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:42.277450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:42.277450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:42.280944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 123/238] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:42.288567 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd03d98-0846-478a-a091-8067e8ecf347 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:42.327891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:42.363863 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 116/239] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:42.407661 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f304d55-5088-4a51-8b82-374187e66c9f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:42.438052 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd03d98-0846-478a-a091-8067e8ecf347 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:42.453014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:42.472394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff17c9-59fb-405a-b84c-3c8b009ee3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:42.473462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff17c9-59fb-405a-b84c-3c8b009ee3fa None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:42.473741 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff17c9-59fb-405a-b84c-3c8b009ee3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:42.474010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff17c9-59fb-405a-b84c-3c8b009ee3fa None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:42.474964 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff17c9-59fb-405a-b84c-3c8b009ee3fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:42.475081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff17c9-59fb-405a-b84c-3c8b009ee3fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:42.476425 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff17c9-59fb-405a-b84c-3c8b009ee3fa None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:42.492550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 124/240] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:42.492550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff17c9-59fb-405a-b84c-3c8b009ee3fa None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:42.600999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:42.619784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f304d55-5088-4a51-8b82-374187e66c9f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:42.623195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff17c9-59fb-405a-b84c-3c8b009ee3fa None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:42.687630 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95b136-a5fa-46c4-ae20-e2ee7c2a5ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:42.688445 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95b136-a5fa-46c4-ae20-e2ee7c2a5ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:42.688752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95b136-a5fa-46c4-ae20-e2ee7c2a5ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:42.689025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95b136-a5fa-46c4-ae20-e2ee7c2a5ca3 None admin] PATH_INFO: `/v3/users/e99d18299515400885dd9e2af13fd4cf` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:42.690773 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ae6f9-5647-4aa7-8a65-0f328f733feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:42.691567 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ae6f9-5647-4aa7-8a65-0f328f733feb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:42.691839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ae6f9-5647-4aa7-8a65-0f328f733feb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:42.692104 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ae6f9-5647-4aa7-8a65-0f328f733feb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:42.694531 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ae6f9-5647-4aa7-8a65-0f328f733feb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:42.697631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ae6f9-5647-4aa7-8a65-0f328f733feb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:42.702202 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 117/241] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:14:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:42.707249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ae6f9-5647-4aa7-8a65-0f328f733feb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:42.721321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95b136-a5fa-46c4-ae20-e2ee7c2a5ca3 None admin] RBAC: Authorizing `identity:get_user(user_id=e99d18299515400885dd9e2af13fd4cf)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:42.723180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95b136-a5fa-46c4-ae20-e2ee7c2a5ca3 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:42.724973 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 125/242] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:42 2022] GET /identity/v3/users/e99d18299515400885dd9e2af13fd4cf => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:42.731573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95b136-a5fa-46c4-ae20-e2ee7c2a5ca3 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:42.831764 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95b136-a5fa-46c4-ae20-e2ee7c2a5ca3 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:42.869688 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5cc9b-fe09-4c96-8441-9e08b6c64936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:42.870350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5cc9b-fe09-4c96-8441-9e08b6c64936 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:42.870625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5cc9b-fe09-4c96-8441-9e08b6c64936 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:42.870893 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5cc9b-fe09-4c96-8441-9e08b6c64936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:42.880543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:42.896886 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:42.946143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ae6f9-5647-4aa7-8a65-0f328f733feb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:42.968321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5cc9b-fe09-4c96-8441-9e08b6c64936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:42.970352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5cc9b-fe09-4c96-8441-9e08b6c64936 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:43.028102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff2663-24e4-4724-99c3-74dab29f87ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:43.028813 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff2663-24e4-4724-99c3-74dab29f87ca None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:43.029249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff2663-24e4-4724-99c3-74dab29f87ca None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:43.029727 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff2663-24e4-4724-99c3-74dab29f87ca None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:43.030595 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff2663-24e4-4724-99c3-74dab29f87ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:43.032183 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff2663-24e4-4724-99c3-74dab29f87ca None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:43.054687 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 118/243] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:14:42 2022] POST /identity/v3/users => generated 293 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:14:43.056395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f18958-9d9e-448e-a375-cd126e212a44 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:43.056896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f18958-9d9e-448e-a375-cd126e212a44 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:43.057384 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f18958-9d9e-448e-a375-cd126e212a44 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:43.063968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 119/244] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:43.066105 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fdefa-658b-459c-9655-f1c1cb4b8ab9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:43.066643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fdefa-658b-459c-9655-f1c1cb4b8ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:43.067183 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fdefa-658b-459c-9655-f1c1cb4b8ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:43.086796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-db0fdefa-658b-459c-9655-f1c1cb4b8ab9 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:43.088438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-db0fdefa-658b-459c-9655-f1c1cb4b8ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:43.125207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 126/245] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 03:14:43.133661 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5cc9b-fe09-4c96-8441-9e08b6c64936 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:43.170255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 120/246] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:43.209006 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:43.229240 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fdefa-658b-459c-9655-f1c1cb4b8ab9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:43.310390 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5cc9b-fe09-4c96-8441-9e08b6c64936 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:43.328260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:43.358313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ea039-e80d-4c19-8982-6a93564ffd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:43.359193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ea039-e80d-4c19-8982-6a93564ffd43 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:43.359468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ea039-e80d-4c19-8982-6a93564ffd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:43.359737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ea039-e80d-4c19-8982-6a93564ffd43 None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:43.361622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ea039-e80d-4c19-8982-6a93564ffd43 None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:43.363072 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ea039-e80d-4c19-8982-6a93564ffd43 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:43.365146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 127/247] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:43 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:43.370496 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fdefa-658b-459c-9655-f1c1cb4b8ab9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:43.373072 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ea039-e80d-4c19-8982-6a93564ffd43 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:43.440625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f48f27-e54c-426f-bebc-8031e9886c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:43.441711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f48f27-e54c-426f-bebc-8031e9886c5f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:43.442371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f48f27-e54c-426f-bebc-8031e9886c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:43.442655 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f48f27-e54c-426f-bebc-8031e9886c5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:43.467417 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f48f27-e54c-426f-bebc-8031e9886c5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:43.477029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-26f48f27-e54c-426f-bebc-8031e9886c5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:14:43.477029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:43.477029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:43.477029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:43.477029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:43.477029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:43.477029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:43.477029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:43.477029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:43.477029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:43.477029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:43.477029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:43.477029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:43.477029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:43.477029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:43.477029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:43.478175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:43.478175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:43.478175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:43.478175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:43.478175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:43.478175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:43.478175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:43.478175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:43.478175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:43.478175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:43.478175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:43.478175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:43.478175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:43.478175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:43.478175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:43.478175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:43.479081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:43.479081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:43.479081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:43.479081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:43.479081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:43.479081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:43.479081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:43.479081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:43.479081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:43.479081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:43.479081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:14:43.479081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:43.482882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 121/248] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:14:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:14:43.488746 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f48f27-e54c-426f-bebc-8031e9886c5f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:43.519107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ea039-e80d-4c19-8982-6a93564ffd43 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:43.521628 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:43.559629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a76c7f-c129-4552-b046-18b20126a0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:43.560297 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a76c7f-c129-4552-b046-18b20126a0be None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:43.560612 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a76c7f-c129-4552-b046-18b20126a0be None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:43.560926 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a76c7f-c129-4552-b046-18b20126a0be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:43.561775 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a76c7f-c129-4552-b046-18b20126a0be None admin] RBAC: Adding query filter params (role.id=a96cd51936d549a3986a0e7e1f50f040, scope.project.id=62c99d0f651845d884f137c894087eb1, user.id=e99d18299515400885dd9e2af13fd4cf) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:43.562084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a76c7f-c129-4552-b046-18b20126a0be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:43.563539 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a76c7f-c129-4552-b046-18b20126a0be None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:43.573652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 128/249] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:43 2022] GET /identity/v3/role_assignments?user.id=e99d18299515400885dd9e2af13fd4cf&scope.project.id=62c99d0f651845d884f137c894087eb1&role.id=a96cd51936d549a3986a0e7e1f50f040 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:43.574995 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35393cd8-1c6b-4854-9ee8-0a3f08dbafaa None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:43.575281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35393cd8-1c6b-4854-9ee8-0a3f08dbafaa None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:43.575555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35393cd8-1c6b-4854-9ee8-0a3f08dbafaa None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:43.577434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 129/250] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:43.583528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b5d23-f634-41a8-b53c-b2484de13403 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:43.583819 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b5d23-f634-41a8-b53c-b2484de13403 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:43.584098 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b5d23-f634-41a8-b53c-b2484de13403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:43.616896 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c41b5d23-f634-41a8-b53c-b2484de13403 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:43.618139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c41b5d23-f634-41a8-b53c-b2484de13403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:43.632315 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f48f27-e54c-426f-bebc-8031e9886c5f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:43.685755 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f6e05-2171-40c4-babb-ed4a8549e384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:43.686608 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f6e05-2171-40c4-babb-ed4a8549e384 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:43.687074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f6e05-2171-40c4-babb-ed4a8549e384 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:43.687353 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f6e05-2171-40c4-babb-ed4a8549e384 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:43.688148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f6e05-2171-40c4-babb-ed4a8549e384 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:43.688457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f6e05-2171-40c4-babb-ed4a8549e384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:43.689950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f6e05-2171-40c4-babb-ed4a8549e384 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:43.691846 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:43.710000 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 122/251] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:14:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:43.718831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f6e05-2171-40c4-babb-ed4a8549e384 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:43.738037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 130/252] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:43.774889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b5d23-f634-41a8-b53c-b2484de13403 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:43.888654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f6e05-2171-40c4-babb-ed4a8549e384 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:43.956157 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb481b-e67f-4110-b6c0-d82254935612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:43.958263 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb481b-e67f-4110-b6c0-d82254935612 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:43.958864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb481b-e67f-4110-b6c0-d82254935612 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:43.960027 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb481b-e67f-4110-b6c0-d82254935612 None admin] PATH_INFO: `/v3/users/7f4c715065904cfa9ee57d8e197dd7df` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:43.964540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb481b-e67f-4110-b6c0-d82254935612 None admin] RBAC: Authorizing `identity:get_user(user_id=7f4c715065904cfa9ee57d8e197dd7df)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:43.964540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb481b-e67f-4110-b6c0-d82254935612 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:43.964949 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 123/253] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:43 2022] GET /identity/v3/users/7f4c715065904cfa9ee57d8e197dd7df => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:43.970362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:43.970500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb481b-e67f-4110-b6c0-d82254935612 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:43.979302 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b5d23-f634-41a8-b53c-b2484de13403 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:44.054110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c593ce8-7719-4204-bb67-eaa05c8b7ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:44.055333 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c593ce8-7719-4204-bb67-eaa05c8b7ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:44.055901 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c593ce8-7719-4204-bb67-eaa05c8b7ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:44.056358 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c593ce8-7719-4204-bb67-eaa05c8b7ad5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:44.084945 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:44.086477 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c593ce8-7719-4204-bb67-eaa05c8b7ad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:44.095132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-8c593ce8-7719-4204-bb67-eaa05c8b7ad5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:44.095132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:44.095132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:44.095132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:44.095132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:44.095132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:44.095132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:44.095132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:44.095132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:44.095132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:44.095132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:44.095132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:44.095132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:44.095132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:44.095132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:44.095132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:44.096019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:44.096019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:44.096019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:44.096019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:44.096019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:44.096019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:44.096019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:44.096019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:44.096019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:44.096019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:44.096019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:44.096019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:44.096019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:44.096019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:44.096019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:44.096019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:44.096820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:44.096820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:44.096820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:44.096820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:44.096820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:44.096820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:44.096820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:44.096820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:44.096820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:44.096820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:44.096820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:44.096820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:44.107176 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 131/254] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:44.113070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c593ce8-7719-4204-bb67-eaa05c8b7ad5 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:44.145343 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb481b-e67f-4110-b6c0-d82254935612 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:44.189815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f7a56-94e5-4d49-89a9-03ec590f0dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:44.190476 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f7a56-94e5-4d49-89a9-03ec590f0dbe None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:44.190753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f7a56-94e5-4d49-89a9-03ec590f0dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:44.191023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f7a56-94e5-4d49-89a9-03ec590f0dbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:44.286886 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c593ce8-7719-4204-bb67-eaa05c8b7ad5 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:44.291688 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f7a56-94e5-4d49-89a9-03ec590f0dbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:44.293208 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f7a56-94e5-4d49-89a9-03ec590f0dbe None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:44.345295 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620ac1a-73fb-4ecb-99f6-9a2284c3380d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:44.346077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ac1a-73fb-4ecb-99f6-9a2284c3380d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:44.346407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ac1a-73fb-4ecb-99f6-9a2284c3380d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:44.346683 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ac1a-73fb-4ecb-99f6-9a2284c3380d None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:44.347448 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620ac1a-73fb-4ecb-99f6-9a2284c3380d None admin] RBAC: Adding query filter params (name=member) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:44.348084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620ac1a-73fb-4ecb-99f6-9a2284c3380d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:44.349522 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620ac1a-73fb-4ecb-99f6-9a2284c3380d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:44.370835 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 132/255] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:44.372188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7edd0-8c9d-45ca-9fb8-9f78b96202db None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:44.372477 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7edd0-8c9d-45ca-9fb8-9f78b96202db None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:44.372806 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7edd0-8c9d-45ca-9fb8-9f78b96202db None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:44.373354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:44.374091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 133/256] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:44.379562 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7edd0-8c9d-45ca-9fb8-9f78b96202db None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:44.415889 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 124/257] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 03:14:44.417470 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e259ed5-43e6-4911-b6aa-fa083d095cb6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:44.417805 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e259ed5-43e6-4911-b6aa-fa083d095cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:44.418157 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e259ed5-43e6-4911-b6aa-fa083d095cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:44.428548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:44.436950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4e259ed5-43e6-4911-b6aa-fa083d095cb6 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:44.438241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4e259ed5-43e6-4911-b6aa-fa083d095cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:44.512657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 125/258] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:44.513574 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e259ed5-43e6-4911-b6aa-fa083d095cb6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:44.586352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7edd0-8c9d-45ca-9fb8-9f78b96202db None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:44.645860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdd8db-6506-4c8d-a661-221a012ea404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:44.651527 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdd8db-6506-4c8d-a661-221a012ea404 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:44.652096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdd8db-6506-4c8d-a661-221a012ea404 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:44.652559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdd8db-6506-4c8d-a661-221a012ea404 None admin] PATH_INFO: `/v3/users/ece10ebdd1ae478aaac5f23c7dddda76` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:44.654107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdd8db-6506-4c8d-a661-221a012ea404 None admin] RBAC: Authorizing `identity:get_user(user_id=ece10ebdd1ae478aaac5f23c7dddda76)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:44.656217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdd8db-6506-4c8d-a661-221a012ea404 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:44.659348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 134/259] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:44 2022] GET /identity/v3/users/ece10ebdd1ae478aaac5f23c7dddda76 => generated 297 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:44.661271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdd8db-6506-4c8d-a661-221a012ea404 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:44.707978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:44.719099 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e259ed5-43e6-4911-b6aa-fa083d095cb6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:44.783441 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e57e7a-906f-404d-968f-d22c97be8d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:44.784317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e57e7a-906f-404d-968f-d22c97be8d5c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:44.784655 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e57e7a-906f-404d-968f-d22c97be8d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:44.784892 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e57e7a-906f-404d-968f-d22c97be8d5c None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:44.786737 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e57e7a-906f-404d-968f-d22c97be8d5c None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:44.788206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e57e7a-906f-404d-968f-d22c97be8d5c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:44.789968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 126/260] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:44 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:44.795586 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e57e7a-906f-404d-968f-d22c97be8d5c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:44.819132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:44.842303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdd8db-6506-4c8d-a661-221a012ea404 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:44.903474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23445b39-e5a1-454d-afde-74dc65c6a6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:44.904282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23445b39-e5a1-454d-afde-74dc65c6a6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:44.904672 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23445b39-e5a1-454d-afde-74dc65c6a6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:44.904950 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23445b39-e5a1-454d-afde-74dc65c6a6f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:44.926290 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23445b39-e5a1-454d-afde-74dc65c6a6f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:44.933946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-23445b39-e5a1-454d-afde-74dc65c6a6f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:44.933946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:44.933946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:44.933946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:44.933946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:44.933946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:44.933946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:44.933946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:44.933946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:44.933946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:44.933946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:44.933946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:44.933946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:44.933946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:44.933946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:44.933946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:44.934777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:44.934777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:44.934777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:44.934777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:44.934777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:44.934777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:44.934777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:44.934777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:44.934777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:44.934777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:44.934777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:44.934777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:44.934777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:44.934777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:44.934777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:44.934777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:44.935617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:44.935617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:44.935617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:44.935617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:44.935617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:44.935617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:44.935617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:44.935617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:44.935617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:44.935617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:44.935617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:44.935617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:44.935617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 135/261] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:14:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:44.936285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23445b39-e5a1-454d-afde-74dc65c6a6f8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:44.972075 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e57e7a-906f-404d-968f-d22c97be8d5c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:45.033979 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee42af-191e-4ade-b407-928dd6df437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:45.034870 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee42af-191e-4ade-b407-928dd6df437d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:45.035152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee42af-191e-4ade-b407-928dd6df437d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:45.035420 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee42af-191e-4ade-b407-928dd6df437d None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:45.036751 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee42af-191e-4ade-b407-928dd6df437d None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:45.038217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee42af-191e-4ade-b407-928dd6df437d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:45.039950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 127/262] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:44 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:45.042146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee42af-191e-4ade-b407-928dd6df437d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:45.081245 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:45.152096 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee42af-191e-4ade-b407-928dd6df437d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:45.177416 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23445b39-e5a1-454d-afde-74dc65c6a6f8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:45.193214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f60ac-a7eb-4f9f-a243-a1aea3eb18ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:45.194249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f60ac-a7eb-4f9f-a243-a1aea3eb18ec None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:45.195473 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f60ac-a7eb-4f9f-a243-a1aea3eb18ec None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:45.196611 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f60ac-a7eb-4f9f-a243-a1aea3eb18ec None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:45.197600 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f60ac-a7eb-4f9f-a243-a1aea3eb18ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:45.198255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f60ac-a7eb-4f9f-a243-a1aea3eb18ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:45.201239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f60ac-a7eb-4f9f-a243-a1aea3eb18ec None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:45.214107 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 128/263] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:45.218190 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f60ac-a7eb-4f9f-a243-a1aea3eb18ec None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:45.245462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c7168-7c71-4e24-b3b1-2aceb988c155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:45.247085 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c7168-7c71-4e24-b3b1-2aceb988c155 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:45.247857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c7168-7c71-4e24-b3b1-2aceb988c155 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:45.249048 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c7168-7c71-4e24-b3b1-2aceb988c155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:45.253575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c7168-7c71-4e24-b3b1-2aceb988c155 None admin] RBAC: Adding query filter params (role.id=690fc625fea1445fa7e0e8f40ae2246c, scope.project.id=62c99d0f651845d884f137c894087eb1, user.id=7f4c715065904cfa9ee57d8e197dd7df) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:45.254455 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c7168-7c71-4e24-b3b1-2aceb988c155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:45.258689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c7168-7c71-4e24-b3b1-2aceb988c155 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:45.279403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 136/264] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:44 2022] GET /identity/v3/role_assignments?user.id=7f4c715065904cfa9ee57d8e197dd7df&scope.project.id=62c99d0f651845d884f137c894087eb1&role.id=690fc625fea1445fa7e0e8f40ae2246c => generated 608 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:45.280653 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c7168-7c71-4e24-b3b1-2aceb988c155 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:45.327119 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:45.386295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:45.397797 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f60ac-a7eb-4f9f-a243-a1aea3eb18ec None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:45.444429 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c7168-7c71-4e24-b3b1-2aceb988c155 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:45.456884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54677863-ad83-44cb-b22b-e685d79882c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:45.457805 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54677863-ad83-44cb-b22b-e685d79882c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:45.458172 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54677863-ad83-44cb-b22b-e685d79882c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:45.458443 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54677863-ad83-44cb-b22b-e685d79882c5 None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1/users/ece10ebdd1ae478aaac5f23c7dddda76/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:45.460552 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54677863-ad83-44cb-b22b-e685d79882c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=62c99d0f651845d884f137c894087eb1, user_id=ece10ebdd1ae478aaac5f23c7dddda76, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:45.462184 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54677863-ad83-44cb-b22b-e685d79882c5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:45.480748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aca51c-4542-48ce-a29b-af922be10f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:45.481670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aca51c-4542-48ce-a29b-af922be10f1c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:45.481949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aca51c-4542-48ce-a29b-af922be10f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:45.482218 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aca51c-4542-48ce-a29b-af922be10f1c None admin] PATH_INFO: `/v3/users/7f4c715065904cfa9ee57d8e197dd7df` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:45.483611 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aca51c-4542-48ce-a29b-af922be10f1c None admin] RBAC: Authorizing `identity:get_user(user_id=7f4c715065904cfa9ee57d8e197dd7df)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:45.485113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aca51c-4542-48ce-a29b-af922be10f1c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:45.487164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 137/265] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:45 2022] GET /identity/v3/users/7f4c715065904cfa9ee57d8e197dd7df => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:45.495913 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 129/266] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:14:45 2022] PUT /identity/v3/projects/62c99d0f651845d884f137c894087eb1/users/ece10ebdd1ae478aaac5f23c7dddda76/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:14:45.498988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aca51c-4542-48ce-a29b-af922be10f1c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:45.593740 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:45.617043 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aca51c-4542-48ce-a29b-af922be10f1c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:45.655703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea85198-ebfb-4aa0-a3a6-347a21d87773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:45.656388 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea85198-ebfb-4aa0-a3a6-347a21d87773 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:45.656745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea85198-ebfb-4aa0-a3a6-347a21d87773 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:45.657025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea85198-ebfb-4aa0-a3a6-347a21d87773 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:45.689351 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b740e2-2e67-4a53-b557-8706d0dc529c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:45.690011 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b740e2-2e67-4a53-b557-8706d0dc529c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:45.690505 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b740e2-2e67-4a53-b557-8706d0dc529c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:45.692623 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 130/267] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:45.706541 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752294a-2de2-4bcd-8a1a-133ca9d9af49 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:45.707061 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752294a-2de2-4bcd-8a1a-133ca9d9af49 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:45.707549 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752294a-2de2-4bcd-8a1a-133ca9d9af49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:45.736548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea85198-ebfb-4aa0-a3a6-347a21d87773 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:45.736548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea85198-ebfb-4aa0-a3a6-347a21d87773 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:45.745773 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2752294a-2de2-4bcd-8a1a-133ca9d9af49 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:45.752900 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2752294a-2de2-4bcd-8a1a-133ca9d9af49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:45.821419 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:45.843860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 138/268] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:45.849572 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea85198-ebfb-4aa0-a3a6-347a21d87773 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:45.850946 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 131/269] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:45.889337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752294a-2de2-4bcd-8a1a-133ca9d9af49 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:45.954317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea85198-ebfb-4aa0-a3a6-347a21d87773 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:45.993684 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd561ac-238a-4270-ac2a-a52837c2bab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:45.994670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd561ac-238a-4270-ac2a-a52837c2bab2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:45.994953 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd561ac-238a-4270-ac2a-a52837c2bab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:45.995328 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd561ac-238a-4270-ac2a-a52837c2bab2 None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:45.996545 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd561ac-238a-4270-ac2a-a52837c2bab2 None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:45.998038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd561ac-238a-4270-ac2a-a52837c2bab2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:46.001008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 139/270] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:45 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:46.017809 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd561ac-238a-4270-ac2a-a52837c2bab2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:46.028357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:46.061113 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752294a-2de2-4bcd-8a1a-133ca9d9af49 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:46.101287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716510f8-7257-43d0-ab96-30f2120ef13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:46.102144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716510f8-7257-43d0-ab96-30f2120ef13f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:46.102422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716510f8-7257-43d0-ab96-30f2120ef13f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:46.102691 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716510f8-7257-43d0-ab96-30f2120ef13f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:46.115622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:46.123488 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716510f8-7257-43d0-ab96-30f2120ef13f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:46.133043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-716510f8-7257-43d0-ab96-30f2120ef13f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:46.133043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:46.133043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:46.133043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:46.133043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:46.133043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:46.133043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:46.133043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:46.133043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:46.133043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:46.133043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:46.133043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:46.133043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:46.133043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:46.133043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:46.133043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:46.133964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:46.133964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:46.133964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:46.133964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:46.133964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:46.133964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:46.133964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:46.133964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:46.133964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:46.133964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:46.133964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:46.133964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:46.133964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:46.133964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:46.133964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:46.133964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:46.134731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:46.134731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:46.134731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:46.134731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:46.134731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:46.134731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:46.134731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:46.134731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:46.134731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:46.134731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:46.134731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:46.134731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:46.134731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 132/271] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:46.145519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716510f8-7257-43d0-ab96-30f2120ef13f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:46.208319 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd561ac-238a-4270-ac2a-a52837c2bab2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:46.260785 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716510f8-7257-43d0-ab96-30f2120ef13f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:46.261446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42a374-6b12-467c-ad3d-fc8139ff60fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:46.262130 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42a374-6b12-467c-ad3d-fc8139ff60fa None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:46.262406 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42a374-6b12-467c-ad3d-fc8139ff60fa None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:46.262675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42a374-6b12-467c-ad3d-fc8139ff60fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:46.263508 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42a374-6b12-467c-ad3d-fc8139ff60fa None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=62c99d0f651845d884f137c894087eb1, user.id=7f4c715065904cfa9ee57d8e197dd7df) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:46.264028 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42a374-6b12-467c-ad3d-fc8139ff60fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:46.265402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42a374-6b12-467c-ad3d-fc8139ff60fa None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:46.271985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 140/272] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:46 2022] GET /identity/v3/role_assignments?user.id=7f4c715065904cfa9ee57d8e197dd7df&scope.project.id=62c99d0f651845d884f137c894087eb1&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:46.273531 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0746c-e7a3-4b4a-8b6b-6ec05dafa4d1 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:46.273811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0746c-e7a3-4b4a-8b6b-6ec05dafa4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:46.274078 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0746c-e7a3-4b4a-8b6b-6ec05dafa4d1 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:46.275325 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 141/273] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:46.281306 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada496ed-2b23-4a09-b63a-88c29b741dc0 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:46.281589 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada496ed-2b23-4a09-b63a-88c29b741dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:46.281862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada496ed-2b23-4a09-b63a-88c29b741dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:46.316592 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ada496ed-2b23-4a09-b63a-88c29b741dc0 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:46.319819 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ada496ed-2b23-4a09-b63a-88c29b741dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:46.344977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd3c8c-db2f-4656-bd07-475fef3105b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:46.345682 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd3c8c-db2f-4656-bd07-475fef3105b1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:46.345959 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd3c8c-db2f-4656-bd07-475fef3105b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:46.346229 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd3c8c-db2f-4656-bd07-475fef3105b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:46.347016 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd3c8c-db2f-4656-bd07-475fef3105b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:46.347318 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd3c8c-db2f-4656-bd07-475fef3105b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:46.349164 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd3c8c-db2f-4656-bd07-475fef3105b1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:46.371063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 133/274] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:46.374795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd3c8c-db2f-4656-bd07-475fef3105b1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:46.383520 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:46.441282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 142/275] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:46.447989 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6293e5-bc25-4990-a5f8-ecfcf25c97b5 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:46.448783 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6293e5-bc25-4990-a5f8-ecfcf25c97b5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:46.448783 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6293e5-bc25-4990-a5f8-ecfcf25c97b5 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:46.450073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 143/276] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:14:46.461359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c3c7e-a54a-484c-bf8a-4a8302159ecd None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:46.461644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c3c7e-a54a-484c-bf8a-4a8302159ecd None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:46.461831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c3c7e-a54a-484c-bf8a-4a8302159ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:46.485931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e05c3c7e-a54a-484c-bf8a-4a8302159ecd None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:46.487246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e05c3c7e-a54a-484c-bf8a-4a8302159ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:46.523653 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd3c8c-db2f-4656-bd07-475fef3105b1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:46.533821 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:46.564605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868f631-cfc8-42ef-9e2f-9cfc948c1a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:46.566055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868f631-cfc8-42ef-9e2f-9cfc948c1a56 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:46.566333 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868f631-cfc8-42ef-9e2f-9cfc948c1a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:46.566633 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868f631-cfc8-42ef-9e2f-9cfc948c1a56 None admin] PATH_INFO: `/v3/users/8a504af69f394769b0e6c17fb3a24ded` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:46.570408 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 144/277] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:46.571346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c3c7e-a54a-484c-bf8a-4a8302159ecd None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:46.581350 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868f631-cfc8-42ef-9e2f-9cfc948c1a56 None admin] RBAC: Authorizing `identity:get_user(user_id=8a504af69f394769b0e6c17fb3a24ded)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:46.583004 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868f631-cfc8-42ef-9e2f-9cfc948c1a56 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:46.585994 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 134/278] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:46 2022] GET /identity/v3/users/8a504af69f394769b0e6c17fb3a24ded => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:46.594190 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868f631-cfc8-42ef-9e2f-9cfc948c1a56 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:46.656999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:46.690595 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c3c7e-a54a-484c-bf8a-4a8302159ecd None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:46.700856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868f631-cfc8-42ef-9e2f-9cfc948c1a56 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:46.729147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd64d2-048f-40e3-94b2-48545c1cae0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:46.729891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd64d2-048f-40e3-94b2-48545c1cae0a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:46.730167 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd64d2-048f-40e3-94b2-48545c1cae0a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:46.730438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd64d2-048f-40e3-94b2-48545c1cae0a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:46.736781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc57769-e69e-41c9-8fb5-c0fa5961e77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:46.737610 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc57769-e69e-41c9-8fb5-c0fa5961e77d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:46.737883 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc57769-e69e-41c9-8fb5-c0fa5961e77d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:46.738146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc57769-e69e-41c9-8fb5-c0fa5961e77d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:46.738979 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc57769-e69e-41c9-8fb5-c0fa5961e77d None admin] RBAC: Adding query filter params (role.id=713f175e9435403f9e39528c805bd956, user.id=8a504af69f394769b0e6c17fb3a24ded, scope.system=all) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:46.739283 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc57769-e69e-41c9-8fb5-c0fa5961e77d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:46.740761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc57769-e69e-41c9-8fb5-c0fa5961e77d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:46.741444 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd64d2-048f-40e3-94b2-48545c1cae0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:46.756553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 135/279] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Jul 12 03:14:46 2022] GET /identity/v3/role_assignments?user.id=8a504af69f394769b0e6c17fb3a24ded&scope.system=all&role.id=713f175e9435403f9e39528c805bd956 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:46.756553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc57769-e69e-41c9-8fb5-c0fa5961e77d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:46.756826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-19bd64d2-048f-40e3-94b2-48545c1cae0a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:46.756826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:46.756826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:46.756826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:46.756826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:46.756826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:46.756826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:46.756826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:46.756826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:46.756826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:46.756826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:46.756826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:46.756826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:46.756826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:46.756826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:46.756826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:46.757644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:46.757644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:46.757644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:46.757644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:46.757644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:46.757644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:46.757644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:46.757644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:46.757644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:46.757644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:46.757644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:46.757644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:46.757644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:46.757644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:46.757644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:46.757644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:46.758407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:46.758407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:46.758407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:46.758407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:46.758407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:46.758407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:46.758407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:46.758407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:46.758407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:46.758407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:46.758407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:46.758407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:46.758407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 145/280] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:46.758407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd64d2-048f-40e3-94b2-48545c1cae0a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:46.793668 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:46.881659 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd64d2-048f-40e3-94b2-48545c1cae0a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:46.892104 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc57769-e69e-41c9-8fb5-c0fa5961e77d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:46.918206 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47126df-5600-4321-801e-c6d5a4c59414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:46.918875 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47126df-5600-4321-801e-c6d5a4c59414 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:46.919149 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47126df-5600-4321-801e-c6d5a4c59414 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:46.919410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47126df-5600-4321-801e-c6d5a4c59414 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:46.920235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47126df-5600-4321-801e-c6d5a4c59414 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:46.920513 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47126df-5600-4321-801e-c6d5a4c59414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:46.922134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47126df-5600-4321-801e-c6d5a4c59414 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:46.925410 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:46.938587 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 146/281] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:46.938783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66809e-e4c5-4ff4-898a-b539fb14319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:46.938783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66809e-e4c5-4ff4-898a-b539fb14319a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:46.938783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66809e-e4c5-4ff4-898a-b539fb14319a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:46.938783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66809e-e4c5-4ff4-898a-b539fb14319a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:46.939072 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47126df-5600-4321-801e-c6d5a4c59414 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:46.939349 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66809e-e4c5-4ff4-898a-b539fb14319a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:46.940712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66809e-e4c5-4ff4-898a-b539fb14319a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:46.942543 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 136/282] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:14:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:46.947571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66809e-e4c5-4ff4-898a-b539fb14319a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:47.060243 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66809e-e4c5-4ff4-898a-b539fb14319a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:47.069788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:47.081222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47126df-5600-4321-801e-c6d5a4c59414 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:47.099265 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26985a98-79d4-4d04-b588-006b5cc2404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:47.100359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985a98-79d4-4d04-b588-006b5cc2404b None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:47.100866 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985a98-79d4-4d04-b588-006b5cc2404b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:47.101337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985a98-79d4-4d04-b588-006b5cc2404b None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:47.102245 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26985a98-79d4-4d04-b588-006b5cc2404b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:47.103929 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26985a98-79d4-4d04-b588-006b5cc2404b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:47.125645 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2133ca-fbd5-4d75-aae3-ff6e4f195506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:47.127310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2133ca-fbd5-4d75-aae3-ff6e4f195506 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:47.127771 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2133ca-fbd5-4d75-aae3-ff6e4f195506 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:47.128217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2133ca-fbd5-4d75-aae3-ff6e4f195506 None admin] PATH_INFO: `/v3/users/e99d18299515400885dd9e2af13fd4cf` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:47.129768 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2133ca-fbd5-4d75-aae3-ff6e4f195506 None admin] RBAC: Authorizing `identity:get_user(user_id=e99d18299515400885dd9e2af13fd4cf)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:47.130024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 137/283] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:14:46 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:14:47.131701 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2133ca-fbd5-4d75-aae3-ff6e4f195506 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:47.133652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 147/284] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:46 2022] GET /identity/v3/users/e99d18299515400885dd9e2af13fd4cf => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:47.140576 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26985a98-79d4-4d04-b588-006b5cc2404b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:47.209278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:47.275077 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26985a98-79d4-4d04-b588-006b5cc2404b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:47.315450 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5613a-0992-4859-933e-1dd1382a895d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:47.316336 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5613a-0992-4859-933e-1dd1382a895d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:47.316641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5613a-0992-4859-933e-1dd1382a895d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:47.316915 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5613a-0992-4859-933e-1dd1382a895d None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:47.318492 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5613a-0992-4859-933e-1dd1382a895d None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:47.320050 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5613a-0992-4859-933e-1dd1382a895d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:47.322277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 138/285] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:47 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:47.329097 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2133ca-fbd5-4d75-aae3-ff6e4f195506 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:47.438271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2133ca-fbd5-4d75-aae3-ff6e4f195506 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:47.474371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31022c0f-5027-4c41-b4c3-835f9f8528b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:47.475274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31022c0f-5027-4c41-b4c3-835f9f8528b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:47.475557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31022c0f-5027-4c41-b4c3-835f9f8528b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:47.475827 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31022c0f-5027-4c41-b4c3-835f9f8528b6 None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1/users/e99d18299515400885dd9e2af13fd4cf/roles/a96cd51936d549a3986a0e7e1f50f040` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:47.477811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31022c0f-5027-4c41-b4c3-835f9f8528b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=62c99d0f651845d884f137c894087eb1, user_id=e99d18299515400885dd9e2af13fd4cf, role_id=a96cd51936d549a3986a0e7e1f50f040)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:47.479257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31022c0f-5027-4c41-b4c3-835f9f8528b6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:47.500210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 148/286] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:14:47 2022] PUT /identity/v3/projects/62c99d0f651845d884f137c894087eb1/users/e99d18299515400885dd9e2af13fd4cf/roles/a96cd51936d549a3986a0e7e1f50f040 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:14:47.907914 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd95731-dc5d-452f-b1ff-a13e3bfa7fbe None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:47.908197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd95731-dc5d-452f-b1ff-a13e3bfa7fbe None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:47.908472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd95731-dc5d-452f-b1ff-a13e3bfa7fbe None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:47.910026 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 139/287] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:47.915500 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abfa3d-68fe-4b65-98ea-813aa87c6800 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:47.915782 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abfa3d-68fe-4b65-98ea-813aa87c6800 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:47.916051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abfa3d-68fe-4b65-98ea-813aa87c6800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:47.936305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c8abfa3d-68fe-4b65-98ea-813aa87c6800 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:47.937542 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c8abfa3d-68fe-4b65-98ea-813aa87c6800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:47.962583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:48.034106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 149/288] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:48.068586 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd95731-dc5d-452f-b1ff-a13e3bfa7fbe None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:48.210277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd95731-dc5d-452f-b1ff-a13e3bfa7fbe None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:48.234711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:48.260623 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b391a-f9a0-45bc-a0f3-e64fef461b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:48.261435 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b391a-f9a0-45bc-a0f3-e64fef461b10 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:48.261716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b391a-f9a0-45bc-a0f3-e64fef461b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:48.261995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b391a-f9a0-45bc-a0f3-e64fef461b10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:48.279421 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b391a-f9a0-45bc-a0f3-e64fef461b10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:48.287853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-0f8b391a-f9a0-45bc-a0f3-e64fef461b10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:48.287853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:48.287853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:48.287853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:48.287853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:48.287853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:48.287853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:48.287853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:48.287853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:48.287853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:48.287853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:48.287853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:48.287853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:48.287853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:48.287853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:48.287853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:48.288716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:48.288716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:48.288716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:48.288716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:48.288716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:48.288716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:48.288716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:48.288716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:48.288716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:48.288716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:48.288716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:48.288716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:48.288716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:48.288716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:48.288716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:48.288716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:48.289483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:48.289483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:48.289483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:48.289483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:48.289483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:48.289483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:48.289483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:48.289483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:48.289483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:48.289483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:48.289483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:48.289483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:48.289483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 140/289] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:48.296614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abfa3d-68fe-4b65-98ea-813aa87c6800 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:48.449609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abfa3d-68fe-4b65-98ea-813aa87c6800 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:48.502913 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b017a15-9952-48c2-b69a-a9aab0955829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:48.504355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b017a15-9952-48c2-b69a-a9aab0955829 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:48.504846 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b017a15-9952-48c2-b69a-a9aab0955829 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:48.505330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b017a15-9952-48c2-b69a-a9aab0955829 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:48.506296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b017a15-9952-48c2-b69a-a9aab0955829 None admin] RBAC: Adding query filter params (name=member) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:48.506787 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b017a15-9952-48c2-b69a-a9aab0955829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:48.508345 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b017a15-9952-48c2-b69a-a9aab0955829 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:48.523696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 150/290] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:48.529453 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b391a-f9a0-45bc-a0f3-e64fef461b10 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:48.699349 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b391a-f9a0-45bc-a0f3-e64fef461b10 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:48.742213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bba40b-0332-4ab4-9205-3d0409de03c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:48.743141 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba40b-0332-4ab4-9205-3d0409de03c3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:48.743422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba40b-0332-4ab4-9205-3d0409de03c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:48.743740 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba40b-0332-4ab4-9205-3d0409de03c3 None admin] PATH_INFO: `/v3/users/ece10ebdd1ae478aaac5f23c7dddda76` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:48.745002 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bba40b-0332-4ab4-9205-3d0409de03c3 None admin] RBAC: Authorizing `identity:get_user(user_id=ece10ebdd1ae478aaac5f23c7dddda76)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:48.746511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bba40b-0332-4ab4-9205-3d0409de03c3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:48.748759 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 141/291] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:48 2022] GET /identity/v3/users/ece10ebdd1ae478aaac5f23c7dddda76 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:48.754035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b017a15-9952-48c2-b69a-a9aab0955829 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:48.784820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:48.910293 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b017a15-9952-48c2-b69a-a9aab0955829 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:48.948195 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a0d50-5167-499e-86d9-6a5289ca002f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:48.948546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a0d50-5167-499e-86d9-6a5289ca002f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:48.948776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a0d50-5167-499e-86d9-6a5289ca002f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:48.950407 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 142/292] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:48.955547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619c34-5661-4ac1-959e-640c3265fdf5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:48.955828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619c34-5661-4ac1-959e-640c3265fdf5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:48.956097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619c34-5661-4ac1-959e-640c3265fdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:48.961336 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8403e-299d-4c01-b67a-54049a87a667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:48.962126 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8403e-299d-4c01-b67a-54049a87a667 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:48.962413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8403e-299d-4c01-b67a-54049a87a667 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:48.962694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8403e-299d-4c01-b67a-54049a87a667 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:48.981563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ec619c34-5661-4ac1-959e-640c3265fdf5 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:48.982980 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ec619c34-5661-4ac1-959e-640c3265fdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:49.040365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8403e-299d-4c01-b67a-54049a87a667 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:49.041826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8403e-299d-4c01-b67a-54049a87a667 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:49.058104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:49.071463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:49.150243 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 143/293] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:49.151741 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 151/294] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:49.157719 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec619c34-5661-4ac1-959e-640c3265fdf5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:49.178365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8403e-299d-4c01-b67a-54049a87a667 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:49.331510 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8403e-299d-4c01-b67a-54049a87a667 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:49.353695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec619c34-5661-4ac1-959e-640c3265fdf5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:49.360898 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:49.380425 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26d607-b1d0-46e9-af89-144f696435f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:49.381276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26d607-b1d0-46e9-af89-144f696435f8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:49.381562 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26d607-b1d0-46e9-af89-144f696435f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:49.381837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26d607-b1d0-46e9-af89-144f696435f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:49.405590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab1a6f-ae0f-4e24-a762-08aa5ac1fc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:49.406462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab1a6f-ae0f-4e24-a762-08aa5ac1fc47 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:49.406733 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab1a6f-ae0f-4e24-a762-08aa5ac1fc47 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:49.406997 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab1a6f-ae0f-4e24-a762-08aa5ac1fc47 None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:49.408180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab1a6f-ae0f-4e24-a762-08aa5ac1fc47 None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:49.409666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab1a6f-ae0f-4e24-a762-08aa5ac1fc47 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:49.411556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 144/295] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:49 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:49.412733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26d607-b1d0-46e9-af89-144f696435f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:49.417537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab1a6f-ae0f-4e24-a762-08aa5ac1fc47 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:49.421074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-ec26d607-b1d0-46e9-af89-144f696435f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:49.421074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:49.421074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:49.421074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:49.421074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:49.421074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:49.421074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:49.421074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:49.421074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:49.421074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:49.421074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:49.421074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:49.421074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:49.421074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:49.421074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:49.421074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:49.421944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:49.421944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:49.421944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:49.421944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:49.421944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:49.421944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:49.421944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:49.421944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:49.421944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:49.421944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:49.421944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:49.421944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:49.421944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:49.421944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:49.421944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:49.421944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:49.422696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:49.422696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:49.422696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:49.422696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:49.422696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:49.422696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:49.422696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:49.422696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:49.422696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:49.422696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:49.422696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:49.422696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:49.422696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 152/296] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:14:49.433642 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26d607-b1d0-46e9-af89-144f696435f8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:49.466000 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:49.550431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab1a6f-ae0f-4e24-a762-08aa5ac1fc47 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:49.588680 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc6f37-a4ba-4a64-a54c-d25ee25e47cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:49.589263 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc6f37-a4ba-4a64-a54c-d25ee25e47cd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:49.589542 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc6f37-a4ba-4a64-a54c-d25ee25e47cd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:49.589813 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc6f37-a4ba-4a64-a54c-d25ee25e47cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:49.590658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc6f37-a4ba-4a64-a54c-d25ee25e47cd None admin] RBAC: Adding query filter params (role.id=713f175e9435403f9e39528c805bd956, scope.project.id=62c99d0f651845d884f137c894087eb1, user.id=ece10ebdd1ae478aaac5f23c7dddda76) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:49.590967 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc6f37-a4ba-4a64-a54c-d25ee25e47cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:49.592512 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc6f37-a4ba-4a64-a54c-d25ee25e47cd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:49.599899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 145/297] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:49 2022] GET /identity/v3/role_assignments?user.id=ece10ebdd1ae478aaac5f23c7dddda76&scope.project.id=62c99d0f651845d884f137c894087eb1&role.id=713f175e9435403f9e39528c805bd956 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:49.611279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26d607-b1d0-46e9-af89-144f696435f8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:49.650000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9f3f7-fd63-4c3d-8292-4da00c8bba9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:49.650687 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9f3f7-fd63-4c3d-8292-4da00c8bba9d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:49.650966 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9f3f7-fd63-4c3d-8292-4da00c8bba9d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:49.651239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9f3f7-fd63-4c3d-8292-4da00c8bba9d None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:49.652071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9f3f7-fd63-4c3d-8292-4da00c8bba9d None admin] RBAC: Adding query filter params (name=member) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:49.652381 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9f3f7-fd63-4c3d-8292-4da00c8bba9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:49.653883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9f3f7-fd63-4c3d-8292-4da00c8bba9d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:49.665137 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 153/298] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:49.671405 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc6f37-a4ba-4a64-a54c-d25ee25e47cd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:49.793694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e28935-3480-430a-8717-3501fcfe5b96 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:49.794027 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e28935-3480-430a-8717-3501fcfe5b96 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:49.794275 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e28935-3480-430a-8717-3501fcfe5b96 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:49.795984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 154/299] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:14:49.801395 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef62ca9-d340-4e5b-ad9a-adedd8609b3f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:49.801682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef62ca9-d340-4e5b-ad9a-adedd8609b3f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:49.801947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef62ca9-d340-4e5b-ad9a-adedd8609b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:49.812023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc6f37-a4ba-4a64-a54c-d25ee25e47cd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:49.825962 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-0ef62ca9-d340-4e5b-ad9a-adedd8609b3f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:49.827404 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0ef62ca9-d340-4e5b-ad9a-adedd8609b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:49.832555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:49.875160 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:49.885370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da3465-f0ee-4d2e-9e26-c99422907077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:49.886292 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da3465-f0ee-4d2e-9e26-c99422907077 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:49.886576 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da3465-f0ee-4d2e-9e26-c99422907077 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:49.886850 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da3465-f0ee-4d2e-9e26-c99422907077 None admin] PATH_INFO: `/v3/users/8a504af69f394769b0e6c17fb3a24ded` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:49.889466 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da3465-f0ee-4d2e-9e26-c99422907077 None admin] RBAC: Authorizing `identity:get_user(user_id=8a504af69f394769b0e6c17fb3a24ded)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:49.891062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da3465-f0ee-4d2e-9e26-c99422907077 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:49.893011 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 146/300] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:49 2022] GET /identity/v3/users/8a504af69f394769b0e6c17fb3a24ded => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:49.905873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da3465-f0ee-4d2e-9e26-c99422907077 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:49.931918 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 155/301] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:49.964669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef62ca9-d340-4e5b-ad9a-adedd8609b3f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:50.039981 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da3465-f0ee-4d2e-9e26-c99422907077 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:50.081740 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43523925-d4c1-4904-9cd4-e9f955e6c691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:50.083014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43523925-d4c1-4904-9cd4-e9f955e6c691 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:50.083483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43523925-d4c1-4904-9cd4-e9f955e6c691 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:50.083942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43523925-d4c1-4904-9cd4-e9f955e6c691 None admin] PATH_INFO: `/v3/system/users/8a504af69f394769b0e6c17fb3a24ded/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:50.085657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43523925-d4c1-4904-9cd4-e9f955e6c691 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8a504af69f394769b0e6c17fb3a24ded, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:50.087240 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43523925-d4c1-4904-9cd4-e9f955e6c691 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:50.105989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 147/302] 10.222.0.26 () {58 vars in 1334 bytes} [Tue Jul 12 03:14:49 2022] PUT /identity/v3/system/users/8a504af69f394769b0e6c17fb3a24ded/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:14:50.107937 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef62ca9-d340-4e5b-ad9a-adedd8609b3f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:50.147477 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fe7ac-7027-4b6e-a289-55800ce6feb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:50.148212 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fe7ac-7027-4b6e-a289-55800ce6feb0 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:50.148577 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fe7ac-7027-4b6e-a289-55800ce6feb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:50.148851 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fe7ac-7027-4b6e-a289-55800ce6feb0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:50.153662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbc514-6528-4ba8-bd7c-6369f5ebb1e3 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:50.154628 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbc514-6528-4ba8-bd7c-6369f5ebb1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:50.154950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbc514-6528-4ba8-bd7c-6369f5ebb1e3 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:50.156797 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 148/303] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:14:50.162743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5966f-737f-4bba-9ab7-b11e1a10b961 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:50.163030 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5966f-737f-4bba-9ab7-b11e1a10b961 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:50.163300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5966f-737f-4bba-9ab7-b11e1a10b961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:50.164823 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fe7ac-7027-4b6e-a289-55800ce6feb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:50.174155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-257fe7ac-7027-4b6e-a289-55800ce6feb0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:50.174155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:50.174155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:50.174155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:50.174155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:50.174155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:50.174155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:50.174155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:50.174155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:50.174155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:50.174155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:50.174155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:50.174155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:50.174155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:50.174155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:50.174155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:50.175133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:50.175133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:50.175133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:50.175133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:50.175133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:50.175133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:50.175133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:50.175133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:50.175133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:50.175133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:50.175133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:50.175133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:50.175133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:50.175133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:50.175133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:50.175133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:50.175899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:50.175899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:50.175899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:50.175899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:50.175899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:50.175899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:50.175899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:50.175899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:50.175899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:50.175899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:50.175899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:50.175899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:50.178347 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 156/304] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:14:50.184333 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fe7ac-7027-4b6e-a289-55800ce6feb0 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:50.184574 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7ca5966f-737f-4bba-9ab7-b11e1a10b961 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:50.186739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7ca5966f-737f-4bba-9ab7-b11e1a10b961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:50.218838 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:50.235822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:50.273880 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 149/305] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:50.275072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7895f7-ae19-4478-a3b9-925359fde27c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:50.275355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7895f7-ae19-4478-a3b9-925359fde27c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:50.275636 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7895f7-ae19-4478-a3b9-925359fde27c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:50.277062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 150/306] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:50.282635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4852c3-b654-412f-bedf-d154db187d5d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:50.282921 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4852c3-b654-412f-bedf-d154db187d5d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:50.283185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4852c3-b654-412f-bedf-d154db187d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:50.301884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6a4852c3-b654-412f-bedf-d154db187d5d None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:50.303086 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6a4852c3-b654-412f-bedf-d154db187d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:50.308921 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fe7ac-7027-4b6e-a289-55800ce6feb0 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:50.345981 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e205007-beee-4ab3-b01f-165b503b9263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:50.346653 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e205007-beee-4ab3-b01f-165b503b9263 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:50.346928 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e205007-beee-4ab3-b01f-165b503b9263 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:50.347192 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e205007-beee-4ab3-b01f-165b503b9263 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:50.348285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e205007-beee-4ab3-b01f-165b503b9263 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:50.348607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e205007-beee-4ab3-b01f-165b503b9263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:50.349988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e205007-beee-4ab3-b01f-165b503b9263 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:50.360659 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 157/307] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:50.362395 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e205007-beee-4ab3-b01f-165b503b9263 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:50.381492 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 151/308] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:50.383240 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4852c3-b654-412f-bedf-d154db187d5d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:50.454275 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:50.470414 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e205007-beee-4ab3-b01f-165b503b9263 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:50.497139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:50.500971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4852c3-b654-412f-bedf-d154db187d5d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:50.508943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf55077-390f-457b-acee-6a383a6a28df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:50.509748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf55077-390f-457b-acee-6a383a6a28df None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:50.510025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf55077-390f-457b-acee-6a383a6a28df None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:50.510291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf55077-390f-457b-acee-6a383a6a28df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:50.511849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf55077-390f-457b-acee-6a383a6a28df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:50.513719 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf55077-390f-457b-acee-6a383a6a28df None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:50.520246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 158/309] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:14:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:50.520246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf55077-390f-457b-acee-6a383a6a28df None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:50.543875 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a04178-db56-4811-a366-82b710ea706c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:50.544832 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a04178-db56-4811-a366-82b710ea706c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:50.545104 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a04178-db56-4811-a366-82b710ea706c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:50.545368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a04178-db56-4811-a366-82b710ea706c None admin] PATH_INFO: `/v3/users/ef84d4ebf8be49138c970f0579311fa6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:50.559077 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a04178-db56-4811-a366-82b710ea706c None admin] RBAC: Authorizing `identity:get_user(user_id=ef84d4ebf8be49138c970f0579311fa6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:50.560765 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a04178-db56-4811-a366-82b710ea706c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:50.567254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 152/310] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:50 2022] GET /identity/v3/users/ef84d4ebf8be49138c970f0579311fa6 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:50.567254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a04178-db56-4811-a366-82b710ea706c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:50.622452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf55077-390f-457b-acee-6a383a6a28df None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:50.657808 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c918345-6e54-4490-bd88-79fe81eade9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:50.658644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c918345-6e54-4490-bd88-79fe81eade9e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:50.658921 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c918345-6e54-4490-bd88-79fe81eade9e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:50.659191 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c918345-6e54-4490-bd88-79fe81eade9e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:50.670133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c918345-6e54-4490-bd88-79fe81eade9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:50.670403 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a04178-db56-4811-a366-82b710ea706c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:50.678095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7c918345-6e54-4490-bd88-79fe81eade9e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:50.678095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:50.678095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:50.678095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:50.678095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:50.678095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:50.678095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:50.678095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:50.678095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:50.678095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:50.678095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:50.678095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:50.678095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:50.678095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:50.678095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:50.678095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:50.678990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:50.678990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:50.678990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:50.678990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:50.678990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:50.678990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:50.678990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:50.678990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:50.678990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:50.678990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:50.678990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:50.678990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:50.678990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:50.678990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:50.678990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:50.678990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:50.679760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:50.679760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:50.679760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:50.679760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:50.679760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:50.679760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:50.679760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:50.679760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:50.679760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:50.679760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:50.679760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:50.679760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:50.684215 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 159/311] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:50.685312 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c918345-6e54-4490-bd88-79fe81eade9e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:50.709128 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:50.713806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d5849-6a52-4b3f-b020-7b483cc50fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:50.714531 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d5849-6a52-4b3f-b020-7b483cc50fa3 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:50.714806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d5849-6a52-4b3f-b020-7b483cc50fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:50.715075 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d5849-6a52-4b3f-b020-7b483cc50fa3 None admin] PATH_INFO: `/v3/groups` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:50.715760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d5849-6a52-4b3f-b020-7b483cc50fa3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:50.717664 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d5849-6a52-4b3f-b020-7b483cc50fa3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:50.733836 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 153/312] 10.222.0.26 () {60 vars in 1134 bytes} [Tue Jul 12 03:14:50 2022] POST /identity/v3/groups => generated 229 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:14:50.734888 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d5849-6a52-4b3f-b020-7b483cc50fa3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:50.762796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:50.834569 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c918345-6e54-4490-bd88-79fe81eade9e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:50.863347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d5849-6a52-4b3f-b020-7b483cc50fa3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:50.876234 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90473852-bdfb-493f-bad4-baeb8aa5de1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:50.877376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90473852-bdfb-493f-bad4-baeb8aa5de1d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:50.877855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90473852-bdfb-493f-bad4-baeb8aa5de1d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:50.878323 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90473852-bdfb-493f-bad4-baeb8aa5de1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:50.879379 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90473852-bdfb-493f-bad4-baeb8aa5de1d None admin] RBAC: Adding query filter params (role.id=a96cd51936d549a3986a0e7e1f50f040, user.id=ef84d4ebf8be49138c970f0579311fa6, scope.system=all) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:50.879918 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90473852-bdfb-493f-bad4-baeb8aa5de1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:50.881741 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90473852-bdfb-493f-bad4-baeb8aa5de1d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:50.888167 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 160/313] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Jul 12 03:14:50 2022] GET /identity/v3/role_assignments?user.id=ef84d4ebf8be49138c970f0579311fa6&scope.system=all&role.id=a96cd51936d549a3986a0e7e1f50f040 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:50.907241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb29fbe-f3aa-40cb-ab12-7e730a686bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:50.907934 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb29fbe-f3aa-40cb-ab12-7e730a686bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:50.908213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb29fbe-f3aa-40cb-ab12-7e730a686bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:50.908487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb29fbe-f3aa-40cb-ab12-7e730a686bc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:50.909319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb29fbe-f3aa-40cb-ab12-7e730a686bc0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:50.909619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb29fbe-f3aa-40cb-ab12-7e730a686bc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:50.911044 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb29fbe-f3aa-40cb-ab12-7e730a686bc0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:50.921116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 154/314] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:50.927035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90473852-bdfb-493f-bad4-baeb8aa5de1d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:51.026310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:51.049425 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90473852-bdfb-493f-bad4-baeb8aa5de1d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:51.084556 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a10f8-db50-4b6d-9873-59959442d159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:51.085453 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a10f8-db50-4b6d-9873-59959442d159 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:51.085727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a10f8-db50-4b6d-9873-59959442d159 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:51.085993 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a10f8-db50-4b6d-9873-59959442d159 None admin] PATH_INFO: `/v3/users/e99d18299515400885dd9e2af13fd4cf` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:51.087172 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a10f8-db50-4b6d-9873-59959442d159 None admin] RBAC: Authorizing `identity:get_user(user_id=e99d18299515400885dd9e2af13fd4cf)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:51.088658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a10f8-db50-4b6d-9873-59959442d159 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:51.090321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 161/315] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:50 2022] GET /identity/v3/users/e99d18299515400885dd9e2af13fd4cf => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:51.096288 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb29fbe-f3aa-40cb-ab12-7e730a686bc0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:51.182237 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:51.203652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb29fbe-f3aa-40cb-ab12-7e730a686bc0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:51.239462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f92835-165a-4419-b8f9-1339517facb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:51.240120 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f92835-165a-4419-b8f9-1339517facb4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:51.240395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f92835-165a-4419-b8f9-1339517facb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:51.240742 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f92835-165a-4419-b8f9-1339517facb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:51.320458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f92835-165a-4419-b8f9-1339517facb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:51.323041 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f92835-165a-4419-b8f9-1339517facb4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:51.415269 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:51.436462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 155/316] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:51.444939 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a10f8-db50-4b6d-9873-59959442d159 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:51.546431 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a10f8-db50-4b6d-9873-59959442d159 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:51.580964 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d30be-5e60-46f9-afd1-601872c6304c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:51.581737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d30be-5e60-46f9-afd1-601872c6304c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:51.582005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d30be-5e60-46f9-afd1-601872c6304c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:51.582273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d30be-5e60-46f9-afd1-601872c6304c None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:51.583436 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d30be-5e60-46f9-afd1-601872c6304c None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:51.584907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d30be-5e60-46f9-afd1-601872c6304c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:51.586906 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 162/317] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:51 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:51.592812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f92835-165a-4419-b8f9-1339517facb4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:51.694716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f92835-165a-4419-b8f9-1339517facb4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:51.731451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77664c-0843-46a2-868a-132c7ae09d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:51.732117 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77664c-0843-46a2-868a-132c7ae09d7b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:51.732597 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77664c-0843-46a2-868a-132c7ae09d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:51.732928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77664c-0843-46a2-868a-132c7ae09d7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:51.733774 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77664c-0843-46a2-868a-132c7ae09d7b None admin] RBAC: Adding query filter params (role.id=a96cd51936d549a3986a0e7e1f50f040, scope.project.id=62c99d0f651845d884f137c894087eb1, user.id=e99d18299515400885dd9e2af13fd4cf) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:51.734083 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77664c-0843-46a2-868a-132c7ae09d7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:51.735558 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77664c-0843-46a2-868a-132c7ae09d7b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:51.742165 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 156/318] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:14:51 2022] GET /identity/v3/role_assignments?user.id=e99d18299515400885dd9e2af13fd4cf&scope.project.id=62c99d0f651845d884f137c894087eb1&role.id=a96cd51936d549a3986a0e7e1f50f040 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:52.241707 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e571243-504e-4f79-94b3-bb0d85bf5828 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:52.242250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e571243-504e-4f79-94b3-bb0d85bf5828 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:52.242250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e571243-504e-4f79-94b3-bb0d85bf5828 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:52.243787 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 163/319] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:52.249540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604f5d2-b0a7-4380-9872-fac53920fc2e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:52.249971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604f5d2-b0a7-4380-9872-fac53920fc2e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:52.250258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604f5d2-b0a7-4380-9872-fac53920fc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:52.269104 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5604f5d2-b0a7-4380-9872-fac53920fc2e None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:52.270284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5604f5d2-b0a7-4380-9872-fac53920fc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:52.312929 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:52.342618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 157/320] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:52.368397 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e571243-504e-4f79-94b3-bb0d85bf5828 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:52.390150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:52.477905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e571243-504e-4f79-94b3-bb0d85bf5828 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:52.513400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bea63c-3273-4c2f-ada9-6774d7a37a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:52.514789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bea63c-3273-4c2f-ada9-6774d7a37a6f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:52.515098 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bea63c-3273-4c2f-ada9-6774d7a37a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:52.515371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bea63c-3273-4c2f-ada9-6774d7a37a6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:52.525986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bea63c-3273-4c2f-ada9-6774d7a37a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:52.534368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-e6bea63c-3273-4c2f-ada9-6774d7a37a6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:52.534368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:52.534368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:52.534368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:52.534368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:52.534368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:52.534368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:52.534368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:52.534368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:52.534368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:52.534368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:52.534368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:52.534368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:52.534368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:52.534368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:52.534368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:52.535407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:52.535407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:52.535407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:52.535407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:52.535407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:52.535407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:52.535407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:52.535407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:52.535407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:52.535407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:52.535407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:52.535407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:52.535407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:52.535407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:52.535407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:52.535407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:52.536180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:52.536180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:52.536180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:52.536180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:52.536180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:52.536180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:52.536180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:52.536180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:52.536180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:52.536180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:52.536180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:52.536180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:52.540453 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 164/321] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:52.541863 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604f5d2-b0a7-4380-9872-fac53920fc2e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:52.647724 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604f5d2-b0a7-4380-9872-fac53920fc2e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:52.689094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ac0f0-e286-43c1-bb60-a60caefa7d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:52.690265 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ac0f0-e286-43c1-bb60-a60caefa7d9c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:52.690549 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ac0f0-e286-43c1-bb60-a60caefa7d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:52.690876 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ac0f0-e286-43c1-bb60-a60caefa7d9c None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:52.691648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ac0f0-e286-43c1-bb60-a60caefa7d9c None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:52.691953 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ac0f0-e286-43c1-bb60-a60caefa7d9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:52.693391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ac0f0-e286-43c1-bb60-a60caefa7d9c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:52.704769 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 158/322] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:52.710445 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bea63c-3273-4c2f-ada9-6774d7a37a6f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:52.794005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:52.818030 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bea63c-3273-4c2f-ada9-6774d7a37a6f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:52.852623 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839304a-0340-4038-b4c7-d2b5f87300f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:52.853501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839304a-0340-4038-b4c7-d2b5f87300f3 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:52.853777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839304a-0340-4038-b4c7-d2b5f87300f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:52.854041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839304a-0340-4038-b4c7-d2b5f87300f3 None admin] PATH_INFO: `/v3/users/8a504af69f394769b0e6c17fb3a24ded` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:52.855234 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839304a-0340-4038-b4c7-d2b5f87300f3 None admin] RBAC: Authorizing `identity:get_user(user_id=8a504af69f394769b0e6c17fb3a24ded)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:52.856698 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839304a-0340-4038-b4c7-d2b5f87300f3 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:52.858926 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 165/323] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:52 2022] GET /identity/v3/users/8a504af69f394769b0e6c17fb3a24ded => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:52.864530 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ac0f0-e286-43c1-bb60-a60caefa7d9c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:52.901926 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:52.902127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad56c8d-390f-4afa-bce4-91cc6a888daf None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:52.902335 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad56c8d-390f-4afa-bce4-91cc6a888daf None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:52.902607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad56c8d-390f-4afa-bce4-91cc6a888daf None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:52.904215 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 166/324] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:14:52.909689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dcfce-75bd-4b7c-9afc-95b4a7495f0e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:52.909946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dcfce-75bd-4b7c-9afc-95b4a7495f0e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:52.910242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dcfce-75bd-4b7c-9afc-95b4a7495f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:52.928550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-670dcfce-75bd-4b7c-9afc-95b4a7495f0e None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:52.929772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-670dcfce-75bd-4b7c-9afc-95b4a7495f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:52.973948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ac0f0-e286-43c1-bb60-a60caefa7d9c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:52.999402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 167/325] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:53.000746 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29944b-54ed-4c60-8524-b2f58d86df40 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:53.001032 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29944b-54ed-4c60-8524-b2f58d86df40 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:53.001307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29944b-54ed-4c60-8524-b2f58d86df40 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:53.002814 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 168/326] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:53.007765 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7d4bd-fdd5-4a9d-a5b0-925318f6d62c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:53.008106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7d4bd-fdd5-4a9d-a5b0-925318f6d62c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:53.008438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7d4bd-fdd5-4a9d-a5b0-925318f6d62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:53.015584 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95c33e-9a34-4661-bf3a-bd38db048f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:53.016239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95c33e-9a34-4661-bf3a-bd38db048f87 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:53.016542 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95c33e-9a34-4661-bf3a-bd38db048f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:53.016833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95c33e-9a34-4661-bf3a-bd38db048f87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:53.017677 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95c33e-9a34-4661-bf3a-bd38db048f87 None admin] RBAC: Adding query filter params (role.id=713f175e9435403f9e39528c805bd956, user.id=8a504af69f394769b0e6c17fb3a24ded, scope.system=all) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:53.017984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95c33e-9a34-4661-bf3a-bd38db048f87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:53.019425 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95c33e-9a34-4661-bf3a-bd38db048f87 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:53.027891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-65e7d4bd-fdd5-4a9d-a5b0-925318f6d62c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:53.029145 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-65e7d4bd-fdd5-4a9d-a5b0-925318f6d62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:53.031404 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 159/327] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Jul 12 03:14:52 2022] GET /identity/v3/role_assignments?user.id=8a504af69f394769b0e6c17fb3a24ded&scope.system=all&role.id=713f175e9435403f9e39528c805bd956 => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:53.033421 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95c33e-9a34-4661-bf3a-bd38db048f87 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:53.116556 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 169/328] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:53.129094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7d4bd-fdd5-4a9d-a5b0-925318f6d62c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:53.133069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:53.139221 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:53.147098 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95c33e-9a34-4661-bf3a-bd38db048f87 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:53.185851 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a355a-b56e-429b-8530-839eb1175a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:53.186320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a355a-b56e-429b-8530-839eb1175a26 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:53.186593 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a355a-b56e-429b-8530-839eb1175a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:53.186859 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a355a-b56e-429b-8530-839eb1175a26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:53.188168 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a355a-b56e-429b-8530-839eb1175a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:53.189773 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a355a-b56e-429b-8530-839eb1175a26 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:53.191555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 160/329] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:14:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:53.197059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a355a-b56e-429b-8530-839eb1175a26 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:53.244652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7d4bd-fdd5-4a9d-a5b0-925318f6d62c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:53.279181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ae1ba-cfce-4345-9a7f-2726275e7b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:53.280582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ae1ba-cfce-4345-9a7f-2726275e7b8e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:53.280864 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ae1ba-cfce-4345-9a7f-2726275e7b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:53.281135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ae1ba-cfce-4345-9a7f-2726275e7b8e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:53.291178 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ae1ba-cfce-4345-9a7f-2726275e7b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:53.299518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-453ae1ba-cfce-4345-9a7f-2726275e7b8e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:53.299518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:53.299518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:53.299518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:53.299518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:53.299518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:53.299518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:53.299518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:53.299518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:53.299518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:53.299518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:53.299518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:53.299518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:53.299518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:53.299518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:53.299518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:53.300362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:53.300362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:53.300362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:53.300362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:53.300362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:53.300362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:53.300362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:53.300362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:53.300362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:53.300362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:53.300362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:53.300362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:53.300362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:53.300362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:53.300362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:53.300362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:53.301181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:53.301181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:53.301181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:53.301181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:53.301181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:53.301181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:53.301181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:53.301181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:53.301181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:53.301181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:53.301181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:53.301181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:53.301181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 170/330] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:53.306695 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ae1ba-cfce-4345-9a7f-2726275e7b8e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:53.307108 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a355a-b56e-429b-8530-839eb1175a26 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:53.344124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e6c32-7dbb-4cf8-9d30-370d20cdc9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:53.344376 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e6c32-7dbb-4cf8-9d30-370d20cdc9ca None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:53.344675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e6c32-7dbb-4cf8-9d30-370d20cdc9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:53.344958 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e6c32-7dbb-4cf8-9d30-370d20cdc9ca None admin] PATH_INFO: `/v3/groups` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:53.345734 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e6c32-7dbb-4cf8-9d30-370d20cdc9ca None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:53.347234 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e6c32-7dbb-4cf8-9d30-370d20cdc9ca None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:53.362480 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 161/331] 10.222.0.26 () {60 vars in 1134 bytes} [Tue Jul 12 03:14:53 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:14:53.378727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:53.421328 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ae1ba-cfce-4345-9a7f-2726275e7b8e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:53.458886 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037599af-9aaf-4ccb-9d97-5c9104938bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:53.459563 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037599af-9aaf-4ccb-9d97-5c9104938bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:53.459835 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037599af-9aaf-4ccb-9d97-5c9104938bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:53.460101 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037599af-9aaf-4ccb-9d97-5c9104938bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:53.460891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037599af-9aaf-4ccb-9d97-5c9104938bc6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:53.461186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037599af-9aaf-4ccb-9d97-5c9104938bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:53.462568 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037599af-9aaf-4ccb-9d97-5c9104938bc6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:53.471868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 171/332] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:53.478064 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e6c32-7dbb-4cf8-9d30-370d20cdc9ca None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:53.506077 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:53.585794 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e6c32-7dbb-4cf8-9d30-370d20cdc9ca None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:53.620058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c8418-edf5-4f34-bec0-d93e92ed404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:53.620991 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c8418-edf5-4f34-bec0-d93e92ed404b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:53.621262 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c8418-edf5-4f34-bec0-d93e92ed404b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:53.621539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c8418-edf5-4f34-bec0-d93e92ed404b None admin] PATH_INFO: `/v3/users/ef84d4ebf8be49138c970f0579311fa6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:53.622743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c8418-edf5-4f34-bec0-d93e92ed404b None admin] RBAC: Authorizing `identity:get_user(user_id=ef84d4ebf8be49138c970f0579311fa6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:53.624317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c8418-edf5-4f34-bec0-d93e92ed404b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:53.626033 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 162/333] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:53 2022] GET /identity/v3/users/ef84d4ebf8be49138c970f0579311fa6 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:53.631810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037599af-9aaf-4ccb-9d97-5c9104938bc6 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:53.744916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037599af-9aaf-4ccb-9d97-5c9104938bc6 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:53.772384 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:53.783583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1062e0a-f0b2-405e-ae21-90753343ae55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:53.784465 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1062e0a-f0b2-405e-ae21-90753343ae55 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:53.784771 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1062e0a-f0b2-405e-ae21-90753343ae55 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:53.785042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1062e0a-f0b2-405e-ae21-90753343ae55 None admin] PATH_INFO: `/v3/system/users/ef84d4ebf8be49138c970f0579311fa6/roles/a96cd51936d549a3986a0e7e1f50f040` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:53.786531 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1062e0a-f0b2-405e-ae21-90753343ae55 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ef84d4ebf8be49138c970f0579311fa6, role_id=a96cd51936d549a3986a0e7e1f50f040)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:53.787919 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1062e0a-f0b2-405e-ae21-90753343ae55 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:53.801708 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 172/334] 10.222.0.26 () {58 vars in 1334 bytes} [Tue Jul 12 03:14:53 2022] PUT /identity/v3/system/users/ef84d4ebf8be49138c970f0579311fa6/roles/a96cd51936d549a3986a0e7e1f50f040 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:14:55.701800 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baffdbe-e211-4b33-bfa2-c74a3c9fb11c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:55.702817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baffdbe-e211-4b33-bfa2-c74a3c9fb11c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:55.703314 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baffdbe-e211-4b33-bfa2-c74a3c9fb11c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:55.705667 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 163/335] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:55.711403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30552997-0e01-4346-b52d-a12828a285c7 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:55.712222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30552997-0e01-4346-b52d-a12828a285c7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:55.712714 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30552997-0e01-4346-b52d-a12828a285c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:55.734658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-30552997-0e01-4346-b52d-a12828a285c7 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:55.736194 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-30552997-0e01-4346-b52d-a12828a285c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:55.826813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 173/336] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:55.862083 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baffdbe-e211-4b33-bfa2-c74a3c9fb11c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:55.977916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:55.991920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baffdbe-e211-4b33-bfa2-c74a3c9fb11c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:56.032561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb1ecc-ea6c-4db3-a0c8-d46e9cc683a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:56.033380 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb1ecc-ea6c-4db3-a0c8-d46e9cc683a4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:56.033657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb1ecc-ea6c-4db3-a0c8-d46e9cc683a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:56.033922 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb1ecc-ea6c-4db3-a0c8-d46e9cc683a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:56.049840 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb1ecc-ea6c-4db3-a0c8-d46e9cc683a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:56.057905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-46eb1ecc-ea6c-4db3-a0c8-d46e9cc683a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:14:56.057905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:56.057905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:56.057905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:56.057905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:56.057905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:56.057905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:56.057905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:56.057905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:56.057905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:56.057905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:56.057905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:56.057905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:56.057905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:56.057905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:56.057905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:56.058749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:56.058749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:56.058749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:56.058749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:56.058749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:56.058749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:56.058749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:56.058749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:56.058749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:56.058749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:56.058749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:56.058749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:56.058749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:56.058749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:56.058749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:56.058749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:56.059544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:56.059544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:56.059544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:56.059544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:56.059544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:56.059544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:56.059544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:56.059544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:56.059544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:56.059544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:56.059544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:14:56.059544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:56.059544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 164/337] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:14:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:56.066857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30552997-0e01-4346-b52d-a12828a285c7 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:56.216229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30552997-0e01-4346-b52d-a12828a285c7 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:56.235566 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965df5d8-f25e-4223-9ead-732c2a55c905 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:56.235881 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965df5d8-f25e-4223-9ead-732c2a55c905 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:56.236044 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965df5d8-f25e-4223-9ead-732c2a55c905 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:56.237713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 165/338] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:56.239659 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:56.243167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e74c91-28c2-4de7-aa59-cc4dccfe47ee None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:56.243451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e74c91-28c2-4de7-aa59-cc4dccfe47ee None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:56.243736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e74c91-28c2-4de7-aa59-cc4dccfe47ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:56.260752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2834ca-1e14-4cfe-89e8-4a8b8f69acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:56.261784 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2834ca-1e14-4cfe-89e8-4a8b8f69acf7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:56.262295 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2834ca-1e14-4cfe-89e8-4a8b8f69acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:56.262759 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2834ca-1e14-4cfe-89e8-4a8b8f69acf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:56.263924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2834ca-1e14-4cfe-89e8-4a8b8f69acf7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:56.264430 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2834ca-1e14-4cfe-89e8-4a8b8f69acf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:56.266135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2834ca-1e14-4cfe-89e8-4a8b8f69acf7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:56.266353 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e5e74c91-28c2-4de7-aa59-cc4dccfe47ee None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:56.267545 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e5e74c91-28c2-4de7-aa59-cc4dccfe47ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:56.277656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 174/339] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:14:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:56.284982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2834ca-1e14-4cfe-89e8-4a8b8f69acf7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:56.356059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 166/340] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:14:56.383118 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e74c91-28c2-4de7-aa59-cc4dccfe47ee None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:56.403059 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2834ca-1e14-4cfe-89e8-4a8b8f69acf7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:56.440313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85e311-586a-4005-824f-453950a47fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:56.441353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85e311-586a-4005-824f-453950a47fca None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:56.441866 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85e311-586a-4005-824f-453950a47fca None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:56.442352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85e311-586a-4005-824f-453950a47fca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:56.468757 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:56.489098 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e74c91-28c2-4de7-aa59-cc4dccfe47ee None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:56.503715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:56.532471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee35dd0-18d9-4506-ab30-628da6d68cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:56.533318 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee35dd0-18d9-4506-ab30-628da6d68cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:56.533597 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee35dd0-18d9-4506-ab30-628da6d68cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:56.533867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee35dd0-18d9-4506-ab30-628da6d68cf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:56.549536 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85e311-586a-4005-824f-453950a47fca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:56.551027 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85e311-586a-4005-824f-453950a47fca None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:56.556640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee35dd0-18d9-4506-ab30-628da6d68cf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:56.565995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-5ee35dd0-18d9-4506-ab30-628da6d68cf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:56.565995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:56.565995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:56.565995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:56.565995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:56.565995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:56.565995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:56.565995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:56.565995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:56.565995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:56.565995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:56.565995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:56.565995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:56.565995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:56.565995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:56.565995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:56.566896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:56.566896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:56.566896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:56.566896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:56.566896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:56.566896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:56.566896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:56.566896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:56.566896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:56.566896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:56.566896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:56.566896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:56.566896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:56.566896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:56.566896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:56.566896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:56.567690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:56.567690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:56.567690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:56.567690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:56.567690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:56.567690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:56.567690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:56.567690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:56.567690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:56.567690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:56.567690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:56.567690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:56.567690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 167/341] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:14:56.578838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fe097-19fa-4bae-b600-06ffd7510c02 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:56.579831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fe097-19fa-4bae-b600-06ffd7510c02 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:56.580324 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fe097-19fa-4bae-b600-06ffd7510c02 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:56.582869 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 168/342] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:56.585822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fe097-19fa-4bae-b600-06ffd7510c02 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:56.681572 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 175/343] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 03:14:56.683296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d3c68-92f7-4fc2-8c6e-a0eef1e4eac3 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:56.683796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d3c68-92f7-4fc2-8c6e-a0eef1e4eac3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:56.684255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d3c68-92f7-4fc2-8c6e-a0eef1e4eac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:56.707263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-288d3c68-92f7-4fc2-8c6e-a0eef1e4eac3 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:56.708810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-288d3c68-92f7-4fc2-8c6e-a0eef1e4eac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:56.713229 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fe097-19fa-4bae-b600-06ffd7510c02 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:56.749387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882c8b9-f2e9-4195-bcd1-6a6b9fbafd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:56.749587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882c8b9-f2e9-4195-bcd1-6a6b9fbafd08 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:56.749807 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882c8b9-f2e9-4195-bcd1-6a6b9fbafd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:56.749975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882c8b9-f2e9-4195-bcd1-6a6b9fbafd08 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:56.750748 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882c8b9-f2e9-4195-bcd1-6a6b9fbafd08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:56.751053 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882c8b9-f2e9-4195-bcd1-6a6b9fbafd08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:56.752455 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882c8b9-f2e9-4195-bcd1-6a6b9fbafd08 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:56.761854 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 169/344] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:14:56.762697 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882c8b9-f2e9-4195-bcd1-6a6b9fbafd08 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:56.766505 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:56.792127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 176/345] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:56.793752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d3c68-92f7-4fc2-8c6e-a0eef1e4eac3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:56.813210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:56.869749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882c8b9-f2e9-4195-bcd1-6a6b9fbafd08 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:56.906418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade199f-04ea-4ec6-be1d-81ef1d8b9528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:56.907317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade199f-04ea-4ec6-be1d-81ef1d8b9528 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:56.907592 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade199f-04ea-4ec6-be1d-81ef1d8b9528 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:56.907862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade199f-04ea-4ec6-be1d-81ef1d8b9528 None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:56.909355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade199f-04ea-4ec6-be1d-81ef1d8b9528 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:56.910710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade199f-04ea-4ec6-be1d-81ef1d8b9528 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:56.912886 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 170/346] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:56 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:56.914456 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316a3ca-e1cc-4acd-aece-2abb1afa3f69 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:56.914737 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316a3ca-e1cc-4acd-aece-2abb1afa3f69 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:56.915013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316a3ca-e1cc-4acd-aece-2abb1afa3f69 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:56.916496 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 171/347] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:56.918634 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316a3ca-e1cc-4acd-aece-2abb1afa3f69 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:56.928588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d3c68-92f7-4fc2-8c6e-a0eef1e4eac3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:56.964621 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7703ca-4fc7-4675-b7e1-657a64a374cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:56.965682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7703ca-4fc7-4675-b7e1-657a64a374cb None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:56.966170 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7703ca-4fc7-4675-b7e1-657a64a374cb None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:56.966901 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7703ca-4fc7-4675-b7e1-657a64a374cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:56.994227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:57.033434 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316a3ca-e1cc-4acd-aece-2abb1afa3f69 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:57.043231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7703ca-4fc7-4675-b7e1-657a64a374cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:57.045182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7703ca-4fc7-4675-b7e1-657a64a374cb None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:57.066980 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:57.069546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f3f7c-6335-45e5-9844-743f12e87b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:57.069965 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f3f7c-6335-45e5-9844-743f12e87b37 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:57.070201 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f3f7c-6335-45e5-9844-743f12e87b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:57.070558 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f3f7c-6335-45e5-9844-743f12e87b37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:57.081951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f3f7c-6335-45e5-9844-743f12e87b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:57.089925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e74f3f7c-6335-45e5-9844-743f12e87b37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:57.089925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:57.089925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:57.089925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:57.089925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:57.089925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:57.089925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:57.089925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:57.089925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:57.089925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:57.089925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:57.089925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:57.089925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:57.089925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:57.089925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:57.089925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:57.090933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:57.090933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:57.090933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:57.090933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:57.090933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:57.090933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:57.090933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:57.090933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:57.090933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:57.090933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:57.090933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:57.090933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:57.090933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:57.090933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:57.090933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:57.090933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:57.091833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:57.091833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:57.091833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:57.091833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:57.091833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:57.091833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:57.091833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:57.091833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:57.091833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:57.091833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:57.091833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:14:57.091833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:57.091833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 172/348] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:57.092877 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f3f7c-6335-45e5-9844-743f12e87b37 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:57.163365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 177/349] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:57.165121 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a3763-e6f8-40b2-84ec-40c389407bc5 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:57.165536 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a3763-e6f8-40b2-84ec-40c389407bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:57.165947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a3763-e6f8-40b2-84ec-40c389407bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:57.186258 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-418a3763-e6f8-40b2-84ec-40c389407bc5 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:57.187780 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-418a3763-e6f8-40b2-84ec-40c389407bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:57.209149 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f3f7c-6335-45e5-9844-743f12e87b37 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:57.250799 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8b7b4-2a64-4626-bf06-e54aa5d94a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:57.251675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8b7b4-2a64-4626-bf06-e54aa5d94a5b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:57.252063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8b7b4-2a64-4626-bf06-e54aa5d94a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:57.252426 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8b7b4-2a64-4626-bf06-e54aa5d94a5b None admin] PATH_INFO: `/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:57.256895 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:57.261923 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8b7b4-2a64-4626-bf06-e54aa5d94a5b None admin] RBAC: Authorizing `identity:get_group(group_id=7a81fbd58cea4f1d87e8dce2dc59f949)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:57.264411 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8b7b4-2a64-4626-bf06-e54aa5d94a5b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:57.265689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 173/350] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 03:14:57 2022] GET /identity/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:57.266715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8b7b4-2a64-4626-bf06-e54aa5d94a5b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:57.275383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 178/351] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:57.276492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a3763-e6f8-40b2-84ec-40c389407bc5 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:57.334524 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:57.391957 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8b7b4-2a64-4626-bf06-e54aa5d94a5b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:57.409488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a3763-e6f8-40b2-84ec-40c389407bc5 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:57.435494 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c3157-4c8e-40df-aa12-179b76b76485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:57.436762 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c3157-4c8e-40df-aa12-179b76b76485 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:57.437368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c3157-4c8e-40df-aa12-179b76b76485 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:57.437819 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c3157-4c8e-40df-aa12-179b76b76485 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:57.438681 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c3157-4c8e-40df-aa12-179b76b76485 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:57.439081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c3157-4c8e-40df-aa12-179b76b76485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:57.440583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c3157-4c8e-40df-aa12-179b76b76485 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:57.450631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 174/352] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:57.451690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c3157-4c8e-40df-aa12-179b76b76485 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:57.453618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8faae-be74-444e-bdbf-592eee2797c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:57.454995 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8faae-be74-444e-bdbf-592eee2797c0 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:57.455425 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8faae-be74-444e-bdbf-592eee2797c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:57.456705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8faae-be74-444e-bdbf-592eee2797c0 None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:57.461241 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8faae-be74-444e-bdbf-592eee2797c0 None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:57.463522 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8faae-be74-444e-bdbf-592eee2797c0 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:57.466501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 179/353] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:57 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:57.467762 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8faae-be74-444e-bdbf-592eee2797c0 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:57.534874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:57.601734 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c3157-4c8e-40df-aa12-179b76b76485 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:57.605062 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8faae-be74-444e-bdbf-592eee2797c0 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:57.619682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:57.646507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bca861-df73-4fce-9dc3-61ac6a2f6963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:57.647490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bca861-df73-4fce-9dc3-61ac6a2f6963 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:57.648015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bca861-df73-4fce-9dc3-61ac6a2f6963 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:57.648471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bca861-df73-4fce-9dc3-61ac6a2f6963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:57.649368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c607e4-ddc9-4dc7-aa51-c0ebc7d1d8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:57.649788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bca861-df73-4fce-9dc3-61ac6a2f6963 None admin] RBAC: Adding query filter params (group.id=7a81fbd58cea4f1d87e8dce2dc59f949, role.id=690fc625fea1445fa7e0e8f40ae2246c, scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:57.650187 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c607e4-ddc9-4dc7-aa51-c0ebc7d1d8af None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:57.650473 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c607e4-ddc9-4dc7-aa51-c0ebc7d1d8af None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:57.650591 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bca861-df73-4fce-9dc3-61ac6a2f6963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:57.650742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c607e4-ddc9-4dc7-aa51-c0ebc7d1d8af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:57.652822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bca861-df73-4fce-9dc3-61ac6a2f6963 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:57.660815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 175/354] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 03:14:57 2022] GET /identity/v3/role_assignments?group.id=7a81fbd58cea4f1d87e8dce2dc59f949&scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a&role.id=690fc625fea1445fa7e0e8f40ae2246c => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:57.661906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bca861-df73-4fce-9dc3-61ac6a2f6963 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:57.663150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c607e4-ddc9-4dc7-aa51-c0ebc7d1d8af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:57.672035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-29c607e4-ddc9-4dc7-aa51-c0ebc7d1d8af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:57.672035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:57.672035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:57.672035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:57.672035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:57.672035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:57.672035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:57.672035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:57.672035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:57.672035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:57.672035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:57.672035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:57.672035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:57.672035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:57.672035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:57.672035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:57.673044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:57.673044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:57.673044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:57.673044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:57.673044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:57.673044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:57.673044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:57.673044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:57.673044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:57.673044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:57.673044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:57.673044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:57.673044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:57.673044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:57.673044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:57.673044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:57.673842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:57.673842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:57.673842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:57.673842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:57.673842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:57.673842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:57.673842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:57.673842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:57.673842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:57.673842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:57.673842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 03:14:57.673842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:14:57.675164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 180/355] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:57.681717 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c607e4-ddc9-4dc7-aa51-c0ebc7d1d8af None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:57.807291 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bca861-df73-4fce-9dc3-61ac6a2f6963 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:57.834484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:57.837365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c607e4-ddc9-4dc7-aa51-c0ebc7d1d8af None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:57.853227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc2420-4a82-42de-a3de-2a47b9cc5b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:57.853925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc2420-4a82-42de-a3de-2a47b9cc5b1b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:57.854208 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc2420-4a82-42de-a3de-2a47b9cc5b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:57.854480 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc2420-4a82-42de-a3de-2a47b9cc5b1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:57.906897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e2c16-604f-47d3-9539-85aa7fc2a815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:57.908033 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e2c16-604f-47d3-9539-85aa7fc2a815 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:57.908309 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e2c16-604f-47d3-9539-85aa7fc2a815 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:57.908612 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e2c16-604f-47d3-9539-85aa7fc2a815 None admin] PATH_INFO: `/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:57.910101 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e2c16-604f-47d3-9539-85aa7fc2a815 None admin] RBAC: Authorizing `identity:get_group(group_id=7a81fbd58cea4f1d87e8dce2dc59f949)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:57.912643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e2c16-604f-47d3-9539-85aa7fc2a815 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:57.914616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 181/356] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 03:14:57 2022] GET /identity/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:57.916466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18863fc8-bb4a-4c1d-8cba-85d1d6b10c8b None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:57.916773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18863fc8-bb4a-4c1d-8cba-85d1d6b10c8b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:57.917045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18863fc8-bb4a-4c1d-8cba-85d1d6b10c8b None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:57.919039 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 182/357] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:57.924662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18863fc8-bb4a-4c1d-8cba-85d1d6b10c8b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:57.955633 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc2420-4a82-42de-a3de-2a47b9cc5b1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:57.957170 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc2420-4a82-42de-a3de-2a47b9cc5b1b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:57.980088 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:58.067759 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18863fc8-bb4a-4c1d-8cba-85d1d6b10c8b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:58.083951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 176/358] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:58.086020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48a7d-1c9b-4b98-a717-f376011bec44 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:58.086866 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48a7d-1c9b-4b98-a717-f376011bec44 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:58.086866 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48a7d-1c9b-4b98-a717-f376011bec44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:58.110759 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9725b-d1b1-4d87-b597-6fc48777b68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:58.111364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9725b-d1b1-4d87-b597-6fc48777b68a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:58.111645 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9725b-d1b1-4d87-b597-6fc48777b68a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:58.111920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9725b-d1b1-4d87-b597-6fc48777b68a None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:58.112737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9725b-d1b1-4d87-b597-6fc48777b68a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:58.113525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9725b-d1b1-4d87-b597-6fc48777b68a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:58.114417 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b1d48a7d-1c9b-4b98-a717-f376011bec44 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:58.114518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9725b-d1b1-4d87-b597-6fc48777b68a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:58.115668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b1d48a7d-1c9b-4b98-a717-f376011bec44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:58.124725 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 183/359] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:14:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:58.125883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9725b-d1b1-4d87-b597-6fc48777b68a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:58.138082 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:58.220821 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 177/360] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:58.222739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ac830-c9de-4304-99d7-4da168461dc3 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:58.223032 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ac830-c9de-4304-99d7-4da168461dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:58.223386 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ac830-c9de-4304-99d7-4da168461dc3 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:58.224791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 178/361] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:14:58.225572 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ac830-c9de-4304-99d7-4da168461dc3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:58.263805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:58.268167 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9725b-d1b1-4d87-b597-6fc48777b68a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:58.310301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35910ca4-b0ff-438b-98e4-5d79939c1319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:58.311308 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35910ca4-b0ff-438b-98e4-5d79939c1319 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:58.311666 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35910ca4-b0ff-438b-98e4-5d79939c1319 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:58.312353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35910ca4-b0ff-438b-98e4-5d79939c1319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:58.312984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35910ca4-b0ff-438b-98e4-5d79939c1319 None admin] RBAC: Adding query filter params (group.id=7a81fbd58cea4f1d87e8dce2dc59f949, role.id=713f175e9435403f9e39528c805bd956, scope.project.id=62c99d0f651845d884f137c894087eb1) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:58.313300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35910ca4-b0ff-438b-98e4-5d79939c1319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:58.314745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35910ca4-b0ff-438b-98e4-5d79939c1319 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:58.322395 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 184/362] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 03:14:58 2022] GET /identity/v3/role_assignments?group.id=7a81fbd58cea4f1d87e8dce2dc59f949&scope.project.id=62c99d0f651845d884f137c894087eb1&role.id=713f175e9435403f9e39528c805bd956 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:58.323518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35910ca4-b0ff-438b-98e4-5d79939c1319 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:58.361264 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ac830-c9de-4304-99d7-4da168461dc3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:58.406466 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f91f3e-70c1-4763-9919-6c138e2141e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:58.407456 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f91f3e-70c1-4763-9919-6c138e2141e8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:58.407818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f91f3e-70c1-4763-9919-6c138e2141e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:58.408154 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f91f3e-70c1-4763-9919-6c138e2141e8 None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:58.410139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f91f3e-70c1-4763-9919-6c138e2141e8 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:58.411988 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f91f3e-70c1-4763-9919-6c138e2141e8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:58.419733 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 179/363] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:58 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:58.419733 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dea2e-f571-4f7e-9511-ba57e643197d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:58.419733 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dea2e-f571-4f7e-9511-ba57e643197d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:58.419733 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dea2e-f571-4f7e-9511-ba57e643197d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:58.441757 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7a5dea2e-f571-4f7e-9511-ba57e643197d None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:14:58.443091 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7a5dea2e-f571-4f7e-9511-ba57e643197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:14:58.468963 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:58.483568 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35910ca4-b0ff-438b-98e4-5d79939c1319 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:58.530814 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e37d0f-aed8-4f03-bb94-41ebf045b9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:58.531962 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e37d0f-aed8-4f03-bb94-41ebf045b9bf None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:58.532408 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e37d0f-aed8-4f03-bb94-41ebf045b9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:58.532717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 180/364] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:14:58.533014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e37d0f-aed8-4f03-bb94-41ebf045b9bf None admin] PATH_INFO: `/v3/users/ef84d4ebf8be49138c970f0579311fa6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:58.538159 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dea2e-f571-4f7e-9511-ba57e643197d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:58.542744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e37d0f-aed8-4f03-bb94-41ebf045b9bf None admin] RBAC: Authorizing `identity:get_user(user_id=ef84d4ebf8be49138c970f0579311fa6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:58.545789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e37d0f-aed8-4f03-bb94-41ebf045b9bf None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:58.550789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 185/365] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:14:58 2022] GET /identity/v3/users/ef84d4ebf8be49138c970f0579311fa6 => generated 293 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:58.551880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e37d0f-aed8-4f03-bb94-41ebf045b9bf None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:58.592402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:58.662843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dea2e-f571-4f7e-9511-ba57e643197d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:58.684700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e37d0f-aed8-4f03-bb94-41ebf045b9bf None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:58.713884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9706350-eb13-41df-9889-40dab36fc15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:58.715117 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9706350-eb13-41df-9889-40dab36fc15c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:58.715463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9706350-eb13-41df-9889-40dab36fc15c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:58.715991 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9706350-eb13-41df-9889-40dab36fc15c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:58.725164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db604513-282c-43b1-b362-c475c75cf43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:58.726102 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db604513-282c-43b1-b362-c475c75cf43a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:58.726324 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db604513-282c-43b1-b362-c475c75cf43a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:58.726594 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db604513-282c-43b1-b362-c475c75cf43a None admin] PATH_INFO: `/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:58.728801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db604513-282c-43b1-b362-c475c75cf43a None admin] RBAC: Authorizing `identity:get_group(group_id=7a81fbd58cea4f1d87e8dce2dc59f949)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:58.730265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db604513-282c-43b1-b362-c475c75cf43a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:58.731256 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9706350-eb13-41df-9889-40dab36fc15c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:58.732354 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 186/366] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 03:14:58 2022] GET /identity/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:58.733181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db604513-282c-43b1-b362-c475c75cf43a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:58.748408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b9706350-eb13-41df-9889-40dab36fc15c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:14:58.748408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:58.748408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:58.748408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:58.748408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:58.748408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:58.748408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:58.748408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:58.748408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:58.748408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:58.748408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:58.748408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:58.748408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:58.748408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:58.748408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:58.748408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:58.749373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:58.749373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:58.749373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:58.749373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:58.749373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:58.749373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:58.749373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:58.749373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:58.749373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:58.749373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:58.749373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:58.749373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:58.749373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:58.749373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:58.749373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:58.749373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:58.750811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:58.750811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:58.750811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:58.750811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:58.750811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:58.750811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:58.750811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:58.750811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:58.750811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:58.750811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:58.750811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:14:58.750811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:58.750811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 181/367] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:14:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:58.751951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9706350-eb13-41df-9889-40dab36fc15c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:58.765020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:58.859877 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:58.863712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db604513-282c-43b1-b362-c475c75cf43a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:58.880224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9706350-eb13-41df-9889-40dab36fc15c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:58.908298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b050f-e36c-4661-bbd8-83db58d7746d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:58.909482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b050f-e36c-4661-bbd8-83db58d7746d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:58.909770 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b050f-e36c-4661-bbd8-83db58d7746d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:58.910401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b050f-e36c-4661-bbd8-83db58d7746d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:58.911300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b050f-e36c-4661-bbd8-83db58d7746d None admin] RBAC: Adding query filter params (role.id=a96cd51936d549a3986a0e7e1f50f040, user.id=ef84d4ebf8be49138c970f0579311fa6, scope.system=all) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:58.911797 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b050f-e36c-4661-bbd8-83db58d7746d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:58.913914 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b050f-e36c-4661-bbd8-83db58d7746d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:58.924529 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96283c0f-b6ed-4b21-bf53-a8d78eb81fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:58.925819 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96283c0f-b6ed-4b21-bf53-a8d78eb81fbb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:58.926103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96283c0f-b6ed-4b21-bf53-a8d78eb81fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:58.926444 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96283c0f-b6ed-4b21-bf53-a8d78eb81fbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:58.932934 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 187/368] 10.222.0.26 () {56 vars in 1308 bytes} [Tue Jul 12 03:14:58 2022] GET /identity/v3/role_assignments?user.id=ef84d4ebf8be49138c970f0579311fa6&scope.system=all&role.id=a96cd51936d549a3986a0e7e1f50f040 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:58.933831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b050f-e36c-4661-bbd8-83db58d7746d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:58.938619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96283c0f-b6ed-4b21-bf53-a8d78eb81fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:14:58.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-96283c0f-b6ed-4b21-bf53-a8d78eb81fbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:58.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:14:58.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:14:58.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:14:58.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:14:58.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:14:58.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:14:58.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:14:58.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:14:58.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:14:58.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:14:58.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:14:58.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:14:58.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:14:58.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:14:58.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:14:58.949920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:14:58.949920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:14:58.949920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:14:58.949920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:14:58.949920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:14:58.949920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:14:58.949920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:14:58.949920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:14:58.949920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:14:58.949920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:14:58.949920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:14:58.949920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:14:58.949920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:14:58.949920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:14:58.949920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:14:58.949920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:14:58.950715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:14:58.950715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:14:58.950715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:14:58.950715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:14:58.950715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:14:58.950715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:14:58.950715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:14:58.950715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:14:58.950715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:14:58.950715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:14:58.950715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:14:58.950715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:14:58.950715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 182/369] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:14:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:14:58.951952 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96283c0f-b6ed-4b21-bf53-a8d78eb81fbb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:59.033020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:59.072096 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96283c0f-b6ed-4b21-bf53-a8d78eb81fbb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:59.112084 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55759585-2e06-45a0-9e2c-1e9b6d58d5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:59.112807 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55759585-2e06-45a0-9e2c-1e9b6d58d5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:59.113142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55759585-2e06-45a0-9e2c-1e9b6d58d5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:59.113468 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55759585-2e06-45a0-9e2c-1e9b6d58d5d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:59.114261 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55759585-2e06-45a0-9e2c-1e9b6d58d5d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:59.114576 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55759585-2e06-45a0-9e2c-1e9b6d58d5d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:59.116110 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55759585-2e06-45a0-9e2c-1e9b6d58d5d7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:59.126372 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 183/370] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:14:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:59.127261 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55759585-2e06-45a0-9e2c-1e9b6d58d5d7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:59.217841 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b050f-e36c-4661-bbd8-83db58d7746d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:59.246757 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55759585-2e06-45a0-9e2c-1e9b6d58d5d7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:59.254928 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6da1e0-2b6a-4f02-ad92-851b924df338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:59.255597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6da1e0-2b6a-4f02-ad92-851b924df338 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:59.255877 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6da1e0-2b6a-4f02-ad92-851b924df338 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:59.256150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6da1e0-2b6a-4f02-ad92-851b924df338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:59.257031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6da1e0-2b6a-4f02-ad92-851b924df338 None admin] RBAC: Adding query filter params (group.id=7a81fbd58cea4f1d87e8dce2dc59f949, role.id=713f175e9435403f9e39528c805bd956, scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:59.257348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6da1e0-2b6a-4f02-ad92-851b924df338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:59.258941 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6da1e0-2b6a-4f02-ad92-851b924df338 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:59.267268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 188/371] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 03:14:58 2022] GET /identity/v3/role_assignments?group.id=7a81fbd58cea4f1d87e8dce2dc59f949&scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a&role.id=713f175e9435403f9e39528c805bd956 => generated 260 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:59.268165 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6da1e0-2b6a-4f02-ad92-851b924df338 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:59.286064 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1175385-d740-4654-9697-42e1e34d52cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:59.287172 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1175385-d740-4654-9697-42e1e34d52cd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:59.287659 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1175385-d740-4654-9697-42e1e34d52cd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:59.288121 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1175385-d740-4654-9697-42e1e34d52cd None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:59.289097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1175385-d740-4654-9697-42e1e34d52cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:14:59.289701 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1175385-d740-4654-9697-42e1e34d52cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:59.291431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1175385-d740-4654-9697-42e1e34d52cd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:59.297491 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:59.302702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 184/372] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:14:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:59.303372 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:59.310055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1175385-d740-4654-9697-42e1e34d52cd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:59.400935 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6da1e0-2b6a-4f02-ad92-851b924df338 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:59.445573 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1175385-d740-4654-9697-42e1e34d52cd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:59.448840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae0dd8-d9f5-4fce-a789-387003b61351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:59.449970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae0dd8-d9f5-4fce-a789-387003b61351 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:59.449970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae0dd8-d9f5-4fce-a789-387003b61351 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:59.450171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae0dd8-d9f5-4fce-a789-387003b61351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:59.492054 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a465f-2fd3-4500-a587-382d9e2eb6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:59.494056 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a465f-2fd3-4500-a587-382d9e2eb6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:59.494546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a465f-2fd3-4500-a587-382d9e2eb6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:59.495000 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a465f-2fd3-4500-a587-382d9e2eb6b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:59.535782 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae0dd8-d9f5-4fce-a789-387003b61351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:59.537376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae0dd8-d9f5-4fce-a789-387003b61351 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:59.572992 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:59.574853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:59.588131 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a465f-2fd3-4500-a587-382d9e2eb6b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:59.589671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a465f-2fd3-4500-a587-382d9e2eb6b5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:59.678013 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 189/373] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:14:59.683966 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae0dd8-d9f5-4fce-a789-387003b61351 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:59.711484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 185/374] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:14:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 03:14:59.718277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a465f-2fd3-4500-a587-382d9e2eb6b5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:59.861016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae0dd8-d9f5-4fce-a789-387003b61351 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:59.882872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:59.897502 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a465f-2fd3-4500-a587-382d9e2eb6b5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:14:59.919717 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:14:59.940751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbedfd-093f-412e-86d5-69feaf46eb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:59.941985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbedfd-093f-412e-86d5-69feaf46eb8c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:59.942259 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbedfd-093f-412e-86d5-69feaf46eb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:59.942527 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbedfd-093f-412e-86d5-69feaf46eb8c None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:59.944254 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbedfd-093f-412e-86d5-69feaf46eb8c None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:59.945736 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbedfd-093f-412e-86d5-69feaf46eb8c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:59.947785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 190/375] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:59 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:59.950102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d4f30-87a7-4f1c-9a04-7262c307abd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:14:59.951317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d4f30-87a7-4f1c-9a04-7262c307abd8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:14:59.951983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d4f30-87a7-4f1c-9a04-7262c307abd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:14:59.952460 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d4f30-87a7-4f1c-9a04-7262c307abd8 None admin] PATH_INFO: `/v3/projects/75f65be69d944055b21e27b7afc48f60` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:14:59.954238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d4f30-87a7-4f1c-9a04-7262c307abd8 None admin] RBAC: Authorizing `identity:get_project(project_id=75f65be69d944055b21e27b7afc48f60)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:14:59.955812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbedfd-093f-412e-86d5-69feaf46eb8c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:14:59.956744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d4f30-87a7-4f1c-9a04-7262c307abd8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:14:59.958977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 186/376] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:14:59 2022] GET /identity/v3/projects/75f65be69d944055b21e27b7afc48f60 => generated 344 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:14:59.966630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d4f30-87a7-4f1c-9a04-7262c307abd8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:00.097818 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbedfd-093f-412e-86d5-69feaf46eb8c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:00.140373 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a1afe-2297-4899-aa0a-297dcb36f44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:00.141657 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a1afe-2297-4899-aa0a-297dcb36f44d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:00.142167 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a1afe-2297-4899-aa0a-297dcb36f44d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:00.142589 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a1afe-2297-4899-aa0a-297dcb36f44d None admin] PATH_INFO: `/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:00.143918 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a1afe-2297-4899-aa0a-297dcb36f44d None admin] RBAC: Authorizing `identity:get_group(group_id=7a81fbd58cea4f1d87e8dce2dc59f949)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:00.145558 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a1afe-2297-4899-aa0a-297dcb36f44d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:00.147724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 191/377] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 03:14:59 2022] GET /identity/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:00.149180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44f134-1298-4b2f-92b1-f8d6c0727362 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:00.149599 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44f134-1298-4b2f-92b1-f8d6c0727362 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:00.150019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44f134-1298-4b2f-92b1-f8d6c0727362 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:00.156187 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 192/378] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:00.158046 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9d344-3023-43be-af44-a004a6f22495 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:00.158534 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9d344-3023-43be-af44-a004a6f22495 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:00.158951 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9d344-3023-43be-af44-a004a6f22495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:00.179459 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-94d9d344-3023-43be-af44-a004a6f22495 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:00.181053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-94d9d344-3023-43be-af44-a004a6f22495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:00.182711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d4f30-87a7-4f1c-9a04-7262c307abd8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:00.234337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a199531-c09a-4c92-84a7-1641477d380d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:00.235219 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a199531-c09a-4c92-84a7-1641477d380d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:00.235499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a199531-c09a-4c92-84a7-1641477d380d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:00.235773 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a199531-c09a-4c92-84a7-1641477d380d None admin] PATH_INFO: `/v3/groups/0ce23bbb1c8e4e3cb6505b448e2d1cbc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:00.245510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a199531-c09a-4c92-84a7-1641477d380d None admin] RBAC: Authorizing `identity:get_group(group_id=0ce23bbb1c8e4e3cb6505b448e2d1cbc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:00.247249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a199531-c09a-4c92-84a7-1641477d380d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:00.251865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 187/379] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 03:14:59 2022] GET /identity/v3/groups/0ce23bbb1c8e4e3cb6505b448e2d1cbc => generated 229 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:00.252691 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a199531-c09a-4c92-84a7-1641477d380d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:00.259970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:00.280725 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 193/380] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:00.281634 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9d344-3023-43be-af44-a004a6f22495 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:00.289330 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:00.368712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a199531-c09a-4c92-84a7-1641477d380d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:00.398012 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9d344-3023-43be-af44-a004a6f22495 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:00.406375 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e05f7-d9e5-46bd-a093-36ae73321c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:00.407369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e05f7-d9e5-46bd-a093-36ae73321c1c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:00.407848 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e05f7-d9e5-46bd-a093-36ae73321c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:00.408322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e05f7-d9e5-46bd-a093-36ae73321c1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:00.409372 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e05f7-d9e5-46bd-a093-36ae73321c1c None admin] RBAC: Adding query filter params (group.id=7a81fbd58cea4f1d87e8dce2dc59f949, role.id=690fc625fea1445fa7e0e8f40ae2246c, scope.project.id=62c99d0f651845d884f137c894087eb1) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:00.409885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e05f7-d9e5-46bd-a093-36ae73321c1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:00.411524 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e05f7-d9e5-46bd-a093-36ae73321c1c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:00.417743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 188/381] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 03:15:00 2022] GET /identity/v3/role_assignments?group.id=7a81fbd58cea4f1d87e8dce2dc59f949&scope.project.id=62c99d0f651845d884f137c894087eb1&role.id=690fc625fea1445fa7e0e8f40ae2246c => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:00.418809 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e05f7-d9e5-46bd-a093-36ae73321c1c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:00.436537 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee0d9e-488e-49bf-982d-3a6968a81262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:00.437260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee0d9e-488e-49bf-982d-3a6968a81262 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:00.437559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee0d9e-488e-49bf-982d-3a6968a81262 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:00.437918 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee0d9e-488e-49bf-982d-3a6968a81262 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:00.438675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee0d9e-488e-49bf-982d-3a6968a81262 None admin] RBAC: Adding query filter params (group.id=0ce23bbb1c8e4e3cb6505b448e2d1cbc, role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=75f65be69d944055b21e27b7afc48f60) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:00.439032 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee0d9e-488e-49bf-982d-3a6968a81262 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:00.440648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee0d9e-488e-49bf-982d-3a6968a81262 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:00.447717 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 194/382] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 03:15:00 2022] GET /identity/v3/role_assignments?group.id=0ce23bbb1c8e4e3cb6505b448e2d1cbc&scope.project.id=75f65be69d944055b21e27b7afc48f60&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:00.526193 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:00.541758 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e05f7-d9e5-46bd-a093-36ae73321c1c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:00.587649 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a23bb-ff57-4fd6-9175-dd5b90a3455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:00.588486 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a23bb-ff57-4fd6-9175-dd5b90a3455b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:00.588791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a23bb-ff57-4fd6-9175-dd5b90a3455b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:00.589060 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a23bb-ff57-4fd6-9175-dd5b90a3455b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:00.601385 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a23bb-ff57-4fd6-9175-dd5b90a3455b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:00.609989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c49a23bb-ff57-4fd6-9175-dd5b90a3455b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:15:00.609989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:00.609989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:00.609989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:00.609989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:00.609989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:00.609989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:00.609989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:00.609989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:00.609989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:00.609989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:00.609989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:00.609989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:00.609989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:00.609989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:00.609989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:00.610960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:00.610960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:00.610960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:00.610960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:00.610960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:00.610960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:00.610960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:00.610960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:00.610960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:00.610960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:00.610960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:00.610960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:00.610960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:00.610960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:00.610960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:00.610960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:00.611730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:00.611730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:00.611730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:00.611730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:00.611730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:00.611730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:00.611730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:00.611730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:00.611730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:00.611730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:00.611730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:15:00.611730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:00.611730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 189/383] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:15:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:00.617203 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee0d9e-488e-49bf-982d-3a6968a81262 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:00.686602 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:00.742693 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee0d9e-488e-49bf-982d-3a6968a81262 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:00.778115 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb09bb0-a81d-4d78-9973-857a8678f8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:00.778990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb09bb0-a81d-4d78-9973-857a8678f8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:00.779229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb09bb0-a81d-4d78-9973-857a8678f8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:00.779391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb09bb0-a81d-4d78-9973-857a8678f8b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:00.780142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb09bb0-a81d-4d78-9973-857a8678f8b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:00.780449 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb09bb0-a81d-4d78-9973-857a8678f8b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:00.781858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb09bb0-a81d-4d78-9973-857a8678f8b5 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:00.791109 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 195/384] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:00.797072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a23bb-ff57-4fd6-9175-dd5b90a3455b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:00.945488 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a23bb-ff57-4fd6-9175-dd5b90a3455b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:00.985044 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a107b9-8b86-4790-8c39-bfdb1bf67757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:00.986198 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a107b9-8b86-4790-8c39-bfdb1bf67757 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:00.986953 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a107b9-8b86-4790-8c39-bfdb1bf67757 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:00.987360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a107b9-8b86-4790-8c39-bfdb1bf67757 None admin] PATH_INFO: `/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:00.988754 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a107b9-8b86-4790-8c39-bfdb1bf67757 None admin] RBAC: Authorizing `identity:get_group(group_id=7a81fbd58cea4f1d87e8dce2dc59f949)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:00.990365 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a107b9-8b86-4790-8c39-bfdb1bf67757 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:00.992488 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 190/385] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 03:15:00 2022] GET /identity/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:00.999168 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb09bb0-a81d-4d78-9973-857a8678f8b5 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:01.125218 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb09bb0-a81d-4d78-9973-857a8678f8b5 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:01.140364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:01.162849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99790af8-cf6f-459a-80d2-2f6d22011080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:01.163740 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99790af8-cf6f-459a-80d2-2f6d22011080 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:01.164023 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99790af8-cf6f-459a-80d2-2f6d22011080 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:01.164332 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99790af8-cf6f-459a-80d2-2f6d22011080 None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:01.165536 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99790af8-cf6f-459a-80d2-2f6d22011080 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:01.166985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99790af8-cf6f-459a-80d2-2f6d22011080 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:01.168743 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 196/386] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:15:00 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:01.174672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a107b9-8b86-4790-8c39-bfdb1bf67757 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:01.178160 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dab1b1-4a23-48bd-841d-ae820f82712e None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:01.179592 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dab1b1-4a23-48bd-841d-ae820f82712e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:01.180070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dab1b1-4a23-48bd-841d-ae820f82712e None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:01.181959 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 197/387] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:01.188399 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c054b-9488-48cc-b1f5-87bc65caf905 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:01.189376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c054b-9488-48cc-b1f5-87bc65caf905 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:01.189850 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c054b-9488-48cc-b1f5-87bc65caf905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:01.213257 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:01.215913 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-d07c054b-9488-48cc-b1f5-87bc65caf905 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:01.218279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d07c054b-9488-48cc-b1f5-87bc65caf905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:01.308722 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 198/388] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:15:01.354497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a107b9-8b86-4790-8c39-bfdb1bf67757 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:01.359457 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c054b-9488-48cc-b1f5-87bc65caf905 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:01.400046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe38c44-9c48-41ee-8a9e-57cde90b3cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:01.401327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe38c44-9c48-41ee-8a9e-57cde90b3cbf None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:01.401909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe38c44-9c48-41ee-8a9e-57cde90b3cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:01.403477 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe38c44-9c48-41ee-8a9e-57cde90b3cbf None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a/groups/7a81fbd58cea4f1d87e8dce2dc59f949/roles/690fc625fea1445fa7e0e8f40ae2246c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:01.410456 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe38c44-9c48-41ee-8a9e-57cde90b3cbf None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a, group_id=7a81fbd58cea4f1d87e8dce2dc59f949, role_id=690fc625fea1445fa7e0e8f40ae2246c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:01.412135 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe38c44-9c48-41ee-8a9e-57cde90b3cbf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:01.443664 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 191/389] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Jul 12 03:15:01 2022] PUT /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a/groups/7a81fbd58cea4f1d87e8dce2dc59f949/roles/690fc625fea1445fa7e0e8f40ae2246c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:15:01.539736 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c054b-9488-48cc-b1f5-87bc65caf905 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:01.555503 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:01.582833 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791947a-06ac-4ba8-a204-c2206d2d5ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:01.583952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791947a-06ac-4ba8-a204-c2206d2d5ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:01.584369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791947a-06ac-4ba8-a204-c2206d2d5ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:01.584815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791947a-06ac-4ba8-a204-c2206d2d5ea2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:01.605668 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791947a-06ac-4ba8-a204-c2206d2d5ea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:01.614054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-6791947a-06ac-4ba8-a204-c2206d2d5ea2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:15:01.614054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:01.614054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:01.614054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:01.614054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:01.614054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:01.614054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:01.614054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:01.614054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:01.614054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:01.614054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:01.614054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:01.614054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:01.614054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:01.614054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:01.614054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:01.615230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:01.615230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:01.615230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:01.615230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:01.615230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:01.615230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:01.615230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:01.615230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:01.615230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:01.615230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:01.615230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:01.615230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:01.615230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:01.615230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:01.615230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:01.615230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:01.616186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:01.616186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:01.616186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:01.616186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:01.616186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:01.616186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:01.616186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:01.616186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:01.616186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:01.616186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:01.616186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:15:01.616186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:01.618371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 199/390] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:01.624432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe38c44-9c48-41ee-8a9e-57cde90b3cbf None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:01.734785 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:01.764185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe38c44-9c48-41ee-8a9e-57cde90b3cbf None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:01.804200 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81e261-bc46-4cd1-8f01-c1aa34f378f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:01.804805 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81e261-bc46-4cd1-8f01-c1aa34f378f5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:01.805086 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81e261-bc46-4cd1-8f01-c1aa34f378f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:01.805362 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81e261-bc46-4cd1-8f01-c1aa34f378f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:01.806130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81e261-bc46-4cd1-8f01-c1aa34f378f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:01.806433 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81e261-bc46-4cd1-8f01-c1aa34f378f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:01.807905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81e261-bc46-4cd1-8f01-c1aa34f378f5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:01.820613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 192/391] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:15:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:01.826161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791947a-06ac-4ba8-a204-c2206d2d5ea2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:01.959103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791947a-06ac-4ba8-a204-c2206d2d5ea2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:01.994368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd7e63-6258-41c8-bf23-f674443afba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:01.995240 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd7e63-6258-41c8-bf23-f674443afba3 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:01.995520 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd7e63-6258-41c8-bf23-f674443afba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:01.995789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd7e63-6258-41c8-bf23-f674443afba3 None admin] PATH_INFO: `/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:01.997002 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd7e63-6258-41c8-bf23-f674443afba3 None admin] RBAC: Authorizing `identity:get_group(group_id=7a81fbd58cea4f1d87e8dce2dc59f949)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:01.998579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd7e63-6258-41c8-bf23-f674443afba3 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:02.000551 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 200/392] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 03:15:01 2022] GET /identity/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:02.006613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81e261-bc46-4cd1-8f01-c1aa34f378f5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:02.236386 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81e261-bc46-4cd1-8f01-c1aa34f378f5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:02.270838 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08f4d7-01d4-4af7-866e-b37197987c7c None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:02.271188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08f4d7-01d4-4af7-866e-b37197987c7c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:02.271403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08f4d7-01d4-4af7-866e-b37197987c7c None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:02.272815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 201/393] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:15:02.285142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ea38b-5d95-45e1-8b35-68c5805400fc None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:02.285427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ea38b-5d95-45e1-8b35-68c5805400fc None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:02.285707 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ea38b-5d95-45e1-8b35-68c5805400fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:02.305052 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ca057-b79d-492f-a37d-86574a887f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:02.306275 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ca057-b79d-492f-a37d-86574a887f27 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:02.306744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ca057-b79d-492f-a37d-86574a887f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:02.307206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ca057-b79d-492f-a37d-86574a887f27 None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:02.309713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ca057-b79d-492f-a37d-86574a887f27 None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:02.311541 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ca057-b79d-492f-a37d-86574a887f27 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:02.315675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 193/394] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:15:02 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:02.317796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a94ea38b-5d95-45e1-8b35-68c5805400fc None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:02.319177 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a94ea38b-5d95-45e1-8b35-68c5805400fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:02.321135 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ca057-b79d-492f-a37d-86574a887f27 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:02.336868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:02.372043 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:02.410356 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 202/395] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:02.437309 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ea38b-5d95-45e1-8b35-68c5805400fc None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:02.472671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ca057-b79d-492f-a37d-86574a887f27 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:02.569313 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2b035-50c3-4736-a760-193d803f2de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:02.569920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ea38b-5d95-45e1-8b35-68c5805400fc None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:02.570221 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2b035-50c3-4736-a760-193d803f2de3 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:02.570505 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2b035-50c3-4736-a760-193d803f2de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:02.570778 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2b035-50c3-4736-a760-193d803f2de3 None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1/groups/7a81fbd58cea4f1d87e8dce2dc59f949/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:02.576710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2b035-50c3-4736-a760-193d803f2de3 None admin] RBAC: Authorizing `identity:create_grant(project_id=62c99d0f651845d884f137c894087eb1, group_id=7a81fbd58cea4f1d87e8dce2dc59f949, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:02.578192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2b035-50c3-4736-a760-193d803f2de3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:02.602280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 194/396] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Jul 12 03:15:02 2022] PUT /identity/v3/projects/62c99d0f651845d884f137c894087eb1/groups/7a81fbd58cea4f1d87e8dce2dc59f949/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:15:02.618041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050c95d-f686-4506-9928-a57d2ecd4c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:02.618924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050c95d-f686-4506-9928-a57d2ecd4c77 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:02.619252 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050c95d-f686-4506-9928-a57d2ecd4c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:02.619531 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050c95d-f686-4506-9928-a57d2ecd4c77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:02.633346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050c95d-f686-4506-9928-a57d2ecd4c77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:02.641210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-a050c95d-f686-4506-9928-a57d2ecd4c77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:15:02.641210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:02.641210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:02.641210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:02.641210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:02.641210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:02.641210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:02.641210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:02.641210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:02.641210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:02.641210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:02.641210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:02.641210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:02.641210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:02.641210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:02.641210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:02.642104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:02.642104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:02.642104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:02.642104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:02.642104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:02.642104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:02.642104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:02.642104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:02.642104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:02.642104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:02.642104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:02.642104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:02.642104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:02.642104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:02.642104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:02.642104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:02.642862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:02.642862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:02.642862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:02.642862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:02.642862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:02.642862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:02.642862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:02.642862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:02.642862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:02.642862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:02.642862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:15:02.642862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:02.642862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 203/397] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:02.648872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2b035-50c3-4736-a760-193d803f2de3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:02.772914 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:02.819076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2b035-50c3-4736-a760-193d803f2de3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:02.871487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf92e7e-f334-451f-8562-c2e1ba717534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:02.872077 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf92e7e-f334-451f-8562-c2e1ba717534 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:02.872379 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf92e7e-f334-451f-8562-c2e1ba717534 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:02.872797 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf92e7e-f334-451f-8562-c2e1ba717534 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:02.873799 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf92e7e-f334-451f-8562-c2e1ba717534 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:02.874106 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf92e7e-f334-451f-8562-c2e1ba717534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:02.875520 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf92e7e-f334-451f-8562-c2e1ba717534 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:02.891288 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 195/398] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:15:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:02.896921 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050c95d-f686-4506-9928-a57d2ecd4c77 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:02.938920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:03.032733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050c95d-f686-4506-9928-a57d2ecd4c77 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:03.047927 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bf4a1-2a26-42d0-967d-9a530cc84580 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:03.048927 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bf4a1-2a26-42d0-967d-9a530cc84580 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:03.049395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bf4a1-2a26-42d0-967d-9a530cc84580 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:03.051215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 196/399] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:15:03.057349 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940011ec-9f1f-4c3c-88af-9afeadc47d11 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:03.057906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940011ec-9f1f-4c3c-88af-9afeadc47d11 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:03.058372 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940011ec-9f1f-4c3c-88af-9afeadc47d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:03.074163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae97d6-bacd-4abd-a1e3-bcbfff22fb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:03.075035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae97d6-bacd-4abd-a1e3-bcbfff22fb05 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:03.075303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae97d6-bacd-4abd-a1e3-bcbfff22fb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:03.075636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae97d6-bacd-4abd-a1e3-bcbfff22fb05 None admin] PATH_INFO: `/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:03.076982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae97d6-bacd-4abd-a1e3-bcbfff22fb05 None admin] RBAC: Authorizing `identity:get_group(group_id=7a81fbd58cea4f1d87e8dce2dc59f949)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:03.078580 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae97d6-bacd-4abd-a1e3-bcbfff22fb05 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:03.080555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 204/400] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 03:15:02 2022] GET /identity/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:03.092567 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae97d6-bacd-4abd-a1e3-bcbfff22fb05 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:03.098460 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-940011ec-9f1f-4c3c-88af-9afeadc47d11 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:03.099805 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-940011ec-9f1f-4c3c-88af-9afeadc47d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:03.177895 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 197/401] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:15:03.194752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:03.199149 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae97d6-bacd-4abd-a1e3-bcbfff22fb05 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:03.202646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940011ec-9f1f-4c3c-88af-9afeadc47d11 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:03.237392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa036b-c924-4394-8f80-518f2b8f26c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:03.238515 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa036b-c924-4394-8f80-518f2b8f26c2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:03.238936 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa036b-c924-4394-8f80-518f2b8f26c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:03.239372 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa036b-c924-4394-8f80-518f2b8f26c2 None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:03.240886 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa036b-c924-4394-8f80-518f2b8f26c2 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:03.242554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa036b-c924-4394-8f80-518f2b8f26c2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:03.244714 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 205/402] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:15:03 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:03.253586 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa036b-c924-4394-8f80-518f2b8f26c2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:03.266711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:03.315642 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940011ec-9f1f-4c3c-88af-9afeadc47d11 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:03.361129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3eb6b7-6e75-48eb-904f-6439bfb8373c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:03.362094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3eb6b7-6e75-48eb-904f-6439bfb8373c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:03.362483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3eb6b7-6e75-48eb-904f-6439bfb8373c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:03.362849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3eb6b7-6e75-48eb-904f-6439bfb8373c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:03.375681 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3eb6b7-6e75-48eb-904f-6439bfb8373c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:03.385152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-ee3eb6b7-6e75-48eb-904f-6439bfb8373c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:15:03.385152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:03.385152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:03.385152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:03.385152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:03.385152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:03.385152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:03.385152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:03.385152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:03.385152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:03.385152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:03.385152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:03.385152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:03.385152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:03.385152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:03.385152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:03.386094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:03.386094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:03.386094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:03.386094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:03.386094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:03.386094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:03.386094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:03.386094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:03.386094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:03.386094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:03.386094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:03.386094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:03.386094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:03.386094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:03.386094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:03.386094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:03.386891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:03.386891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:03.386891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:03.386891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:03.386891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:03.386891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:03.386891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:03.386891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:03.386891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:03.386891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:03.386891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:15:03.386891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:03.386891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 198/403] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:15:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:03.388081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a86511-58d7-4902-941b-c0476ba2b1ea None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:03.388363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a86511-58d7-4902-941b-c0476ba2b1ea None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:03.389331 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a86511-58d7-4902-941b-c0476ba2b1ea None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:03.390338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 199/404] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:03.395357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb829ca-7ddf-499f-addd-711e0db7d1f5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:03.395649 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb829ca-7ddf-499f-addd-711e0db7d1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:03.395929 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb829ca-7ddf-499f-addd-711e0db7d1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:03.399304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa036b-c924-4394-8f80-518f2b8f26c2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:03.415071 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2cb829ca-7ddf-499f-addd-711e0db7d1f5 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:03.416412 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2cb829ca-7ddf-499f-addd-711e0db7d1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:03.439281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b178950-2766-4d2c-a54b-19a4a630a479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:03.440190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b178950-2766-4d2c-a54b-19a4a630a479 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:03.440509 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b178950-2766-4d2c-a54b-19a4a630a479 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:03.440802 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b178950-2766-4d2c-a54b-19a4a630a479 None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a/groups/7a81fbd58cea4f1d87e8dce2dc59f949/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:03.442986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b178950-2766-4d2c-a54b-19a4a630a479 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a, group_id=7a81fbd58cea4f1d87e8dce2dc59f949, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:03.444572 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b178950-2766-4d2c-a54b-19a4a630a479 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:03.463793 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 206/405] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Jul 12 03:15:03 2022] PUT /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a/groups/7a81fbd58cea4f1d87e8dce2dc59f949/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:15:03.464745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b178950-2766-4d2c-a54b-19a4a630a479 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:03.528249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:03.545254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 200/406] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:03.567491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb829ca-7ddf-499f-addd-711e0db7d1f5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:03.657562 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:03.673906 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b178950-2766-4d2c-a54b-19a4a630a479 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:03.724216 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341384e0-fa53-4ce7-aa07-b9536f797218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:03.725422 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341384e0-fa53-4ce7-aa07-b9536f797218 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:03.725903 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341384e0-fa53-4ce7-aa07-b9536f797218 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:03.726370 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341384e0-fa53-4ce7-aa07-b9536f797218 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:03.727343 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341384e0-fa53-4ce7-aa07-b9536f797218 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:03.727817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb829ca-7ddf-499f-addd-711e0db7d1f5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:03.728039 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341384e0-fa53-4ce7-aa07-b9536f797218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:03.729776 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341384e0-fa53-4ce7-aa07-b9536f797218 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:03.741689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 207/407] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:03.747140 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341384e0-fa53-4ce7-aa07-b9536f797218 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:03.773848 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f8f2f-d166-4cc4-8396-8bba8454a7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:03.775168 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8f2f-d166-4cc4-8396-8bba8454a7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:03.775698 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8f2f-d166-4cc4-8396-8bba8454a7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:03.776170 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8f2f-d166-4cc4-8396-8bba8454a7c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:03.801488 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f8f2f-d166-4cc4-8396-8bba8454a7c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:03.809696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-506f8f2f-d166-4cc4-8396-8bba8454a7c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:15:03.809696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:03.809696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:03.809696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:03.809696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:03.809696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:03.809696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:03.809696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:03.809696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:03.809696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:03.809696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:03.809696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:03.809696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:03.809696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:03.809696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:03.809696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:03.810673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:03.810673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:03.810673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:03.810673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:03.810673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:03.810673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:03.810673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:03.810673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:03.810673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:03.810673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:03.810673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:03.810673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:03.810673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:03.810673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:03.810673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:03.810673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:03.811439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:03.811439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:03.811439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:03.811439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:03.811439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:03.811439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:03.811439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:03.811439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:03.811439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:03.811439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:03.811439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:15:03.811439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:03.811439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 201/408] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:15:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:03.817466 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f8f2f-d166-4cc4-8396-8bba8454a7c5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:03.845685 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:03.859647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341384e0-fa53-4ce7-aa07-b9536f797218 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:03.894751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78892c-4302-4b5a-a726-28849f261f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:03.896010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78892c-4302-4b5a-a726-28849f261f9c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:03.896504 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78892c-4302-4b5a-a726-28849f261f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:03.897040 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78892c-4302-4b5a-a726-28849f261f9c None admin] PATH_INFO: `/v3/groups/0ce23bbb1c8e4e3cb6505b448e2d1cbc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:03.898596 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78892c-4302-4b5a-a726-28849f261f9c None admin] RBAC: Authorizing `identity:get_group(group_id=0ce23bbb1c8e4e3cb6505b448e2d1cbc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:03.900451 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78892c-4302-4b5a-a726-28849f261f9c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:03.902706 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 208/409] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 03:15:03 2022] GET /identity/v3/groups/0ce23bbb1c8e4e3cb6505b448e2d1cbc => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:03.907853 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78892c-4302-4b5a-a726-28849f261f9c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:04.016015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f8f2f-d166-4cc4-8396-8bba8454a7c5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:04.026448 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:04.055076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249a4f2-25e8-461c-a7c3-f200b6ff2397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:04.056630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249a4f2-25e8-461c-a7c3-f200b6ff2397 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:04.057111 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249a4f2-25e8-461c-a7c3-f200b6ff2397 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:04.057610 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249a4f2-25e8-461c-a7c3-f200b6ff2397 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:04.059077 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249a4f2-25e8-461c-a7c3-f200b6ff2397 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:04.059598 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249a4f2-25e8-461c-a7c3-f200b6ff2397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:04.061423 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249a4f2-25e8-461c-a7c3-f200b6ff2397 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:04.070894 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 202/410] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:04.082551 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249a4f2-25e8-461c-a7c3-f200b6ff2397 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:04.112383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78892c-4302-4b5a-a726-28849f261f9c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:04.157197 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006befa1-4af0-44ad-8dd7-a82fec29838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:04.158344 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006befa1-4af0-44ad-8dd7-a82fec29838c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:04.158633 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006befa1-4af0-44ad-8dd7-a82fec29838c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:04.159485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006befa1-4af0-44ad-8dd7-a82fec29838c None admin] PATH_INFO: `/v3/projects/75f65be69d944055b21e27b7afc48f60` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:04.161161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006befa1-4af0-44ad-8dd7-a82fec29838c None admin] RBAC: Authorizing `identity:get_project(project_id=75f65be69d944055b21e27b7afc48f60)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:04.163918 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006befa1-4af0-44ad-8dd7-a82fec29838c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:04.166026 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 209/411] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:15:03 2022] GET /identity/v3/projects/75f65be69d944055b21e27b7afc48f60 => generated 344 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:04.167277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edec09-daf2-4572-96a5-0cfe189e65d7 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:04.167552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edec09-daf2-4572-96a5-0cfe189e65d7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:04.167827 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edec09-daf2-4572-96a5-0cfe189e65d7 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:04.169766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 210/412] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:04.175043 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edec09-daf2-4572-96a5-0cfe189e65d7 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:04.204914 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:04.212479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249a4f2-25e8-461c-a7c3-f200b6ff2397 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:04.246213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a615982-55f2-4711-a3e1-7e877fb6c31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:04.247075 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a615982-55f2-4711-a3e1-7e877fb6c31d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:04.247457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a615982-55f2-4711-a3e1-7e877fb6c31d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:04.247968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a615982-55f2-4711-a3e1-7e877fb6c31d None admin] PATH_INFO: `/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:04.249565 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a615982-55f2-4711-a3e1-7e877fb6c31d None admin] RBAC: Authorizing `identity:get_group(group_id=7a81fbd58cea4f1d87e8dce2dc59f949)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:04.251113 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a615982-55f2-4711-a3e1-7e877fb6c31d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:04.253178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 203/413] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 03:15:04 2022] GET /identity/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:04.254342 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43343224-107f-4916-964e-e12249b23297 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:04.254619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43343224-107f-4916-964e-e12249b23297 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:04.254890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43343224-107f-4916-964e-e12249b23297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:04.278465 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-43343224-107f-4916-964e-e12249b23297 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:04.279628 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-43343224-107f-4916-964e-e12249b23297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:04.301831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edec09-daf2-4572-96a5-0cfe189e65d7 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:04.319194 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:04.342786 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db356c-773a-40b1-8882-9a18fc44f609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:04.343862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db356c-773a-40b1-8882-9a18fc44f609 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:04.344207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db356c-773a-40b1-8882-9a18fc44f609 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:04.344605 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db356c-773a-40b1-8882-9a18fc44f609 None admin] PATH_INFO: `/v3/projects/75f65be69d944055b21e27b7afc48f60/groups/0ce23bbb1c8e4e3cb6505b448e2d1cbc/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:04.346896 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db356c-773a-40b1-8882-9a18fc44f609 None admin] RBAC: Authorizing `identity:create_grant(project_id=75f65be69d944055b21e27b7afc48f60, group_id=0ce23bbb1c8e4e3cb6505b448e2d1cbc, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:04.348788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db356c-773a-40b1-8882-9a18fc44f609 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:04.368616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 211/414] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Jul 12 03:15:04 2022] PUT /identity/v3/projects/75f65be69d944055b21e27b7afc48f60/groups/0ce23bbb1c8e4e3cb6505b448e2d1cbc/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:15:04.369458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db356c-773a-40b1-8882-9a18fc44f609 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:04.378762 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 204/415] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:04.408391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43343224-107f-4916-964e-e12249b23297 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:04.533474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43343224-107f-4916-964e-e12249b23297 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:04.574904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916de88-0130-48fe-be5c-6bdaca1093e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:04.577003 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916de88-0130-48fe-be5c-6bdaca1093e0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:04.577465 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916de88-0130-48fe-be5c-6bdaca1093e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:04.577898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916de88-0130-48fe-be5c-6bdaca1093e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:04.592644 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916de88-0130-48fe-be5c-6bdaca1093e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:04.602645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e916de88-0130-48fe-be5c-6bdaca1093e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:15:04.602645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:04.602645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:04.602645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:04.602645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:04.602645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:04.602645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:04.602645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:04.602645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:04.602645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:04.602645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:04.602645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:04.602645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:04.602645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:04.602645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:04.602645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:04.603619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:04.603619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:04.603619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:04.603619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:04.603619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:04.603619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:04.603619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:04.603619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:04.603619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:04.603619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:04.603619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:04.603619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:04.603619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:04.603619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:04.603619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:04.603619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:04.604391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:04.604391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:04.604391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:04.604391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:04.604391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:04.604391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:04.604391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:04.604391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:04.604391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:04.604391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:04.604391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:15:04.604391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:04.605116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:04.612665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 205/416] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:15:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:04.617197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916de88-0130-48fe-be5c-6bdaca1093e0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:04.632784 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db356c-773a-40b1-8882-9a18fc44f609 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:04.649078 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:04.668504 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdb09e-101a-42ad-91fe-6eb282279f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:04.670190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdb09e-101a-42ad-91fe-6eb282279f49 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:04.670675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdb09e-101a-42ad-91fe-6eb282279f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:04.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdb09e-101a-42ad-91fe-6eb282279f49 None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:04.672570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdb09e-101a-42ad-91fe-6eb282279f49 None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:04.674226 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdb09e-101a-42ad-91fe-6eb282279f49 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:04.676504 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 212/417] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:15:04 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:04.682115 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdb09e-101a-42ad-91fe-6eb282279f49 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:04.729897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916de88-0130-48fe-be5c-6bdaca1093e0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:04.765582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894de102-31d4-4668-9659-e895afabfec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:04.766263 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894de102-31d4-4668-9659-e895afabfec3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:04.766536 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894de102-31d4-4668-9659-e895afabfec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:04.766804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894de102-31d4-4668-9659-e895afabfec3 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:04.767563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894de102-31d4-4668-9659-e895afabfec3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:04.767961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894de102-31d4-4668-9659-e895afabfec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:04.769377 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894de102-31d4-4668-9659-e895afabfec3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:04.780859 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 206/418] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:04.786566 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894de102-31d4-4668-9659-e895afabfec3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:04.793665 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdb09e-101a-42ad-91fe-6eb282279f49 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:04.831594 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263c684-2975-43a2-a845-9771bd9a5207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:04.832605 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263c684-2975-43a2-a845-9771bd9a5207 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:04.832885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263c684-2975-43a2-a845-9771bd9a5207 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:04.833154 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263c684-2975-43a2-a845-9771bd9a5207 None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1/groups/7a81fbd58cea4f1d87e8dce2dc59f949/roles/690fc625fea1445fa7e0e8f40ae2246c` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:04.835575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263c684-2975-43a2-a845-9771bd9a5207 None admin] RBAC: Authorizing `identity:create_grant(project_id=62c99d0f651845d884f137c894087eb1, group_id=7a81fbd58cea4f1d87e8dce2dc59f949, role_id=690fc625fea1445fa7e0e8f40ae2246c)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:04.837115 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263c684-2975-43a2-a845-9771bd9a5207 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:04.854279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 213/419] 10.222.0.26 () {58 vars in 1442 bytes} [Tue Jul 12 03:15:04 2022] PUT /identity/v3/projects/62c99d0f651845d884f137c894087eb1/groups/7a81fbd58cea4f1d87e8dce2dc59f949/roles/690fc625fea1445fa7e0e8f40ae2246c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:15:04.892901 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:04.901247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894de102-31d4-4668-9659-e895afabfec3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:04.940256 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9c0d7-01de-4381-9aec-9712352ce406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:04.940954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9c0d7-01de-4381-9aec-9712352ce406 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:04.941234 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9c0d7-01de-4381-9aec-9712352ce406 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:04.941503 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9c0d7-01de-4381-9aec-9712352ce406 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:05.016254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9c0d7-01de-4381-9aec-9712352ce406 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:05.017785 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9c0d7-01de-4381-9aec-9712352ce406 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:05.113369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:05.126824 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 207/420] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 03:15:05.132512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263c684-2975-43a2-a845-9771bd9a5207 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:05.149957 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:05.258528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263c684-2975-43a2-a845-9771bd9a5207 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:05.295122 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b3a10-a541-459f-92c9-ebd59a0c0665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:05.296012 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b3a10-a541-459f-92c9-ebd59a0c0665 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:05.296290 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b3a10-a541-459f-92c9-ebd59a0c0665 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:05.296580 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b3a10-a541-459f-92c9-ebd59a0c0665 None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:05.297755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b3a10-a541-459f-92c9-ebd59a0c0665 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:05.299193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b3a10-a541-459f-92c9-ebd59a0c0665 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:05.301242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 214/421] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:15:05 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:05.306812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9c0d7-01de-4381-9aec-9712352ce406 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:05.387190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e55f84-2adc-4d2e-ae10-da9597ad94e8 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:05.387485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e55f84-2adc-4d2e-ae10-da9597ad94e8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:05.387659 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e55f84-2adc-4d2e-ae10-da9597ad94e8 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:05.389703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 215/422] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:05.394673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fe2c0-634e-4939-a252-0778ccc11f86 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:05.394957 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fe2c0-634e-4939-a252-0778ccc11f86 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:05.395229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fe2c0-634e-4939-a252-0778ccc11f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:05.412438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2d3fe2c0-634e-4939-a252-0778ccc11f86 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:05.413662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2d3fe2c0-634e-4939-a252-0778ccc11f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:05.439299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9c0d7-01de-4381-9aec-9712352ce406 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:05.508006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98939a33-3676-4a04-aff7-6ee59b20b846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:05.509048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98939a33-3676-4a04-aff7-6ee59b20b846 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:05.509387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98939a33-3676-4a04-aff7-6ee59b20b846 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:05.509726 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98939a33-3676-4a04-aff7-6ee59b20b846 None admin] PATH_INFO: `/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:05.511585 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98939a33-3676-4a04-aff7-6ee59b20b846 None admin] RBAC: Authorizing `identity:get_group(group_id=7a81fbd58cea4f1d87e8dce2dc59f949)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:05.513299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98939a33-3676-4a04-aff7-6ee59b20b846 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:05.514959 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 208/423] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 03:15:05 2022] GET /identity/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:05.520570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98939a33-3676-4a04-aff7-6ee59b20b846 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:05.526050 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 216/424] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:05.556979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fe2c0-634e-4939-a252-0778ccc11f86 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:05.573110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:05.624888 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:05.673718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fe2c0-634e-4939-a252-0778ccc11f86 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:05.703737 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98939a33-3676-4a04-aff7-6ee59b20b846 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:05.734462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eebe9a-58b7-47b5-8204-d7ebcb85a84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:05.735269 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eebe9a-58b7-47b5-8204-d7ebcb85a84f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:05.735546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eebe9a-58b7-47b5-8204-d7ebcb85a84f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:05.735816 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eebe9a-58b7-47b5-8204-d7ebcb85a84f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:05.762438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eebe9a-58b7-47b5-8204-d7ebcb85a84f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:05.770916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-81eebe9a-58b7-47b5-8204-d7ebcb85a84f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:15:05.770916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:05.770916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:05.770916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:05.770916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:05.770916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:05.770916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:05.770916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:05.770916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:05.770916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:05.770916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:05.770916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:05.770916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:05.770916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:05.770916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:05.770916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:05.771795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:05.771795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:05.771795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:05.771795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:05.771795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:05.771795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:05.771795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:05.771795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:05.771795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:05.771795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:05.771795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:05.771795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:05.771795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:05.771795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:05.771795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:05.771795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:05.772637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:05.772637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:05.772637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:05.772637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:05.772637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:05.772637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:05.772637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:05.772637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:05.772637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:05.772637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:05.772637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:15:05.772637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:05.777147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da649727-c6b4-4b9c-8fe5-2294f7128e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:05.777744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da649727-c6b4-4b9c-8fe5-2294f7128e73 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:05.778018 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da649727-c6b4-4b9c-8fe5-2294f7128e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:05.778284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da649727-c6b4-4b9c-8fe5-2294f7128e73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:05.779727 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da649727-c6b4-4b9c-8fe5-2294f7128e73 None admin] RBAC: Adding query filter params (group.id=7a81fbd58cea4f1d87e8dce2dc59f949, role.id=690fc625fea1445fa7e0e8f40ae2246c, scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:05.780035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da649727-c6b4-4b9c-8fe5-2294f7128e73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:05.781509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da649727-c6b4-4b9c-8fe5-2294f7128e73 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:05.783748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 217/425] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:05.784674 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eebe9a-58b7-47b5-8204-d7ebcb85a84f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:05.797370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 209/426] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 03:15:05 2022] GET /identity/v3/role_assignments?group.id=7a81fbd58cea4f1d87e8dce2dc59f949&scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a&role.id=690fc625fea1445fa7e0e8f40ae2246c => generated 611 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:05.892677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:05.942201 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eebe9a-58b7-47b5-8204-d7ebcb85a84f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:05.987081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf482e0-390a-4498-84c6-22cf6ddb1315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:05.987759 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf482e0-390a-4498-84c6-22cf6ddb1315 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:05.988036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf482e0-390a-4498-84c6-22cf6ddb1315 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:05.988304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf482e0-390a-4498-84c6-22cf6ddb1315 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:05.989082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf482e0-390a-4498-84c6-22cf6ddb1315 None admin] RBAC: Adding query filter params (name=member) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:05.989385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf482e0-390a-4498-84c6-22cf6ddb1315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:05.990758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf482e0-390a-4498-84c6-22cf6ddb1315 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:06.004701 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 218/427] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:15:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:06.006190 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ae3cd-51b6-43c3-a6eb-7d42be33ea72 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:06.006470 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ae3cd-51b6-43c3-a6eb-7d42be33ea72 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:06.006738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ae3cd-51b6-43c3-a6eb-7d42be33ea72 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:06.008207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 210/428] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:06.010824 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf482e0-390a-4498-84c6-22cf6ddb1315 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:06.014105 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8858cf3-6ac9-4b6b-babe-c96b866d8f11 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:06.014648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8858cf3-6ac9-4b6b-babe-c96b866d8f11 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:06.015122 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8858cf3-6ac9-4b6b-babe-c96b866d8f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:06.033245 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a8858cf3-6ac9-4b6b-babe-c96b866d8f11 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:06.034849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a8858cf3-6ac9-4b6b-babe-c96b866d8f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:06.146638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 211/429] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:15:06.175053 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8858cf3-6ac9-4b6b-babe-c96b866d8f11 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:06.176008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf482e0-390a-4498-84c6-22cf6ddb1315 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:06.210036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:06.215383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427181c4-4bb8-467d-85a8-2fd6f761fc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:06.216586 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427181c4-4bb8-467d-85a8-2fd6f761fc41 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:06.217198 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427181c4-4bb8-467d-85a8-2fd6f761fc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:06.217781 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427181c4-4bb8-467d-85a8-2fd6f761fc41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:06.252797 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:06.312250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8858cf3-6ac9-4b6b-babe-c96b866d8f11 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:06.313816 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427181c4-4bb8-467d-85a8-2fd6f761fc41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:06.316361 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427181c4-4bb8-467d-85a8-2fd6f761fc41 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:06.355648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952cc53-aaa0-4cc6-9c09-65f03e8afff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:06.356694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952cc53-aaa0-4cc6-9c09-65f03e8afff8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:06.357173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952cc53-aaa0-4cc6-9c09-65f03e8afff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:06.357763 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952cc53-aaa0-4cc6-9c09-65f03e8afff8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:06.379702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952cc53-aaa0-4cc6-9c09-65f03e8afff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:06.389884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-5952cc53-aaa0-4cc6-9c09-65f03e8afff8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:15:06.389884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:06.389884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:06.389884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:06.389884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:06.389884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:06.389884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:06.389884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:06.389884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:06.389884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:06.389884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:06.389884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:06.389884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:06.389884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:06.389884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:06.389884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:06.390812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:06.390812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:06.390812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:06.390812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:06.390812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:06.390812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:06.390812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:06.390812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:06.390812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:06.390812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:06.390812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:06.390812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:06.390812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:06.390812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:06.390812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:06.390812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:06.391587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:06.391587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:06.391587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:06.391587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:06.391587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:06.391587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:06.391587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:06.391587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:06.391587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:06.391587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:06.391587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 03:15:06.391587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:06.399514 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 212/430] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:06.401416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952cc53-aaa0-4cc6-9c09-65f03e8afff8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:06.442604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 219/431] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:15:06.449832 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427181c4-4bb8-467d-85a8-2fd6f761fc41 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:06.484333 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:06.534564 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952cc53-aaa0-4cc6-9c09-65f03e8afff8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:06.552432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:06.564672 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427181c4-4bb8-467d-85a8-2fd6f761fc41 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:06.581942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad5f89-721f-4384-8880-209cf8dbe468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:06.583053 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad5f89-721f-4384-8880-209cf8dbe468 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:06.583834 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad5f89-721f-4384-8880-209cf8dbe468 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:06.584277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad5f89-721f-4384-8880-209cf8dbe468 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:06.585231 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad5f89-721f-4384-8880-209cf8dbe468 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:06.585671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad5f89-721f-4384-8880-209cf8dbe468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:06.587704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad5f89-721f-4384-8880-209cf8dbe468 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:06.600159 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 213/432] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:15:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:06.601687 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280328e-be71-4fb2-8233-aff8910dae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:06.602631 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280328e-be71-4fb2-8233-aff8910dae7d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:06.602968 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280328e-be71-4fb2-8233-aff8910dae7d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:06.603299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280328e-be71-4fb2-8233-aff8910dae7d None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:06.604604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280328e-be71-4fb2-8233-aff8910dae7d None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:06.605671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad5f89-721f-4384-8880-209cf8dbe468 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:06.606167 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280328e-be71-4fb2-8233-aff8910dae7d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:06.608313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 220/433] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:15:06 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:06.614449 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280328e-be71-4fb2-8233-aff8910dae7d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:06.726559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad5f89-721f-4384-8880-209cf8dbe468 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:06.743848 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:06.748941 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280328e-be71-4fb2-8233-aff8910dae7d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:06.771791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722252f-6b25-4394-b9e0-1c66604261d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:06.772762 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722252f-6b25-4394-b9e0-1c66604261d2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:06.773459 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722252f-6b25-4394-b9e0-1c66604261d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:06.773870 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722252f-6b25-4394-b9e0-1c66604261d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:06.789296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a2724-57f6-482c-96cd-8121d63db082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:06.790291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a2724-57f6-482c-96cd-8121d63db082 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:06.790664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a2724-57f6-482c-96cd-8121d63db082 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:06.791024 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a2724-57f6-482c-96cd-8121d63db082 None admin] PATH_INFO: `/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:06.792304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a2724-57f6-482c-96cd-8121d63db082 None admin] RBAC: Authorizing `identity:get_group(group_id=7a81fbd58cea4f1d87e8dce2dc59f949)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:06.793918 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a2724-57f6-482c-96cd-8121d63db082 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:06.795926 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 221/434] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 03:15:06 2022] GET /identity/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:06.801469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a2724-57f6-482c-96cd-8121d63db082 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:06.829439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:06.857966 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722252f-6b25-4394-b9e0-1c66604261d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:06.859752 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722252f-6b25-4394-b9e0-1c66604261d2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:06.918521 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a2724-57f6-482c-96cd-8121d63db082 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:06.956651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427f471-6cb2-44db-b2d4-8cb0ec012610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:06.957413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427f471-6cb2-44db-b2d4-8cb0ec012610 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:06.957641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427f471-6cb2-44db-b2d4-8cb0ec012610 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:06.957916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427f471-6cb2-44db-b2d4-8cb0ec012610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:06.958876 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427f471-6cb2-44db-b2d4-8cb0ec012610 None admin] RBAC: Adding query filter params (group.id=7a81fbd58cea4f1d87e8dce2dc59f949, role.id=713f175e9435403f9e39528c805bd956, scope.project.id=62c99d0f651845d884f137c894087eb1) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:06.959314 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427f471-6cb2-44db-b2d4-8cb0ec012610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:06.960845 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427f471-6cb2-44db-b2d4-8cb0ec012610 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:06.962520 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 214/435] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 03:15:06.963838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009d8b3-0de0-49b6-9898-6bde21f8796e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:06.964122 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009d8b3-0de0-49b6-9898-6bde21f8796e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:06.964387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009d8b3-0de0-49b6-9898-6bde21f8796e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:06.965787 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 215/436] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:06.968100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 222/437] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 03:15:06 2022] GET /identity/v3/role_assignments?group.id=7a81fbd58cea4f1d87e8dce2dc59f949&scope.project.id=62c99d0f651845d884f137c894087eb1&role.id=713f175e9435403f9e39528c805bd956 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:06.974178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009d8b3-0de0-49b6-9898-6bde21f8796e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:06.974709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b928232-ba22-418e-8a45-5c16ffff3ecb None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:06.975009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b928232-ba22-418e-8a45-5c16ffff3ecb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:06.975369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b928232-ba22-418e-8a45-5c16ffff3ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:06.992856 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5b928232-ba22-418e-8a45-5c16ffff3ecb None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:06.994125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5b928232-ba22-418e-8a45-5c16ffff3ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:07.029142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:07.085797 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:07.089212 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 223/438] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:07.108712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b928232-ba22-418e-8a45-5c16ffff3ecb None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:07.127960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009d8b3-0de0-49b6-9898-6bde21f8796e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:07.172239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb456bb6-b6d5-4595-bb36-c9253ad9b4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:07.173307 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb456bb6-b6d5-4595-bb36-c9253ad9b4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:07.173588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb456bb6-b6d5-4595-bb36-c9253ad9b4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:07.173864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb456bb6-b6d5-4595-bb36-c9253ad9b4b2 None admin] PATH_INFO: `/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:07.175097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb456bb6-b6d5-4595-bb36-c9253ad9b4b2 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad8e30c96fe410daf6f3b7e3803ed8a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:07.176586 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb456bb6-b6d5-4595-bb36-c9253ad9b4b2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:07.178312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 216/439] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:15:06 2022] GET /identity/v3/projects/2ad8e30c96fe410daf6f3b7e3803ed8a => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:07.185471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb456bb6-b6d5-4595-bb36-c9253ad9b4b2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:07.235607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b928232-ba22-418e-8a45-5c16ffff3ecb None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:07.270771 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43575f58-f94e-4564-b429-69105ffe9139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:07.271490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43575f58-f94e-4564-b429-69105ffe9139 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:07.271767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43575f58-f94e-4564-b429-69105ffe9139 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:07.272035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43575f58-f94e-4564-b429-69105ffe9139 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:07.283853 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43575f58-f94e-4564-b429-69105ffe9139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:07.292382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-43575f58-f94e-4564-b429-69105ffe9139 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:15:07.292382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:07.292382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:07.292382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:07.292382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:07.292382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:07.292382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:07.292382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:07.292382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:07.292382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:07.292382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:07.292382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:07.292382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:07.292382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:07.292382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:07.292382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:07.293285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:07.293285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:07.293285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:07.293285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:07.293285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:07.293285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:07.293285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:07.293285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:07.293285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:07.293285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:07.293285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:07.293285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:07.293285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:07.293285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:07.293285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:07.293285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:07.294132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:07.294132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:07.294132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:07.294132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:07.294132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:07.294132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:07.294132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:07.294132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:07.294132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:07.294132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:07.294132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:15:07.294132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:07.294132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 224/440] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:15:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:07.299621 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43575f58-f94e-4564-b429-69105ffe9139 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:07.301496 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb456bb6-b6d5-4595-bb36-c9253ad9b4b2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:07.326724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:07.339318 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b516736-895a-4d98-92e8-c8eb00899405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:07.340350 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b516736-895a-4d98-92e8-c8eb00899405 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:07.340661 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b516736-895a-4d98-92e8-c8eb00899405 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:07.340989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b516736-895a-4d98-92e8-c8eb00899405 None admin] PATH_INFO: `/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:07.342294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b516736-895a-4d98-92e8-c8eb00899405 None admin] RBAC: Authorizing `identity:get_group(group_id=7a81fbd58cea4f1d87e8dce2dc59f949)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:07.343740 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b516736-895a-4d98-92e8-c8eb00899405 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:07.345747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 217/441] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 03:15:07 2022] GET /identity/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:07.351532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b516736-895a-4d98-92e8-c8eb00899405 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:07.364868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:07.414937 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43575f58-f94e-4564-b429-69105ffe9139 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:07.449698 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5389e-b94a-465b-b193-684b58b599de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:07.450525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5389e-b94a-465b-b193-684b58b599de None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:07.450807 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5389e-b94a-465b-b193-684b58b599de None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:07.451092 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5389e-b94a-465b-b193-684b58b599de None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:07.451905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5389e-b94a-465b-b193-684b58b599de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:07.452253 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5389e-b94a-465b-b193-684b58b599de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:07.453709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5389e-b94a-465b-b193-684b58b599de None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:07.454652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b516736-895a-4d98-92e8-c8eb00899405 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:07.462151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 225/442] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:07.463367 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7689ba0-7a8d-4755-9e3c-943c36f2ead7 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:07.463656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7689ba0-7a8d-4755-9e3c-943c36f2ead7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:07.463933 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7689ba0-7a8d-4755-9e3c-943c36f2ead7 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:07.468570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 226/443] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:07.468570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7689ba0-7a8d-4755-9e3c-943c36f2ead7 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:07.491753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2179bf9-eda5-46da-b24e-a96b45639a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:07.492409 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2179bf9-eda5-46da-b24e-a96b45639a14 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:07.492725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2179bf9-eda5-46da-b24e-a96b45639a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:07.492993 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2179bf9-eda5-46da-b24e-a96b45639a14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:07.494683 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2179bf9-eda5-46da-b24e-a96b45639a14 None admin] RBAC: Adding query filter params (group.id=7a81fbd58cea4f1d87e8dce2dc59f949, role.id=713f175e9435403f9e39528c805bd956, scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:07.495005 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2179bf9-eda5-46da-b24e-a96b45639a14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:07.496440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2179bf9-eda5-46da-b24e-a96b45639a14 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:07.503490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 218/444] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 03:15:07 2022] GET /identity/v3/role_assignments?group.id=7a81fbd58cea4f1d87e8dce2dc59f949&scope.project.id=2ad8e30c96fe410daf6f3b7e3803ed8a&role.id=713f175e9435403f9e39528c805bd956 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:07.505061 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24f4dc-863b-4698-bd33-e2e22600fdbd None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:07.505592 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24f4dc-863b-4698-bd33-e2e22600fdbd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:07.505984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24f4dc-863b-4698-bd33-e2e22600fdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:07.524091 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0d24f4dc-863b-4698-bd33-e2e22600fdbd None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:07.525271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0d24f4dc-863b-4698-bd33-e2e22600fdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:07.571894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:07.592327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7689ba0-7a8d-4755-9e3c-943c36f2ead7 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:07.604605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 219/445] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:07.627823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24f4dc-863b-4698-bd33-e2e22600fdbd None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:07.629730 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296843b8-2fa4-4a8b-b47a-6be13666d0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:07.630518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296843b8-2fa4-4a8b-b47a-6be13666d0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:07.630829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296843b8-2fa4-4a8b-b47a-6be13666d0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:07.631116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:07.631753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296843b8-2fa4-4a8b-b47a-6be13666d0d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:07.715833 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296843b8-2fa4-4a8b-b47a-6be13666d0d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:07.717380 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296843b8-2fa4-4a8b-b47a-6be13666d0d7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:07.751450 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24f4dc-863b-4698-bd33-e2e22600fdbd None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:07.792112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc501172-e6a3-434e-a900-62777499375b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:07.792870 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc501172-e6a3-434e-a900-62777499375b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:07.793147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc501172-e6a3-434e-a900-62777499375b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:07.793415 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc501172-e6a3-434e-a900-62777499375b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:07.808713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc501172-e6a3-434e-a900-62777499375b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:07.815436 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:07.819987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-bc501172-e6a3-434e-a900-62777499375b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:15:07.819987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:07.819987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:07.819987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:07.819987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:07.819987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:07.819987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:07.819987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:07.819987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:07.819987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:07.819987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:07.819987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:07.819987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:07.819987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:07.819987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:07.819987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:07.820928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:07.820928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:07.820928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:07.820928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:07.820928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:07.820928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:07.820928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:07.820928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:07.820928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:07.820928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:07.820928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:07.820928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:07.820928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:07.820928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:07.820928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:07.820928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:07.821736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:07.821736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:07.821736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:07.821736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:07.821736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:07.821736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:07.821736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:07.821736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:07.821736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:07.821736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:07.821736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:15:07.821736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:07.822517 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 220/446] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:15:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:07.828990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc501172-e6a3-434e-a900-62777499375b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:07.830635 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 227/447] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 03:15:07.836300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296843b8-2fa4-4a8b-b47a-6be13666d0d7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:07.900009 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:07.949243 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc501172-e6a3-434e-a900-62777499375b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:07.952122 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296843b8-2fa4-4a8b-b47a-6be13666d0d7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:07.989516 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caf422-21e5-46c7-abbb-0f85ef4d61e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:07.989750 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f6d93-0bb4-4e8f-939f-fddcb0036efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:07.990266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caf422-21e5-46c7-abbb-0f85ef4d61e4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:07.990398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f6d93-0bb4-4e8f-939f-fddcb0036efb None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:07.990561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caf422-21e5-46c7-abbb-0f85ef4d61e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:07.990656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f6d93-0bb4-4e8f-939f-fddcb0036efb None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:07.990829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caf422-21e5-46c7-abbb-0f85ef4d61e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:07.990941 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f6d93-0bb4-4e8f-939f-fddcb0036efb None admin] PATH_INFO: `/v3/projects/75f65be69d944055b21e27b7afc48f60` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:07.991563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12caf422-21e5-46c7-abbb-0f85ef4d61e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:07.991868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12caf422-21e5-46c7-abbb-0f85ef4d61e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:07.992142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f6d93-0bb4-4e8f-939f-fddcb0036efb None admin] RBAC: Authorizing `identity:get_project(project_id=75f65be69d944055b21e27b7afc48f60)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:07.993466 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12caf422-21e5-46c7-abbb-0f85ef4d61e4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:07.993687 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f6d93-0bb4-4e8f-939f-fddcb0036efb None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:07.995791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 228/448] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:15:07 2022] GET /identity/v3/projects/75f65be69d944055b21e27b7afc48f60 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:08.001243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f6d93-0bb4-4e8f-939f-fddcb0036efb None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:08.005823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 221/449] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:08.013175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caf422-21e5-46c7-abbb-0f85ef4d61e4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:08.065369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:08.120887 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f6d93-0bb4-4e8f-939f-fddcb0036efb None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:08.138366 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caf422-21e5-46c7-abbb-0f85ef4d61e4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:08.163154 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779538d-b9c5-41db-8116-bdce0c12bfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:08.164022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779538d-b9c5-41db-8116-bdce0c12bfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:08.164298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779538d-b9c5-41db-8116-bdce0c12bfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:08.164588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779538d-b9c5-41db-8116-bdce0c12bfc2 None admin] PATH_INFO: `/v3/groups/0ce23bbb1c8e4e3cb6505b448e2d1cbc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:08.165769 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779538d-b9c5-41db-8116-bdce0c12bfc2 None admin] RBAC: Authorizing `identity:get_group(group_id=0ce23bbb1c8e4e3cb6505b448e2d1cbc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:08.167356 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779538d-b9c5-41db-8116-bdce0c12bfc2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:08.169495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 229/450] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 03:15:08 2022] GET /identity/v3/groups/0ce23bbb1c8e4e3cb6505b448e2d1cbc => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:08.170291 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:08.175657 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779538d-b9c5-41db-8116-bdce0c12bfc2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:08.183737 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631577ab-b0c4-4f64-b1b3-8b11ac1b6610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:08.184400 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631577ab-b0c4-4f64-b1b3-8b11ac1b6610 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:08.184795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631577ab-b0c4-4f64-b1b3-8b11ac1b6610 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:08.185073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631577ab-b0c4-4f64-b1b3-8b11ac1b6610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:08.252669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631577ab-b0c4-4f64-b1b3-8b11ac1b6610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:08.254383 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631577ab-b0c4-4f64-b1b3-8b11ac1b6610 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:08.276552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779538d-b9c5-41db-8116-bdce0c12bfc2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:08.297565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:08.311887 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8bc67-c1e6-4f83-a409-3b3a8a910b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:08.312557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8bc67-c1e6-4f83-a409-3b3a8a910b4d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:08.312838 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8bc67-c1e6-4f83-a409-3b3a8a910b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:08.313102 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8bc67-c1e6-4f83-a409-3b3a8a910b4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:08.313931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8bc67-c1e6-4f83-a409-3b3a8a910b4d None admin] RBAC: Adding query filter params (group.id=0ce23bbb1c8e4e3cb6505b448e2d1cbc, role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=75f65be69d944055b21e27b7afc48f60) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:08.314229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8bc67-c1e6-4f83-a409-3b3a8a910b4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:08.315717 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8bc67-c1e6-4f83-a409-3b3a8a910b4d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:08.321670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 230/451] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 03:15:08 2022] GET /identity/v3/role_assignments?group.id=0ce23bbb1c8e4e3cb6505b448e2d1cbc&scope.project.id=75f65be69d944055b21e27b7afc48f60&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:08.353489 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 222/452] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 03:15:08.359387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8bc67-c1e6-4f83-a409-3b3a8a910b4d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:08.465843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8bc67-c1e6-4f83-a409-3b3a8a910b4d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:08.509911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f009fb0-6400-4d2a-98ec-666a34d635e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:08.510795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f009fb0-6400-4d2a-98ec-666a34d635e8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:08.511073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f009fb0-6400-4d2a-98ec-666a34d635e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:08.511345 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f009fb0-6400-4d2a-98ec-666a34d635e8 None admin] PATH_INFO: `/v3/projects/62c99d0f651845d884f137c894087eb1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:08.512596 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f009fb0-6400-4d2a-98ec-666a34d635e8 None admin] RBAC: Authorizing `identity:get_project(project_id=62c99d0f651845d884f137c894087eb1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:08.514112 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f009fb0-6400-4d2a-98ec-666a34d635e8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:08.516005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 231/453] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:15:08 2022] GET /identity/v3/projects/62c99d0f651845d884f137c894087eb1 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:08.521662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631577ab-b0c4-4f64-b1b3-8b11ac1b6610 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:08.552021 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:08.629028 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631577ab-b0c4-4f64-b1b3-8b11ac1b6610 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:08.667370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052a144-7745-4e61-ae6c-cc8956418fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:08.668224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052a144-7745-4e61-ae6c-cc8956418fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:08.668501 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052a144-7745-4e61-ae6c-cc8956418fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:08.668801 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052a144-7745-4e61-ae6c-cc8956418fc6 None admin] PATH_INFO: `/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:08.670221 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052a144-7745-4e61-ae6c-cc8956418fc6 None admin] RBAC: Authorizing `identity:get_group(group_id=7a81fbd58cea4f1d87e8dce2dc59f949)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:08.671694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052a144-7745-4e61-ae6c-cc8956418fc6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:08.673343 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 223/454] 10.222.0.26 () {56 vars in 1180 bytes} [Tue Jul 12 03:15:08 2022] GET /identity/v3/groups/7a81fbd58cea4f1d87e8dce2dc59f949 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:08.679670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f009fb0-6400-4d2a-98ec-666a34d635e8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:08.738054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:08.790010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f009fb0-6400-4d2a-98ec-666a34d635e8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:08.826892 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235010d-6430-4b88-b32e-34fc19518e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:08.827536 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235010d-6430-4b88-b32e-34fc19518e00 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:08.827813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235010d-6430-4b88-b32e-34fc19518e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:08.828083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235010d-6430-4b88-b32e-34fc19518e00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:08.828969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235010d-6430-4b88-b32e-34fc19518e00 None admin] RBAC: Adding query filter params (group.id=7a81fbd58cea4f1d87e8dce2dc59f949, role.id=690fc625fea1445fa7e0e8f40ae2246c, scope.project.id=62c99d0f651845d884f137c894087eb1) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:08.829283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235010d-6430-4b88-b32e-34fc19518e00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:08.830712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235010d-6430-4b88-b32e-34fc19518e00 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:08.836694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 232/455] 10.222.0.26 () {56 vars in 1376 bytes} [Tue Jul 12 03:15:08 2022] GET /identity/v3/role_assignments?group.id=7a81fbd58cea4f1d87e8dce2dc59f949&scope.project.id=62c99d0f651845d884f137c894087eb1&role.id=690fc625fea1445fa7e0e8f40ae2246c => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:11.588087 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03992bc-dbbb-4c11-8831-62aea983a650 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:11.588642 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03992bc-dbbb-4c11-8831-62aea983a650 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:11.588642 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03992bc-dbbb-4c11-8831-62aea983a650 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:11.590279 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 224/456] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:11.596111 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c259b-e2f5-4ccd-a8e5-4e02a2c4ce1f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:11.596545 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c259b-e2f5-4ccd-a8e5-4e02a2c4ce1f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:11.596721 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c259b-e2f5-4ccd-a8e5-4e02a2c4ce1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:11.618885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4c4c259b-e2f5-4ccd-a8e5-4e02a2c4ce1f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:11.620069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4c4c259b-e2f5-4ccd-a8e5-4e02a2c4ce1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:11.636544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444ccb8-6d8d-47e9-9a0f-0674fde7cae9 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:11.636544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444ccb8-6d8d-47e9-9a0f-0674fde7cae9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:11.636544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444ccb8-6d8d-47e9-9a0f-0674fde7cae9 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:11.638258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 225/457] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:11.645060 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8cd50-39db-4a84-b9fa-c4eb2860d42e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:11.645618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8cd50-39db-4a84-b9fa-c4eb2860d42e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:11.646084 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8cd50-39db-4a84-b9fa-c4eb2860d42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:11.675646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e5a8cd50-39db-4a84-b9fa-c4eb2860d42e None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:11.677270 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e5a8cd50-39db-4a84-b9fa-c4eb2860d42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:11.713765 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 233/458] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:15:11.787803 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 226/459] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:15:11.789645 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c259b-e2f5-4ccd-a8e5-4e02a2c4ce1f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:11.812379 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8cd50-39db-4a84-b9fa-c4eb2860d42e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:11.862205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:11.868915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:11.953014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c259b-e2f5-4ccd-a8e5-4e02a2c4ce1f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:11.984537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8cd50-39db-4a84-b9fa-c4eb2860d42e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:11.993002 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e79f42-9125-4094-af6c-56817d906736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:11.994153 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e79f42-9125-4094-af6c-56817d906736 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:11.994505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e79f42-9125-4094-af6c-56817d906736 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:11.994849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e79f42-9125-4094-af6c-56817d906736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:12.006055 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e79f42-9125-4094-af6c-56817d906736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:12.007683 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e79f42-9125-4094-af6c-56817d906736 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:12.024242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44236b0-7e0f-4b29-acbf-a85b6e7edc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:12.025303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44236b0-7e0f-4b29-acbf-a85b6e7edc94 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:12.025773 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44236b0-7e0f-4b29-acbf-a85b6e7edc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:12.026208 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44236b0-7e0f-4b29-acbf-a85b6e7edc94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:12.026872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-e5e79f42-9125-4094-af6c-56817d906736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:12.026872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:12.026872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:12.026872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:12.026872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:12.026872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:12.026872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:12.026872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:12.026872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:12.026872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:12.026872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:12.026872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:12.026872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:12.026872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:12.026872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:12.027675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:12.027675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:12.027675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:12.027675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:12.027675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:12.027675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:12.027675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:12.027675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:12.027675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:12.027675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:12.027675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:12.027675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:12.027675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:12.027675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:12.027675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:12.027675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:12.027675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:12.028509 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:12.028509 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:12.028509 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:12.028509 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:12.033307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 234/460] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:12.034865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128fbdf-af03-4c9e-95da-cfc82eeb75ae None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:12.035220 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128fbdf-af03-4c9e-95da-cfc82eeb75ae None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:12.035563 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128fbdf-af03-4c9e-95da-cfc82eeb75ae None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:12.041255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 235/461] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:12.041255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128fbdf-af03-4c9e-95da-cfc82eeb75ae None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:12.046636 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44236b0-7e0f-4b29-acbf-a85b6e7edc94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:12.048321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44236b0-7e0f-4b29-acbf-a85b6e7edc94 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:12.071873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b44236b0-7e0f-4b29-acbf-a85b6e7edc94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:12.071873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:12.071873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:12.071873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:12.071873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:12.071873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:12.071873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:12.071873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:12.071873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:12.071873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:12.071873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:12.071873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:12.071873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:12.071873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:12.071873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:12.073304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:12.073304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:12.073304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:12.073304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:12.073304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:12.073304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:12.073304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:12.073304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:12.073304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:12.073304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:12.073304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:12.073304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:12.073304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:12.073304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:12.073304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:12.073304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:12.073304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:12.074856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:12.074856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:12.074856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:12.074856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:12.082562 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 227/462] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:12.082562 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c1d6d-6022-441f-a6f2-614306adfe67 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:12.082562 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c1d6d-6022-441f-a6f2-614306adfe67 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:12.083252 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c1d6d-6022-441f-a6f2-614306adfe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:12.105972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1d0c1d6d-6022-441f-a6f2-614306adfe67 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:12.107861 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1d0c1d6d-6022-441f-a6f2-614306adfe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:12.167906 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:12.174387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128fbdf-af03-4c9e-95da-cfc82eeb75ae None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:12.181973 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 228/463] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:12.183001 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c1d6d-6022-441f-a6f2-614306adfe67 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:12.191980 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:12.219229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afbcc3-f338-465b-8b16-ad0e8675aa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:12.220135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afbcc3-f338-465b-8b16-ad0e8675aa94 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:12.220575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afbcc3-f338-465b-8b16-ad0e8675aa94 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:12.220979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afbcc3-f338-465b-8b16-ad0e8675aa94 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:12.221839 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afbcc3-f338-465b-8b16-ad0e8675aa94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:12.222644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afbcc3-f338-465b-8b16-ad0e8675aa94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:12.224186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afbcc3-f338-465b-8b16-ad0e8675aa94 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:12.241647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 236/464] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:12.241647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f923e5-f4d4-46bf-8c57-4a5c76725309 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:12.241647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f923e5-f4d4-46bf-8c57-4a5c76725309 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:12.241647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f923e5-f4d4-46bf-8c57-4a5c76725309 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:12.241647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 237/465] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:12.242319 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f923e5-f4d4-46bf-8c57-4a5c76725309 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:12.304960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c1d6d-6022-441f-a6f2-614306adfe67 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:12.348025 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4020af-0abb-4389-909a-11e7c48cdf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:12.348851 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4020af-0abb-4389-909a-11e7c48cdf91 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:12.349757 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4020af-0abb-4389-909a-11e7c48cdf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:12.350130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4020af-0abb-4389-909a-11e7c48cdf91 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:12.350927 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4020af-0abb-4389-909a-11e7c48cdf91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:12.351271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4020af-0abb-4389-909a-11e7c48cdf91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:12.352742 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4020af-0abb-4389-909a-11e7c48cdf91 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:12.369023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 229/466] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:12.369592 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4020af-0abb-4389-909a-11e7c48cdf91 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:12.387453 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f923e5-f4d4-46bf-8c57-4a5c76725309 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:12.440584 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71724c6-0088-4497-833e-4e2d9894e057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:12.441765 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71724c6-0088-4497-833e-4e2d9894e057 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:12.442140 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71724c6-0088-4497-833e-4e2d9894e057 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:12.442643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71724c6-0088-4497-833e-4e2d9894e057 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:12.451676 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:12.457889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71724c6-0088-4497-833e-4e2d9894e057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:12.459536 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71724c6-0088-4497-833e-4e2d9894e057 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:12.488984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-f71724c6-0088-4497-833e-4e2d9894e057 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:12.488984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:12.488984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:12.488984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:12.488984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:12.488984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:12.488984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:12.488984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:12.488984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:12.488984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:12.488984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:12.488984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:12.488984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:12.488984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:12.488984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:12.489947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:12.489947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:12.489947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:12.489947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:12.489947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:12.489947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:12.489947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:12.489947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:12.489947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:12.489947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:12.489947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:12.489947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:12.489947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:12.489947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:12.489947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:12.489947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:12.489947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:12.490911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:12.490911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:12.490911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:12.490911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:12.492435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 238/467] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:12.499139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c27eb-4951-4eeb-9505-5296f15a365e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:12.499454 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c27eb-4951-4eeb-9505-5296f15a365e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:12.499690 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c27eb-4951-4eeb-9505-5296f15a365e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:12.500509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4020af-0abb-4389-909a-11e7c48cdf91 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:12.523351 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-857c27eb-4951-4eeb-9505-5296f15a365e None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:12.525008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-857c27eb-4951-4eeb-9505-5296f15a365e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:12.529814 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:12.549362 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e57606-bd30-4031-aa69-59ec128fc3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:12.550054 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e57606-bd30-4031-aa69-59ec128fc3cf None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:12.550343 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e57606-bd30-4031-aa69-59ec128fc3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:12.550653 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e57606-bd30-4031-aa69-59ec128fc3cf None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:12.551407 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e57606-bd30-4031-aa69-59ec128fc3cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:12.552913 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e57606-bd30-4031-aa69-59ec128fc3cf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:12.588086 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 230/468] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:15:12 2022] POST /identity/v3/users => generated 246 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:15:12.589193 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e57606-bd30-4031-aa69-59ec128fc3cf None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:12.631792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 239/469] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:12.633653 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c27eb-4951-4eeb-9505-5296f15a365e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:12.759632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e57606-bd30-4031-aa69-59ec128fc3cf None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:12.765254 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c27eb-4951-4eeb-9505-5296f15a365e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:12.787081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:12.804240 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cd2d8-fa95-4346-93cd-38b83b6a64bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:12.804955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd2d8-fa95-4346-93cd-38b83b6a64bf None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:12.805233 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd2d8-fa95-4346-93cd-38b83b6a64bf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:12.805509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd2d8-fa95-4346-93cd-38b83b6a64bf None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:12.806230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cd2d8-fa95-4346-93cd-38b83b6a64bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:12.808389 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cd2d8-fa95-4346-93cd-38b83b6a64bf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:12.813318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be954703-744b-4bfb-bfcc-2cd5d6424d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:12.814139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be954703-744b-4bfb-bfcc-2cd5d6424d65 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:12.814267 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be954703-744b-4bfb-bfcc-2cd5d6424d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:12.814528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be954703-744b-4bfb-bfcc-2cd5d6424d65 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:12.815652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be954703-744b-4bfb-bfcc-2cd5d6424d65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:12.815652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be954703-744b-4bfb-bfcc-2cd5d6424d65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:12.816964 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be954703-744b-4bfb-bfcc-2cd5d6424d65 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:12.829548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:12.833472 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 240/470] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:12.834397 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be954703-744b-4bfb-bfcc-2cd5d6424d65 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:12.838598 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 231/471] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:15:12 2022] POST /identity/v3/users => generated 248 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:15:12.839867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12df90-f3d0-4203-b752-058cf307a0f9 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:12.840230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12df90-f3d0-4203-b752-058cf307a0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:12.840839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12df90-f3d0-4203-b752-058cf307a0f9 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:12.843621 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 232/472] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:12.844893 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12df90-f3d0-4203-b752-058cf307a0f9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:12.961667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be954703-744b-4bfb-bfcc-2cd5d6424d65 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:13.011295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12df90-f3d0-4203-b752-058cf307a0f9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:13.017418 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d981e68-7c9e-4a0c-8c30-d9c857fe634d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:13.018613 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d981e68-7c9e-4a0c-8c30-d9c857fe634d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:13.019093 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d981e68-7c9e-4a0c-8c30-d9c857fe634d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:13.019598 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d981e68-7c9e-4a0c-8c30-d9c857fe634d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:13.037337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d981e68-7c9e-4a0c-8c30-d9c857fe634d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:13.039673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d981e68-7c9e-4a0c-8c30-d9c857fe634d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:13.055961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2f7fd-32f2-4c65-b652-333c6c66502e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:13.057143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2f7fd-32f2-4c65-b652-333c6c66502e None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:13.057592 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2f7fd-32f2-4c65-b652-333c6c66502e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:13.058043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2f7fd-32f2-4c65-b652-333c6c66502e None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:13.059261 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2f7fd-32f2-4c65-b652-333c6c66502e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:13.061899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2f7fd-32f2-4c65-b652-333c6c66502e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:13.063147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-1d981e68-7c9e-4a0c-8c30-d9c857fe634d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:13.063147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:13.063147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:13.063147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:13.063147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:13.063147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:13.063147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:13.063147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:13.063147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:13.063147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:13.063147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:13.063147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:13.063147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:13.063147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:13.063147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:13.063963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:13.063963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:13.063963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:13.063963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:13.063963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:13.063963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:13.063963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:13.063963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:13.063963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:13.063963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:13.063963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:13.063963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:13.063963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:13.063963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:13.063963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:13.063963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:13.063963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:13.065062 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:13.065062 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:13.065062 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:13.065062 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:13.065062 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 241/473] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:13.066894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071faf-9b94-4750-b588-68ddb63b31b7 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:13.066894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071faf-9b94-4750-b588-68ddb63b31b7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:13.066894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071faf-9b94-4750-b588-68ddb63b31b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:13.093772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5b071faf-9b94-4750-b588-68ddb63b31b7 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:13.094531 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 233/474] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:15:12 2022] POST /identity/v3/users => generated 248 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:15:13.095427 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2f7fd-32f2-4c65-b652-333c6c66502e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:13.095921 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5b071faf-9b94-4750-b588-68ddb63b31b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:13.141670 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:13.176365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:13.201842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 242/475] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:13.228729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b071faf-9b94-4750-b588-68ddb63b31b7 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:13.240111 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2f7fd-32f2-4c65-b652-333c6c66502e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:13.287923 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47e54b-5348-4b27-8e38-82cbd65c32d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:13.290022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47e54b-5348-4b27-8e38-82cbd65c32d1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:13.290022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47e54b-5348-4b27-8e38-82cbd65c32d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:13.290213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47e54b-5348-4b27-8e38-82cbd65c32d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:13.294791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47e54b-5348-4b27-8e38-82cbd65c32d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:13.295368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47e54b-5348-4b27-8e38-82cbd65c32d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:13.297757 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47e54b-5348-4b27-8e38-82cbd65c32d1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:13.314819 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 234/476] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:13.319964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47e54b-5348-4b27-8e38-82cbd65c32d1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:13.376386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b071faf-9b94-4750-b588-68ddb63b31b7 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:13.412975 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393804f-0aaa-426a-9be6-751b1d9cbae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:13.414137 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393804f-0aaa-426a-9be6-751b1d9cbae7 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:13.414606 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393804f-0aaa-426a-9be6-751b1d9cbae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:13.415083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393804f-0aaa-426a-9be6-751b1d9cbae7 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:13.416143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393804f-0aaa-426a-9be6-751b1d9cbae7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:13.417906 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393804f-0aaa-426a-9be6-751b1d9cbae7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:13.426400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.sql.core [None req-7393804f-0aaa-426a-9be6-751b1d9cbae7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 03:15:13.426400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 03:15:13.426400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [parameters: {'id': 'ab7f4ffd4b434fc68e3c83ed43e56fc2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 03:15:13.426400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80397) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 03:15:13.430469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:13.437874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47e54b-5348-4b27-8e38-82cbd65c32d1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:13.450829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7393804f-0aaa-426a-9be6-751b1d9cbae7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 03:15:13.450829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:13.450829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 03:15:13.450829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 03:15:13.450829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 03:15:13.450829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 03:15:13.450829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 03:15:13.450829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 03:15:13.450829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 03:15:13.450829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application conn.query(q) Jul 12 03:15:13.450829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 03:15:13.450829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 03:15:13.450829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 03:15:13.450829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application result.read() Jul 12 03:15:13.450829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return ref.to_dict() Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 03:15:13.451858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application next(self.gen) Jul 12 03:15:13.452773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 03:15:13.452773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application yield resource Jul 12 03:15:13.452773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 03:15:13.452773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application next(self.gen) Jul 12 03:15:13.452773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 03:15:13.452773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 03:15:13.452773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 03:15:13.452773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 03:15:13.452773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 03:15:13.452773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise self.value Jul 12 03:15:13.452773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 03:15:13.452773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 03:15:13.452773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 03:15:13.452773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application session.commit() Jul 12 03:15:13.452773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 03:15:13.452773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 03:15:13.452773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 03:15:13.453643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 03:15:13.453643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 03:15:13.453643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.session.flush() Jul 12 03:15:13.453643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 03:15:13.453643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 03:15:13.453643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 03:15:13.453643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 03:15:13.453643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 03:15:13.453643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application compat.raise_( Jul 12 03:15:13.453643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 03:15:13.453643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception Jul 12 03:15:13.453643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 03:15:13.453643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 03:15:13.453643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 03:15:13.453643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 03:15:13.453643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 03:15:13.453643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 03:15:13.454479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 03:15:13.454479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 03:15:13.454479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 03:15:13.454479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 03:15:13.454479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 03:15:13.454479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 03:15:13.454479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 03:15:13.454479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 03:15:13.454479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 03:15:13.454479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 03:15:13.454479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 03:15:13.454479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 03:15:13.454479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 03:15:13.454479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 03:15:13.454479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 03:15:13.454479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception Jul 12 03:15:13.455260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 03:15:13.455260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 03:15:13.455260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 03:15:13.455260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 03:15:13.455260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 03:15:13.455260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 03:15:13.455260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 03:15:13.455260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application conn.query(q) Jul 12 03:15:13.455260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 03:15:13.455260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 03:15:13.455260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 03:15:13.455260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application result.read() Jul 12 03:15:13.455260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 03:15:13.455260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 03:15:13.455260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 03:15:13.455260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 03:15:13.456016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 03:15:13.456016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 03:15:13.456016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 03:15:13.456016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 03:15:13.456016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 03:15:13.456016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 03:15:13.456016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [parameters: {'id': 'ab7f4ffd4b434fc68e3c83ed43e56fc2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 03:15:13.456016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 03:15:13.456016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:13.456016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:15:13.456016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:13.456016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:13.456016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:13.456016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:13.456016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:13.456016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:13.458794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:13.458794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:13.458794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:13.458794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:13.458794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:13.458794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:13.458794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 12 03:15:13.458794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 12 03:15:13.458794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:13.458794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:13.458794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 12 03:15:13.458794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 12 03:15:13.458794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 03:15:13.458794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 03:15:13.458794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 03:15:13.458794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:13.460832 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 243/477] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Jul 12 03:15:13 2022] POST /identity/v3/roles => generated 144 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:13.461974 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393804f-0aaa-426a-9be6-751b1d9cbae7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:13.495722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89010807-e016-4a48-b00e-ab65a8316ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:13.496714 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89010807-e016-4a48-b00e-ab65a8316ea4 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:13.497087 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89010807-e016-4a48-b00e-ab65a8316ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:13.497358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89010807-e016-4a48-b00e-ab65a8316ea4 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:13.498201 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89010807-e016-4a48-b00e-ab65a8316ea4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:13.499731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89010807-e016-4a48-b00e-ab65a8316ea4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:13.520548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:13.530434 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 235/478] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:15:13 2022] POST /identity/v3/users => generated 249 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:15:13.615091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393804f-0aaa-426a-9be6-751b1d9cbae7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:13.668573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a14936-f7fb-4d4b-b6a6-432598bf8892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:13.669426 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a14936-f7fb-4d4b-b6a6-432598bf8892 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:13.669706 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a14936-f7fb-4d4b-b6a6-432598bf8892 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:13.670135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a14936-f7fb-4d4b-b6a6-432598bf8892 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:13.694584 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a14936-f7fb-4d4b-b6a6-432598bf8892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:13.703266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-a3a14936-f7fb-4d4b-b6a6-432598bf8892 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:15:13.703266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:13.703266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:13.703266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:13.703266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:13.703266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:13.703266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:13.703266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:13.703266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:13.703266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:13.703266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:13.703266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:13.703266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:13.703266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:13.703266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:13.703266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:13.704229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:13.704229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:13.704229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:13.704229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:13.704229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:13.704229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:13.704229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:13.704229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:13.704229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:13.704229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:13.704229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:13.704229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:13.704229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:13.704229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:13.704229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:13.704229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:13.705107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:13.705107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:13.705107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:13.705107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:13.705107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:13.705107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:13.705107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:13.705107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:13.705107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:13.705107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:13.705107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 03:15:13.705107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:13.705107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 244/479] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:15:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:13.710297 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89010807-e016-4a48-b00e-ab65a8316ea4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:13.825827 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89010807-e016-4a48-b00e-ab65a8316ea4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:13.861396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f299d-b7c4-4ed5-94e8-68a3810afe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:13.862081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f299d-b7c4-4ed5-94e8-68a3810afe71 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:13.862360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f299d-b7c4-4ed5-94e8-68a3810afe71 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:13.862631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f299d-b7c4-4ed5-94e8-68a3810afe71 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:13.863399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f299d-b7c4-4ed5-94e8-68a3810afe71 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:13.863703 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f299d-b7c4-4ed5-94e8-68a3810afe71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:13.865156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f299d-b7c4-4ed5-94e8-68a3810afe71 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:13.875311 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 236/480] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:15.154088 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b88591-57a2-45ba-9fb7-eea8a85eb2da None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:15.155224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b88591-57a2-45ba-9fb7-eea8a85eb2da None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:15.155721 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b88591-57a2-45ba-9fb7-eea8a85eb2da None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:15.157589 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 245/481] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:15.170610 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f720da2-4811-467e-a7ec-6f32a9c6ac90 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:15.171678 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f720da2-4811-467e-a7ec-6f32a9c6ac90 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:15.172148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f720da2-4811-467e-a7ec-6f32a9c6ac90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:15.195596 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7f720da2-4811-467e-a7ec-6f32a9c6ac90 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:15.197174 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7f720da2-4811-467e-a7ec-6f32a9c6ac90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:15.205372 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:15.286671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 237/482] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:15.320286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b88591-57a2-45ba-9fb7-eea8a85eb2da None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:15.444896 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b88591-57a2-45ba-9fb7-eea8a85eb2da None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:15.445067 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7e648-b8ff-482d-bac5-f7836cc03e6a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:15.445352 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7e648-b8ff-482d-bac5-f7836cc03e6a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:15.445628 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7e648-b8ff-482d-bac5-f7836cc03e6a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:15.447980 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 238/483] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:15.453030 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4fa6e-2abe-445e-9181-12609db354a2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:15.453253 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:15.453353 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4fa6e-2abe-445e-9181-12609db354a2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:15.453573 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4fa6e-2abe-445e-9181-12609db354a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:15.482980 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577ed5d-d251-4b46-aa6c-30bec61b1c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:15.483956 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577ed5d-d251-4b46-aa6c-30bec61b1c96 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:15.484236 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577ed5d-d251-4b46-aa6c-30bec61b1c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:15.484506 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577ed5d-d251-4b46-aa6c-30bec61b1c96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:15.495501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577ed5d-d251-4b46-aa6c-30bec61b1c96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:15.496478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-29f4fa6e-2abe-445e-9181-12609db354a2 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:15.497737 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-29f4fa6e-2abe-445e-9181-12609db354a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:15.503840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-3577ed5d-d251-4b46-aa6c-30bec61b1c96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:15.503840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:15.503840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:15.503840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:15.503840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:15.503840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:15.503840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:15.503840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:15.503840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:15.503840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:15.503840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:15.503840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:15.503840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:15.503840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:15.503840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:15.503840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:15.504803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:15.504803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:15.504803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:15.504803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:15.504803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:15.504803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:15.504803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:15.504803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:15.504803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:15.504803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:15.504803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:15.504803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:15.504803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:15.504803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:15.504803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:15.504803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:15.505573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:15.505573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:15.505573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:15.505573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:15.505573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:15.505573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:15.505573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:15.505573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:15.505573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:15.505573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:15.505573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:15.505573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:15.506188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 246/484] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:15.514188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577ed5d-d251-4b46-aa6c-30bec61b1c96 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:15.639288 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 239/485] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:15:15.684875 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577ed5d-d251-4b46-aa6c-30bec61b1c96 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:15.698065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4fa6e-2abe-445e-9181-12609db354a2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:15.739922 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec4777-943c-4e46-8f20-3ed8d84417e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:15.740626 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec4777-943c-4e46-8f20-3ed8d84417e2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:15.740910 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec4777-943c-4e46-8f20-3ed8d84417e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:15.741192 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec4777-943c-4e46-8f20-3ed8d84417e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:15.741948 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec4777-943c-4e46-8f20-3ed8d84417e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:15.742253 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec4777-943c-4e46-8f20-3ed8d84417e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:15.743643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec4777-943c-4e46-8f20-3ed8d84417e2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:15.752897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 247/486] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:15.758623 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec4777-943c-4e46-8f20-3ed8d84417e2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:15.797860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:15.837568 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:15.877238 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec4777-943c-4e46-8f20-3ed8d84417e2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:15.884593 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4fa6e-2abe-445e-9181-12609db354a2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:15.913117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de375a91-1edb-4c16-9754-d39813af4a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:15.914297 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de375a91-1edb-4c16-9754-d39813af4a99 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:15.914988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de375a91-1edb-4c16-9754-d39813af4a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:15.915453 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de375a91-1edb-4c16-9754-d39813af4a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:15.927628 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de375a91-1edb-4c16-9754-d39813af4a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:15.929423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de375a91-1edb-4c16-9754-d39813af4a99 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:15.930064 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b5bb3-a6e4-4a5f-be79-1ebc10b6b349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:15.931035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b5bb3-a6e4-4a5f-be79-1ebc10b6b349 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:15.931319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b5bb3-a6e4-4a5f-be79-1ebc10b6b349 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:15.931653 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b5bb3-a6e4-4a5f-be79-1ebc10b6b349 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:15.944701 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b5bb3-a6e4-4a5f-be79-1ebc10b6b349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:15.948785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-de375a91-1edb-4c16-9754-d39813af4a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:15.948785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:15.948785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:15.948785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:15.948785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:15.948785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:15.948785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:15.948785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:15.948785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:15.948785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:15.948785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:15.948785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:15.948785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:15.948785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:15.948785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:15.949597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:15.949597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:15.949597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:15.949597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:15.949597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:15.949597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:15.949597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:15.949597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:15.949597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:15.949597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:15.949597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:15.949597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:15.949597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:15.949597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:15.949597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:15.949597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:15.949597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:15.950424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:15.950424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:15.950424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:15.950424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:15.952635 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 248/487] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:15.954038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317026f3-f1f6-402e-8b72-1aa5f61f0d50 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:15.954542 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317026f3-f1f6-402e-8b72-1aa5f61f0d50 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:15.955028 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317026f3-f1f6-402e-8b72-1aa5f61f0d50 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:15.960355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-ac6b5bb3-a6e4-4a5f-be79-1ebc10b6b349 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:15.960355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:15.960355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:15.960355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:15.960355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:15.960355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:15.960355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:15.960355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:15.960355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:15.960355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:15.960355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:15.960355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:15.960355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:15.960355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:15.960355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:15.960355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:15.961236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:15.961236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:15.961236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:15.961236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:15.961236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:15.961236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:15.961236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:15.961236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:15.961236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:15.961236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:15.961236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:15.961236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:15.961236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:15.961236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:15.961236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:15.961236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:15.962103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:15.962103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:15.962103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:15.962103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:15.962103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:15.962103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:15.962103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:15.962103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:15.962103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:15.962103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:15.962103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:15.962103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:15.962103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 240/488] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:15.962103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b5bb3-a6e4-4a5f-be79-1ebc10b6b349 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:15.963503 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 249/489] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:15.964940 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b27e1-9d39-44fa-9d17-ceb6fc059b0b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:15.965413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b27e1-9d39-44fa-9d17-ceb6fc059b0b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:15.965868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b27e1-9d39-44fa-9d17-ceb6fc059b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:15.983809 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-bb8b27e1-9d39-44fa-9d17-ceb6fc059b0b None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:15.985430 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bb8b27e1-9d39-44fa-9d17-ceb6fc059b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:16.065126 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 250/490] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:16.065614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b27e1-9d39-44fa-9d17-ceb6fc059b0b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:16.084547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:16.087923 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b5bb3-a6e4-4a5f-be79-1ebc10b6b349 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:16.130167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:16.137852 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d72f94-305f-42f5-aef2-d2365af5337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:16.139457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d72f94-305f-42f5-aef2-d2365af5337c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:16.139937 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d72f94-305f-42f5-aef2-d2365af5337c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:16.140686 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d72f94-305f-42f5-aef2-d2365af5337c None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:16.142027 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d72f94-305f-42f5-aef2-d2365af5337c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:16.142786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d72f94-305f-42f5-aef2-d2365af5337c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:16.145133 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d72f94-305f-42f5-aef2-d2365af5337c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:16.162252 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 241/491] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:16.163383 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d72f94-305f-42f5-aef2-d2365af5337c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:16.190081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b27e1-9d39-44fa-9d17-ceb6fc059b0b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:16.230121 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd999e-5572-44c8-8bed-bd07778291b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:16.230867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd999e-5572-44c8-8bed-bd07778291b5 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:16.231407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd999e-5572-44c8-8bed-bd07778291b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:16.231598 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd999e-5572-44c8-8bed-bd07778291b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:16.232591 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd999e-5572-44c8-8bed-bd07778291b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:16.232997 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd999e-5572-44c8-8bed-bd07778291b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:16.234481 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd999e-5572-44c8-8bed-bd07778291b5 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:16.243550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 251/492] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:16.244529 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd999e-5572-44c8-8bed-bd07778291b5 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:16.294455 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d72f94-305f-42f5-aef2-d2365af5337c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:16.316965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:16.334601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daec50-a380-4f1e-8eeb-c6095f9b6a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:16.335648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daec50-a380-4f1e-8eeb-c6095f9b6a9e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:16.336064 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daec50-a380-4f1e-8eeb-c6095f9b6a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:16.336467 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daec50-a380-4f1e-8eeb-c6095f9b6a9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:16.349850 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daec50-a380-4f1e-8eeb-c6095f9b6a9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:16.350018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd999e-5572-44c8-8bed-bd07778291b5 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:16.358125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-84daec50-a380-4f1e-8eeb-c6095f9b6a9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:16.358125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:16.358125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:16.358125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:16.358125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:16.358125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:16.358125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:16.358125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:16.358125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:16.358125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:16.358125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:16.358125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:16.358125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:16.358125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:16.358125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:16.358125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:16.359017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:16.359017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:16.359017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:16.359017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:16.359017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:16.359017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:16.359017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:16.359017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:16.359017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:16.359017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:16.359017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:16.359017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:16.359017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:16.359017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:16.359017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:16.359017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:16.359798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:16.359798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:16.359798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:16.359798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:16.359798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:16.359798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:16.359798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:16.359798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:16.359798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:16.359798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:16.359798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:16.359798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:16.359798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 242/493] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:16.361381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb20333-3760-4f9c-8edc-18a8d2362a7b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:16.361381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb20333-3760-4f9c-8edc-18a8d2362a7b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:16.361381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb20333-3760-4f9c-8edc-18a8d2362a7b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:16.364712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 243/494] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:16.367033 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb20333-3760-4f9c-8edc-18a8d2362a7b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:16.389980 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec210f6e-3563-48ca-8061-90d935ff7e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:16.390784 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec210f6e-3563-48ca-8061-90d935ff7e81 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:16.391064 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec210f6e-3563-48ca-8061-90d935ff7e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:16.391330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec210f6e-3563-48ca-8061-90d935ff7e81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:16.399857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec210f6e-3563-48ca-8061-90d935ff7e81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:16.401322 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec210f6e-3563-48ca-8061-90d935ff7e81 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:16.416603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-ec210f6e-3563-48ca-8061-90d935ff7e81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:15:16.416603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:16.416603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:16.416603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:16.416603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:16.416603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:16.416603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:16.416603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:16.416603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:16.416603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:16.416603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:16.416603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:16.416603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:16.416603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:16.416603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:16.416603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:16.417492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:16.418353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:16.418353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:16.418353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:16.418353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:16.418353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:16.418353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:16.418353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:16.418353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:16.418353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:15:16.418353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:16.418353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 252/495] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 03:15:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:16.418923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec210f6e-3563-48ca-8061-90d935ff7e81 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:16.429398 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:16.483449 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb20333-3760-4f9c-8edc-18a8d2362a7b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:16.517094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb39be5-0094-4dd3-ba17-1e40ffa07193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:16.517886 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb39be5-0094-4dd3-ba17-1e40ffa07193 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:16.518161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb39be5-0094-4dd3-ba17-1e40ffa07193 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:16.518427 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb39be5-0094-4dd3-ba17-1e40ffa07193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:16.521736 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec210f6e-3563-48ca-8061-90d935ff7e81 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:16.529623 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb39be5-0094-4dd3-ba17-1e40ffa07193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:16.531096 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb39be5-0094-4dd3-ba17-1e40ffa07193 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:16.548013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3fb39be5-0094-4dd3-ba17-1e40ffa07193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:16.548013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:16.548013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:16.548013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:16.548013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:16.548013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:16.548013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:16.548013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:16.548013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:16.548013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:16.548013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:16.548013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:16.548013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:16.548013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:16.548013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:16.549072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:16.549072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:16.549072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:16.549072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:16.549072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:16.549072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:16.549072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:16.549072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:16.549072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:16.549072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:16.549072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:16.549072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:16.549072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:16.549072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:16.549072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:16.549072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:16.549072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:16.549950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:16.549950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:16.549950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:16.549950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:16.549950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 244/496] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:16.551099 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fcf4b-70a5-4091-a112-ff8a213c24c8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:16.551374 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fcf4b-70a5-4091-a112-ff8a213c24c8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:16.551641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fcf4b-70a5-4091-a112-ff8a213c24c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:16.553049 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:16.559502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60007a2-5255-45ed-8f61-bc5501119338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:16.560236 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60007a2-5255-45ed-8f61-bc5501119338 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:16.560549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60007a2-5255-45ed-8f61-bc5501119338 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:16.560856 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60007a2-5255-45ed-8f61-bc5501119338 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:16.561606 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60007a2-5255-45ed-8f61-bc5501119338 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:16.561908 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60007a2-5255-45ed-8f61-bc5501119338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:16.563299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60007a2-5255-45ed-8f61-bc5501119338 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:16.569042 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-eb1fcf4b-70a5-4091-a112-ff8a213c24c8 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:16.570232 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-eb1fcf4b-70a5-4091-a112-ff8a213c24c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:16.571627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 253/497] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:16.572421 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60007a2-5255-45ed-8f61-bc5501119338 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:16.636296 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 245/498] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:16.637636 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e63ef9-d4df-426c-a8bd-bd557069af00 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:16.637915 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e63ef9-d4df-426c-a8bd-bd557069af00 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:16.638188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e63ef9-d4df-426c-a8bd-bd557069af00 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:16.639985 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 246/499] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:16.640462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e63ef9-d4df-426c-a8bd-bd557069af00 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:16.680089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:16.684017 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60007a2-5255-45ed-8f61-bc5501119338 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:16.718669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a9abd-9e8f-469d-91c4-a48837748db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:16.719348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a9abd-9e8f-469d-91c4-a48837748db8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:16.719625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a9abd-9e8f-469d-91c4-a48837748db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:16.719902 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a9abd-9e8f-469d-91c4-a48837748db8 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:16.720771 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a9abd-9e8f-469d-91c4-a48837748db8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:16.721077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a9abd-9e8f-469d-91c4-a48837748db8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:16.722886 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a9abd-9e8f-469d-91c4-a48837748db8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:16.747970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e63ef9-d4df-426c-a8bd-bd557069af00 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:16.759473 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 254/500] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 03:15:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:16.760325 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a9abd-9e8f-469d-91c4-a48837748db8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:16.783204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7c158-9f20-4307-a0c3-8ecaaadbb8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:16.784212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7c158-9f20-4307-a0c3-8ecaaadbb8fd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:16.784212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7c158-9f20-4307-a0c3-8ecaaadbb8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:16.784437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7c158-9f20-4307-a0c3-8ecaaadbb8fd None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:16.785143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7c158-9f20-4307-a0c3-8ecaaadbb8fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:16.785444 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7c158-9f20-4307-a0c3-8ecaaadbb8fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:16.786826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7c158-9f20-4307-a0c3-8ecaaadbb8fd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:16.797729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 247/501] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:16.798899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a2716-1e91-450c-b586-4cbfc5af4078 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:16.799180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a2716-1e91-450c-b586-4cbfc5af4078 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:16.799452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a2716-1e91-450c-b586-4cbfc5af4078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:16.815770 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:16.817216 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-273a2716-1e91-450c-b586-4cbfc5af4078 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:16.818540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-273a2716-1e91-450c-b586-4cbfc5af4078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:16.865921 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a9abd-9e8f-469d-91c4-a48837748db8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:16.889152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 248/502] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:16.890077 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a2716-1e91-450c-b586-4cbfc5af4078 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:16.913096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb46c91-1626-48ae-92ee-fcdc311fa40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:16.913901 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb46c91-1626-48ae-92ee-fcdc311fa40f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:16.914170 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb46c91-1626-48ae-92ee-fcdc311fa40f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:16.914432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb46c91-1626-48ae-92ee-fcdc311fa40f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:16.915683 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:16.924749 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb46c91-1626-48ae-92ee-fcdc311fa40f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:16.926223 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb46c91-1626-48ae-92ee-fcdc311fa40f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:16.943411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-3bb46c91-1626-48ae-92ee-fcdc311fa40f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:16.943411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:16.943411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:16.943411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:16.943411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:16.943411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:16.943411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:16.943411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:16.943411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:16.943411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:16.943411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:16.943411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:16.943411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:16.943411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:16.943411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:16.944272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:16.944272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:16.944272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:16.944272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:16.944272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:16.944272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:16.944272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:16.944272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:16.944272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:16.944272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:16.944272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:16.944272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:16.944272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:16.944272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:16.944272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:16.944272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:16.944272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:16.945126 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:16.945126 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:16.945126 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:16.945126 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:16.945126 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 255/503] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:16.945394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb46c91-1626-48ae-92ee-fcdc311fa40f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:16.994897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a2716-1e91-450c-b586-4cbfc5af4078 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:17.028596 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc5a59-7e73-44c9-8aac-913f6659b696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:17.029432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc5a59-7e73-44c9-8aac-913f6659b696 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:17.029714 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc5a59-7e73-44c9-8aac-913f6659b696 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:17.029988 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc5a59-7e73-44c9-8aac-913f6659b696 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:17.040083 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc5a59-7e73-44c9-8aac-913f6659b696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:17.041164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb46c91-1626-48ae-92ee-fcdc311fa40f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:17.043388 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:17.048162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e8fc5a59-7e73-44c9-8aac-913f6659b696 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:17.048162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:17.048162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:17.048162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:17.048162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:17.048162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:17.048162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:17.048162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:17.048162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:17.048162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:17.048162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:17.048162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:17.048162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:17.048162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:17.048162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:17.048162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:17.049097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:17.049097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:17.049097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:17.049097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:17.049097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:17.049097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:17.049097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:17.049097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:17.049097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:17.049097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:17.049097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:17.049097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:17.049097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:17.049097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:17.049097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:17.049097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:17.049878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:17.049878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:17.049878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:17.049878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:17.049878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:17.049878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:17.049878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:17.049878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:17.049878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:17.049878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:17.049878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:17.049878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:17.049878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 249/504] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:17.050514 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc5a59-7e73-44c9-8aac-913f6659b696 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:17.075461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c90f17-5bda-4fee-bd74-ef0b668f354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:17.076443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c90f17-5bda-4fee-bd74-ef0b668f354d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:17.076614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c90f17-5bda-4fee-bd74-ef0b668f354d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:17.076865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c90f17-5bda-4fee-bd74-ef0b668f354d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:17.133850 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:17.144673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c90f17-5bda-4fee-bd74-ef0b668f354d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:17.146136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c90f17-5bda-4fee-bd74-ef0b668f354d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:17.151206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc5a59-7e73-44c9-8aac-913f6659b696 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:17.184394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2b645-1243-450f-b215-d28043249209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:17.185229 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2b645-1243-450f-b215-d28043249209 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:17.185606 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2b645-1243-450f-b215-d28043249209 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:17.185882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2b645-1243-450f-b215-d28043249209 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:17.193373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2b645-1243-450f-b215-d28043249209 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:17.194834 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2b645-1243-450f-b215-d28043249209 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:17.210616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3ff2b645-1243-450f-b215-d28043249209 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 03:15:17.210616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:17.210616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:17.210616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:17.210616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:17.210616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:17.210616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:17.210616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:17.210616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:17.210616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:17.210616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:17.210616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:17.210616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:17.210616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:17.210616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:17.210616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:17.211553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:17.212419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:17.212419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:17.212419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:17.212419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:17.212419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:17.212419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:17.212419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:17.212419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:17.212419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 03:15:17.212419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:17.212419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 250/505] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:17.213042 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2b645-1243-450f-b215-d28043249209 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:17.253304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 256/506] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:15:17.254147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c90f17-5bda-4fee-bd74-ef0b668f354d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:17.257215 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:17.318866 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2b645-1243-450f-b215-d28043249209 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:17.353139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c90f17-5bda-4fee-bd74-ef0b668f354d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:17.353795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a46a2-34c0-4abf-a3bd-90352655cc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:17.354590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a46a2-34c0-4abf-a3bd-90352655cc01 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:17.354862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a46a2-34c0-4abf-a3bd-90352655cc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:17.355127 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a46a2-34c0-4abf-a3bd-90352655cc01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:17.365877 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a46a2-34c0-4abf-a3bd-90352655cc01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:17.367348 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a46a2-34c0-4abf-a3bd-90352655cc01 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:17.369858 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:17.385266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-814a46a2-34c0-4abf-a3bd-90352655cc01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:17.385266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:17.385266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:17.385266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:17.385266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:17.385266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:17.385266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:17.385266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:17.385266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:17.385266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:17.385266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:17.385266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:17.385266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:17.385266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:17.385266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:17.386143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:17.386143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:17.386143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:17.386143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:17.386143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:17.386143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:17.386143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:17.386143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:17.386143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:17.386143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:17.386143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:17.386143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:17.386143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:17.386143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:17.386143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:17.386143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:17.386143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:17.386975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:17.386975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:17.386975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:17.386975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:17.386975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 251/507] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:17.387453 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a46a2-34c0-4abf-a3bd-90352655cc01 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:17.391900 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71c5a3-aa1a-4a72-8ac8-20ead21ca786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:17.392602 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71c5a3-aa1a-4a72-8ac8-20ead21ca786 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:17.392883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71c5a3-aa1a-4a72-8ac8-20ead21ca786 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:17.393150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71c5a3-aa1a-4a72-8ac8-20ead21ca786 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:17.393867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71c5a3-aa1a-4a72-8ac8-20ead21ca786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:17.394160 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71c5a3-aa1a-4a72-8ac8-20ead21ca786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:17.395545 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71c5a3-aa1a-4a72-8ac8-20ead21ca786 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:17.407179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 257/508] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:17.407961 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71c5a3-aa1a-4a72-8ac8-20ead21ca786 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:17.468955 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:17.491471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a46a2-34c0-4abf-a3bd-90352655cc01 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:17.507968 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71c5a3-aa1a-4a72-8ac8-20ead21ca786 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:17.526118 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbc21b-d3bc-4855-9e86-7d4424316977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:17.526779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbc21b-d3bc-4855-9e86-7d4424316977 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:17.527052 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbc21b-d3bc-4855-9e86-7d4424316977 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:17.527322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbc21b-d3bc-4855-9e86-7d4424316977 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:17.528064 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbc21b-d3bc-4855-9e86-7d4424316977 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:17.528357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbc21b-d3bc-4855-9e86-7d4424316977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:17.529812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbc21b-d3bc-4855-9e86-7d4424316977 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:17.537745 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 252/509] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:17.538517 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbc21b-d3bc-4855-9e86-7d4424316977 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:17.541592 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204f5ce-621d-4506-9c38-85bebb264340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:17.542264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204f5ce-621d-4506-9c38-85bebb264340 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:17.542546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204f5ce-621d-4506-9c38-85bebb264340 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:17.542819 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204f5ce-621d-4506-9c38-85bebb264340 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:17.543653 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204f5ce-621d-4506-9c38-85bebb264340 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:17.543961 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204f5ce-621d-4506-9c38-85bebb264340 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:17.545542 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204f5ce-621d-4506-9c38-85bebb264340 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:17.563432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 258/510] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Jul 12 03:15:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:17.564325 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204f5ce-621d-4506-9c38-85bebb264340 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:17.603398 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:17.646067 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbc21b-d3bc-4855-9e86-7d4424316977 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:17.662162 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204f5ce-621d-4506-9c38-85bebb264340 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:17.684605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6cdf8-2a0a-4dc9-851c-c88c022b8298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:17.684796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:17.685591 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6cdf8-2a0a-4dc9-851c-c88c022b8298 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:17.685591 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6cdf8-2a0a-4dc9-851c-c88c022b8298 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:17.686195 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6cdf8-2a0a-4dc9-851c-c88c022b8298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:17.697139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6cdf8-2a0a-4dc9-851c-c88c022b8298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:17.697340 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59b6d4-93c7-4950-880f-f14cd885d4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:17.698004 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59b6d4-93c7-4950-880f-f14cd885d4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:17.698280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59b6d4-93c7-4950-880f-f14cd885d4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:17.698550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59b6d4-93c7-4950-880f-f14cd885d4f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:17.699020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6cdf8-2a0a-4dc9-851c-c88c022b8298 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:17.699261 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59b6d4-93c7-4950-880f-f14cd885d4f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:17.699560 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59b6d4-93c7-4950-880f-f14cd885d4f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:17.701272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59b6d4-93c7-4950-880f-f14cd885d4f9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:17.712490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 259/511] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:17.713309 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59b6d4-93c7-4950-880f-f14cd885d4f9 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:17.721212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c1b6cdf8-2a0a-4dc9-851c-c88c022b8298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:17.721212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:17.721212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:17.721212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:17.721212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:17.721212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:17.721212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:17.721212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:17.721212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:17.721212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:17.721212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:17.721212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:17.721212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:17.721212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:17.721212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:17.722438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:17.722438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:17.722438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:17.722438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:17.722438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:17.722438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:17.722438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:17.722438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:17.722438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:17.722438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:17.722438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:17.722438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:17.722438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:17.722438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:17.722438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:17.722438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:17.722438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:17.723399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:17.723399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:17.723399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:17.723399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:17.723399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 253/512] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:17.723911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6cdf8-2a0a-4dc9-851c-c88c022b8298 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:17.815118 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59b6d4-93c7-4950-880f-f14cd885d4f9 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:17.823760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6cdf8-2a0a-4dc9-851c-c88c022b8298 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:17.833944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:17.849563 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c404e-89b1-4f90-b891-113b6dc94391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:17.850370 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c404e-89b1-4f90-b891-113b6dc94391 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:17.850649 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c404e-89b1-4f90-b891-113b6dc94391 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:17.850916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c404e-89b1-4f90-b891-113b6dc94391 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:17.858547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c404e-89b1-4f90-b891-113b6dc94391 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:17.860173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253251b7-8007-4ec7-8914-51960163af8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:17.860292 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c404e-89b1-4f90-b891-113b6dc94391 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:17.860999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253251b7-8007-4ec7-8914-51960163af8d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:17.861279 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253251b7-8007-4ec7-8914-51960163af8d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:17.861546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253251b7-8007-4ec7-8914-51960163af8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:17.872079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253251b7-8007-4ec7-8914-51960163af8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:17.874171 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253251b7-8007-4ec7-8914-51960163af8d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:17.874998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-f88c404e-89b1-4f90-b891-113b6dc94391 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 03:15:17.874998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:17.874998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:17.874998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:17.874998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:17.874998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:17.874998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:17.874998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:17.874998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:17.874998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:17.874998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:17.874998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:17.874998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:17.874998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:17.874998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:17.874998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:17.875904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:17.876815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:17.876815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:17.876815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:17.876815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:17.876815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:17.876815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:17.876815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:17.876815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:17.876815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 03:15:17.876815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:17.876815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 260/513] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:17.877589 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c404e-89b1-4f90-b891-113b6dc94391 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:17.896047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-253251b7-8007-4ec7-8914-51960163af8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:17.896047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:17.896047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:17.896047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:17.896047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:17.896047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:17.896047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:17.896047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:17.896047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:17.896047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:17.896047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:17.896047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:17.896047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:17.896047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:17.896047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:17.897062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:17.897062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:17.897062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:17.897062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:17.897062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:17.897062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:17.897062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:17.897062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:17.897062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:17.897062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:17.897062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:17.897062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:17.897062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:17.897062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:17.897062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:17.897062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:17.897062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:17.898066 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:17.898066 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:17.898066 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:17.898066 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:17.900795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 254/514] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:17.901632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253251b7-8007-4ec7-8914-51960163af8d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:17.919054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:17.978315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c404e-89b1-4f90-b891-113b6dc94391 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:18.003804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253251b7-8007-4ec7-8914-51960163af8d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:18.011302 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94c3f3-0ae1-4e12-b735-d5870a62fa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:18.011944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c3f3-0ae1-4e12-b735-d5870a62fa8d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:18.012244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c3f3-0ae1-4e12-b735-d5870a62fa8d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:18.012539 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c3f3-0ae1-4e12-b735-d5870a62fa8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:18.037032 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5a648-e1fb-4a54-9722-547fd4878781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:18.037698 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5a648-e1fb-4a54-9722-547fd4878781 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:18.037980 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5a648-e1fb-4a54-9722-547fd4878781 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:18.038251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5a648-e1fb-4a54-9722-547fd4878781 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:18.038958 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5a648-e1fb-4a54-9722-547fd4878781 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:18.040414 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5a648-e1fb-4a54-9722-547fd4878781 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:18.060991 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 255/515] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:15:17 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:15:18.061804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5a648-e1fb-4a54-9722-547fd4878781 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:18.079594 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94c3f3-0ae1-4e12-b735-d5870a62fa8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:18.081490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94c3f3-0ae1-4e12-b735-d5870a62fa8d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:18.084395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:18.131879 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:18.179892 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5a648-e1fb-4a54-9722-547fd4878781 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:18.195941 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 261/516] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:15:18.197116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94c3f3-0ae1-4e12-b735-d5870a62fa8d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:18.226552 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca669d49-9d3c-46a0-93d0-20436349a393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:18.227230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca669d49-9d3c-46a0-93d0-20436349a393 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:18.227628 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca669d49-9d3c-46a0-93d0-20436349a393 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:18.227901 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca669d49-9d3c-46a0-93d0-20436349a393 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:18.228682 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca669d49-9d3c-46a0-93d0-20436349a393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:18.228991 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca669d49-9d3c-46a0-93d0-20436349a393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:18.230413 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca669d49-9d3c-46a0-93d0-20436349a393 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:18.244204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 256/517] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:18.245371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca669d49-9d3c-46a0-93d0-20436349a393 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:18.324782 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94c3f3-0ae1-4e12-b735-d5870a62fa8d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:18.328419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:18.354085 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca669d49-9d3c-46a0-93d0-20436349a393 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:18.362146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b61d4-b22f-42e8-99ab-452a7d3ca814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:18.362824 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b61d4-b22f-42e8-99ab-452a7d3ca814 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:18.363103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b61d4-b22f-42e8-99ab-452a7d3ca814 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:18.363371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b61d4-b22f-42e8-99ab-452a7d3ca814 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:18.364209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b61d4-b22f-42e8-99ab-452a7d3ca814 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:18.364540 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b61d4-b22f-42e8-99ab-452a7d3ca814 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:18.366024 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b61d4-b22f-42e8-99ab-452a7d3ca814 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:18.380345 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:18.389010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 262/518] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Jul 12 03:15:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:18.389010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b61d4-b22f-42e8-99ab-452a7d3ca814 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:18.396229 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f21fc-75de-4fb6-8def-a5460633c0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:18.397138 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f21fc-75de-4fb6-8def-a5460633c0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:18.397492 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f21fc-75de-4fb6-8def-a5460633c0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:18.397778 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f21fc-75de-4fb6-8def-a5460633c0a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:18.398511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f21fc-75de-4fb6-8def-a5460633c0a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:18.398815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f21fc-75de-4fb6-8def-a5460633c0a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:18.400214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f21fc-75de-4fb6-8def-a5460633c0a5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:18.416547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 257/519] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:18.416547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f21fc-75de-4fb6-8def-a5460633c0a5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:18.500376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b61d4-b22f-42e8-99ab-452a7d3ca814 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:18.520908 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f21fc-75de-4fb6-8def-a5460633c0a5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:18.537856 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a18ab-726d-44ca-9de7-b809f3f5e010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:18.538446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a18ab-726d-44ca-9de7-b809f3f5e010 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:18.538728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a18ab-726d-44ca-9de7-b809f3f5e010 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:18.539002 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a18ab-726d-44ca-9de7-b809f3f5e010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:18.549732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a18ab-726d-44ca-9de7-b809f3f5e010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:18.551173 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a18ab-726d-44ca-9de7-b809f3f5e010 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:18.557583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24615f46-c063-4063-942b-ddb59657611e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:18.558680 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24615f46-c063-4063-942b-ddb59657611e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:18.558969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24615f46-c063-4063-942b-ddb59657611e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:18.559238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24615f46-c063-4063-942b-ddb59657611e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:18.567027 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24615f46-c063-4063-942b-ddb59657611e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:18.568569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24615f46-c063-4063-942b-ddb59657611e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:18.570405 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:18.570644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-397a18ab-726d-44ca-9de7-b809f3f5e010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:18.570644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:18.570644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:18.570644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:18.570644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:18.570644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:18.570644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:18.570644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:18.570644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:18.570644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:18.570644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:18.570644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:18.570644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:18.570644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:18.570644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:18.571462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:18.571462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:18.571462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:18.571462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:18.571462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:18.571462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:18.571462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:18.571462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:18.571462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:18.571462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:18.571462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:18.571462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:18.571462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:18.571462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:18.571462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:18.571462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:18.571462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:18.572401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:18.572401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:18.572401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:18.572401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:18.572401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 263/520] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:18.572825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a18ab-726d-44ca-9de7-b809f3f5e010 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:18.589781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-24615f46-c063-4063-942b-ddb59657611e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:18.589781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:18.589781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:18.589781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:18.589781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:18.589781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:18.589781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:18.589781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:18.589781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:18.589781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:18.589781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:18.589781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:18.589781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:18.589781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:18.589781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:18.590689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:18.590689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:18.590689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:18.590689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:18.590689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:18.590689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:18.590689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:18.590689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:18.590689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:18.590689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:18.590689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:18.590689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:18.590689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:18.590689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:18.590689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:18.590689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:18.590689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:18.591583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:18.591583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:18.591583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:18.591583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:18.591583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:18.591583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:18.591583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:18.591583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:18.596116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 258/521] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:18.597230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24615f46-c063-4063-942b-ddb59657611e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:18.630809 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:18.685229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a18ab-726d-44ca-9de7-b809f3f5e010 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:18.721163 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24615f46-c063-4063-942b-ddb59657611e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:18.724289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3c08f-3c49-4962-a68c-d1049c223e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:18.725091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3c08f-3c49-4962-a68c-d1049c223e92 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:18.725433 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3c08f-3c49-4962-a68c-d1049c223e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:18.725768 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3c08f-3c49-4962-a68c-d1049c223e92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:18.758815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03429d-46d2-4c26-9a62-760a1f16519a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:18.759617 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03429d-46d2-4c26-9a62-760a1f16519a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:18.759888 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03429d-46d2-4c26-9a62-760a1f16519a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:18.760152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03429d-46d2-4c26-9a62-760a1f16519a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:18.767402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03429d-46d2-4c26-9a62-760a1f16519a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:18.768887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03429d-46d2-4c26-9a62-760a1f16519a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:18.783684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7a03429d-46d2-4c26-9a62-760a1f16519a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 03:15:18.783684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:18.783684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:18.783684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:18.783684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:18.783684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:18.783684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:18.783684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:18.783684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:18.783684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:18.783684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:18.783684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:18.783684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:18.783684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:18.783684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:18.783684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:18.784654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:18.785540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:18.785540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:18.785540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:18.785540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:18.785540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:18.785540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:18.785540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:18.785540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:18.785540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 03:15:18.785540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:18.785540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 259/522] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:18.786113 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03429d-46d2-4c26-9a62-760a1f16519a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:18.800579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3c08f-3c49-4962-a68c-d1049c223e92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:18.802067 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3c08f-3c49-4962-a68c-d1049c223e92 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:18.849756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:18.859423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:18.894672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03429d-46d2-4c26-9a62-760a1f16519a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:18.916530 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 264/523] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:15:18.916530 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3c08f-3c49-4962-a68c-d1049c223e92 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:18.940443 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d680d-d14c-45a2-b776-7ec7fb03be27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:18.941070 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d680d-d14c-45a2-b776-7ec7fb03be27 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:18.941349 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d680d-d14c-45a2-b776-7ec7fb03be27 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:18.941627 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d680d-d14c-45a2-b776-7ec7fb03be27 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:18.942359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d680d-d14c-45a2-b776-7ec7fb03be27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:18.942660 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d680d-d14c-45a2-b776-7ec7fb03be27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:18.944054 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d680d-d14c-45a2-b776-7ec7fb03be27 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:18.957064 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 260/524] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:18.957962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d680d-d14c-45a2-b776-7ec7fb03be27 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:19.028767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3c08f-3c49-4962-a68c-d1049c223e92 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:19.065654 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043f5d6-363c-4aa1-930e-d41e331d5fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:19.066319 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043f5d6-363c-4aa1-930e-d41e331d5fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:19.066603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043f5d6-363c-4aa1-930e-d41e331d5fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:19.066875 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043f5d6-363c-4aa1-930e-d41e331d5fb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:19.067742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043f5d6-363c-4aa1-930e-d41e331d5fb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:19.068047 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043f5d6-363c-4aa1-930e-d41e331d5fb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:19.069688 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043f5d6-363c-4aa1-930e-d41e331d5fb8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:19.073980 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d680d-d14c-45a2-b776-7ec7fb03be27 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:19.094292 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 265/525] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:19.094292 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043f5d6-363c-4aa1-930e-d41e331d5fb8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:19.098172 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:19.108644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:19.117152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c30ef-18fa-4337-815b-b93abecfda75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:19.117864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c30ef-18fa-4337-815b-b93abecfda75 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:19.118149 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c30ef-18fa-4337-815b-b93abecfda75 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:19.118437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c30ef-18fa-4337-815b-b93abecfda75 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:19.119291 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c30ef-18fa-4337-815b-b93abecfda75 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:19.119597 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c30ef-18fa-4337-815b-b93abecfda75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:19.121327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c30ef-18fa-4337-815b-b93abecfda75 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:19.164641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 261/526] 10.222.0.26 () {56 vars in 1139 bytes} [Tue Jul 12 03:15:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:19.164641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c30ef-18fa-4337-815b-b93abecfda75 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:19.207915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043f5d6-363c-4aa1-930e-d41e331d5fb8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:19.244745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14986ab4-016d-4c58-b552-00477721bae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:19.245557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14986ab4-016d-4c58-b552-00477721bae4 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:19.245838 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14986ab4-016d-4c58-b552-00477721bae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:19.246112 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14986ab4-016d-4c58-b552-00477721bae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:19.257201 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14986ab4-016d-4c58-b552-00477721bae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:19.259321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14986ab4-016d-4c58-b552-00477721bae4 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:19.277794 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c30ef-18fa-4337-815b-b93abecfda75 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:19.280432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-14986ab4-016d-4c58-b552-00477721bae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:19.280432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:19.280432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:19.280432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:19.280432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:19.280432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:19.280432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:19.280432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:19.280432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:19.280432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:19.280432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:19.280432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:19.280432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:19.280432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:19.280432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:19.281320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:19.281320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:19.281320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:19.281320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:19.281320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:19.281320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:19.281320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:19.281320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:19.281320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:19.281320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:19.281320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:19.281320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:19.281320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:19.281320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:19.281320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:19.281320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:19.281320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:19.282576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:19.282576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:19.282576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:19.282576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:19.282576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 266/527] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:19.283026 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14986ab4-016d-4c58-b552-00477721bae4 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:19.315293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edce745-d433-45d3-9d4e-cb925ff01de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:19.316316 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edce745-d433-45d3-9d4e-cb925ff01de0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:19.316777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edce745-d433-45d3-9d4e-cb925ff01de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:19.317049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edce745-d433-45d3-9d4e-cb925ff01de0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:19.323957 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edce745-d433-45d3-9d4e-cb925ff01de0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:19.325457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edce745-d433-45d3-9d4e-cb925ff01de0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:19.339431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-9edce745-d433-45d3-9d4e-cb925ff01de0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:19.339431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:19.339431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:19.339431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:19.339431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:19.339431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:19.339431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:19.339431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:19.339431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:19.339431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:19.339431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:19.339431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:19.339431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:19.339431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:19.339431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:19.340899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:19.340899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:19.340899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:19.340899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:19.340899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:19.340899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:19.340899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:19.340899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:19.340899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:19.340899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:19.340899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:19.340899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:19.340899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:19.340899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:19.340899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:19.340899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:19.340899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:19.341789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:19.341789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:19.341789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:19.341789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:19.341789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:19.341789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:19.341789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:19.341789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:19.341789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 262/528] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:19.341789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edce745-d433-45d3-9d4e-cb925ff01de0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:19.355998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:19.383127 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:19.398732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14986ab4-016d-4c58-b552-00477721bae4 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:19.433740 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d3669-95eb-4d8a-87e6-458f3d594c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:19.434393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d3669-95eb-4d8a-87e6-458f3d594c68 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:19.434669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d3669-95eb-4d8a-87e6-458f3d594c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:19.434933 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d3669-95eb-4d8a-87e6-458f3d594c68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:19.435806 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d3669-95eb-4d8a-87e6-458f3d594c68 None admin] RBAC: Adding query filter params (role.id=8a9636f0fea542a19f6fcaf54b9c1d11, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=0c43d9d0a6264b19a843077a4669ce70) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:19.436110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d3669-95eb-4d8a-87e6-458f3d594c68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:19.437575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d3669-95eb-4d8a-87e6-458f3d594c68 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:19.444104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 267/529] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:15:19 2022] GET /identity/v3/role_assignments?user.id=0c43d9d0a6264b19a843077a4669ce70&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=8a9636f0fea542a19f6fcaf54b9c1d11 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:19.444810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d3669-95eb-4d8a-87e6-458f3d594c68 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:19.452913 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edce745-d433-45d3-9d4e-cb925ff01de0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:19.504232 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ade82-87cd-4676-ad81-77ad643b6823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:19.505279 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ade82-87cd-4676-ad81-77ad643b6823 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:19.505781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ade82-87cd-4676-ad81-77ad643b6823 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:19.506988 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ade82-87cd-4676-ad81-77ad643b6823 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:19.594226 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d3669-95eb-4d8a-87e6-458f3d594c68 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:19.614327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ade82-87cd-4676-ad81-77ad643b6823 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:19.616164 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ade82-87cd-4676-ad81-77ad643b6823 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:19.627319 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:19.637586 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc1a20-458a-4d3d-ae47-56e4976f7085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:19.638769 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc1a20-458a-4d3d-ae47-56e4976f7085 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:19.639624 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc1a20-458a-4d3d-ae47-56e4976f7085 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:19.640038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc1a20-458a-4d3d-ae47-56e4976f7085 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:19.641188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc1a20-458a-4d3d-ae47-56e4976f7085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:19.641655 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc1a20-458a-4d3d-ae47-56e4976f7085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:19.643761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc1a20-458a-4d3d-ae47-56e4976f7085 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:19.659825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 268/530] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:19.661173 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc1a20-458a-4d3d-ae47-56e4976f7085 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:19.662437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:19.751097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 263/531] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:15:19.752173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ade82-87cd-4676-ad81-77ad643b6823 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:19.796631 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc1a20-458a-4d3d-ae47-56e4976f7085 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:19.840776 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085b8db-2fe1-41c1-9ce5-c2c7f403b63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:19.841773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085b8db-2fe1-41c1-9ce5-c2c7f403b63c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:19.842188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085b8db-2fe1-41c1-9ce5-c2c7f403b63c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:19.842594 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085b8db-2fe1-41c1-9ce5-c2c7f403b63c None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:19.843516 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085b8db-2fe1-41c1-9ce5-c2c7f403b63c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:19.843954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085b8db-2fe1-41c1-9ce5-c2c7f403b63c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:19.846114 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085b8db-2fe1-41c1-9ce5-c2c7f403b63c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:19.860740 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 269/532] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:19.861938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085b8db-2fe1-41c1-9ce5-c2c7f403b63c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:19.874939 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ade82-87cd-4676-ad81-77ad643b6823 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:19.912231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:19.912810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d69850-2064-4e93-af7d-e976f1aaefe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:19.914656 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d69850-2064-4e93-af7d-e976f1aaefe8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:19.915095 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d69850-2064-4e93-af7d-e976f1aaefe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:19.915536 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d69850-2064-4e93-af7d-e976f1aaefe8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:19.919457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:19.928324 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d69850-2064-4e93-af7d-e976f1aaefe8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:19.930096 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d69850-2064-4e93-af7d-e976f1aaefe8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:19.948546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-62d69850-2064-4e93-af7d-e976f1aaefe8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:19.948546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:19.948546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:19.948546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:19.948546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:19.948546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:19.948546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:19.948546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:19.948546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:19.948546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:19.948546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:19.948546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:19.948546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:19.948546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:19.948546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:19.949560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:19.949560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:19.949560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:19.949560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:19.949560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:19.949560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:19.949560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:19.949560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:19.949560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:19.949560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:19.949560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:19.949560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:19.949560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:19.949560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:19.949560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:19.949560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:19.949560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:19.950570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:19.950570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:19.950570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:19.950570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:19.950570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:19.950570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:19.950570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:19.950570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:19.953357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 264/533] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:19.954606 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d69850-2064-4e93-af7d-e976f1aaefe8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:19.970442 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085b8db-2fe1-41c1-9ce5-c2c7f403b63c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:20.008410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4060fea-ea8a-416c-8faf-a343d70c49bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:20.009516 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4060fea-ea8a-416c-8faf-a343d70c49bf None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:20.009967 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4060fea-ea8a-416c-8faf-a343d70c49bf None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:20.010753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4060fea-ea8a-416c-8faf-a343d70c49bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:20.025606 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4060fea-ea8a-416c-8faf-a343d70c49bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:20.028193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4060fea-ea8a-416c-8faf-a343d70c49bf None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:20.050923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d4060fea-ea8a-416c-8faf-a343d70c49bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:20.050923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:20.050923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:20.050923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:20.050923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:20.050923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:20.050923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:20.050923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:20.050923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:20.050923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:20.050923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:20.050923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:20.050923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:20.050923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:20.050923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:20.051947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:20.051947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:20.051947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:20.051947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:20.051947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:20.051947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:20.051947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:20.051947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:20.051947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:20.051947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:20.051947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:20.051947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:20.051947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:20.051947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:20.051947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:20.051947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:20.051947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:20.053014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:20.053014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:20.053014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:20.053014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:20.055501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 270/534] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:20.056753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4060fea-ea8a-416c-8faf-a343d70c49bf None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:20.073642 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d69850-2064-4e93-af7d-e976f1aaefe8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:20.110019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c16d9-38f5-4662-97d7-b6c35457386e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:20.110829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c16d9-38f5-4662-97d7-b6c35457386e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:20.111222 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c16d9-38f5-4662-97d7-b6c35457386e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:20.111584 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c16d9-38f5-4662-97d7-b6c35457386e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:20.112530 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c16d9-38f5-4662-97d7-b6c35457386e None admin] RBAC: Adding query filter params (role.id=8a9636f0fea542a19f6fcaf54b9c1d11, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=97fe9d04ccb445208f3783a8b55cd31e) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:20.112940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c16d9-38f5-4662-97d7-b6c35457386e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:20.114944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c16d9-38f5-4662-97d7-b6c35457386e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:20.122987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 265/535] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:15:19 2022] GET /identity/v3/role_assignments?user.id=97fe9d04ccb445208f3783a8b55cd31e&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=8a9636f0fea542a19f6fcaf54b9c1d11 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:20.124258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c16d9-38f5-4662-97d7-b6c35457386e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:20.188077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:20.192185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4060fea-ea8a-416c-8faf-a343d70c49bf None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:20.204969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:20.233775 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f1efb-99e3-4275-aa82-20059579c6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:20.234696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f1efb-99e3-4275-aa82-20059579c6dc None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:20.235378 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f1efb-99e3-4275-aa82-20059579c6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:20.235726 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f1efb-99e3-4275-aa82-20059579c6dc None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:20.236639 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f1efb-99e3-4275-aa82-20059579c6dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:20.237022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f1efb-99e3-4275-aa82-20059579c6dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:20.239103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f1efb-99e3-4275-aa82-20059579c6dc None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:20.251645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c16d9-38f5-4662-97d7-b6c35457386e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:20.256297 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 271/536] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:20.257870 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377828b2-45ab-405e-ac09-205600fd3e19 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:20.258228 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377828b2-45ab-405e-ac09-205600fd3e19 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:20.258572 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377828b2-45ab-405e-ac09-205600fd3e19 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:20.265589 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 272/537] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:20.266994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377828b2-45ab-405e-ac09-205600fd3e19 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:20.293782 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a5b1d-9d10-4948-98f0-7e91a7e5cba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:20.294648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a5b1d-9d10-4948-98f0-7e91a7e5cba4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:20.295085 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a5b1d-9d10-4948-98f0-7e91a7e5cba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:20.295369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a5b1d-9d10-4948-98f0-7e91a7e5cba4 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:20.296103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a5b1d-9d10-4948-98f0-7e91a7e5cba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:20.296774 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a5b1d-9d10-4948-98f0-7e91a7e5cba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:20.298087 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a5b1d-9d10-4948-98f0-7e91a7e5cba4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:20.313623 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 266/538] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:20.315102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ad573-2452-4c71-803d-0bb8ff764b0b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:20.315445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ad573-2452-4c71-803d-0bb8ff764b0b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:20.315703 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ad573-2452-4c71-803d-0bb8ff764b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:20.335578 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0f1ad573-2452-4c71-803d-0bb8ff764b0b None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:20.336833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0f1ad573-2452-4c71-803d-0bb8ff764b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:20.398163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377828b2-45ab-405e-ac09-205600fd3e19 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:20.416037 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 267/539] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:20.417522 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ad573-2452-4c71-803d-0bb8ff764b0b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:20.453567 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6180d-2e41-4eac-9ba8-5a2df878f3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:20.454315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6180d-2e41-4eac-9ba8-5a2df878f3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:20.454660 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6180d-2e41-4eac-9ba8-5a2df878f3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:20.454990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6180d-2e41-4eac-9ba8-5a2df878f3a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:20.455884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6180d-2e41-4eac-9ba8-5a2df878f3a8 None admin] RBAC: Adding query filter params (role.id=8a9636f0fea542a19f6fcaf54b9c1d11, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=99605c4dd01f48e39a3e29a74114506d) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:20.456252 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6180d-2e41-4eac-9ba8-5a2df878f3a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:20.457803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6180d-2e41-4eac-9ba8-5a2df878f3a8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:20.464016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 273/540] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:15:20 2022] GET /identity/v3/role_assignments?user.id=99605c4dd01f48e39a3e29a74114506d&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=8a9636f0fea542a19f6fcaf54b9c1d11 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:20.464994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6180d-2e41-4eac-9ba8-5a2df878f3a8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:20.493739 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:20.495457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:20.570406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ad573-2452-4c71-803d-0bb8ff764b0b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:20.583888 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6180d-2e41-4eac-9ba8-5a2df878f3a8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:20.617189 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164e742-d0ac-4512-9710-7ecf375f3e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:20.618804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164e742-d0ac-4512-9710-7ecf375f3e33 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:20.619103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164e742-d0ac-4512-9710-7ecf375f3e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:20.619374 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164e742-d0ac-4512-9710-7ecf375f3e33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:20.627835 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164e742-d0ac-4512-9710-7ecf375f3e33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:20.629388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164e742-d0ac-4512-9710-7ecf375f3e33 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:20.646254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-0164e742-d0ac-4512-9710-7ecf375f3e33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:20.646254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:20.646254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:20.646254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:20.646254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:20.646254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:20.646254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:20.646254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:20.646254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:20.646254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:20.646254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:20.646254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:20.646254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:20.646254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:20.646254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:20.648217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:20.648217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:20.648217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:20.648217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:20.648217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:20.648217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:20.648217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:20.648217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:20.648217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:20.648217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:20.648217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:20.648217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:20.648217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:20.648217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:20.648217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:20.648217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:20.648217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:20.650188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:20.650188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:20.650188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:20.650188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:20.650188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:20.650188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:20.650188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:20.650188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:20.650188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 268/541] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:20.651232 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bee87-dff9-444d-93d1-f9757005df33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:20.651232 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bee87-dff9-444d-93d1-f9757005df33 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:20.651232 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bee87-dff9-444d-93d1-f9757005df33 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:20.651232 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bee87-dff9-444d-93d1-f9757005df33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:20.655666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164e742-d0ac-4512-9710-7ecf375f3e33 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:20.667302 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bee87-dff9-444d-93d1-f9757005df33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:20.681423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-756bee87-dff9-444d-93d1-f9757005df33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:20.681423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:20.681423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:20.681423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:20.681423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:20.681423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:20.681423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:20.681423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:20.681423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:20.681423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:20.681423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:20.681423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:20.681423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:20.681423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:20.681423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:20.681423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:20.683519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:20.683519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:20.683519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:20.683519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:20.683519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:20.683519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:20.683519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:20.683519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:20.683519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:20.683519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:20.683519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:20.683519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:20.683519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:20.683519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:20.683519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:20.683519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:20.685081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:20.685081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:20.685081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:20.685081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:20.685081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:20.685081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:20.685081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:20.685081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:20.685081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:20.685081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:20.685081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:20.685081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:20.685081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 274/542] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:20.693123 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bee87-dff9-444d-93d1-f9757005df33 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:20.803635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164e742-d0ac-4512-9710-7ecf375f3e33 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:20.818754 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:20.820818 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:20.849109 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bee87-dff9-444d-93d1-f9757005df33 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:20.865033 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e30803-1675-4199-bed8-5826dc7c2f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:20.865707 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e30803-1675-4199-bed8-5826dc7c2f91 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:20.865985 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e30803-1675-4199-bed8-5826dc7c2f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:20.866258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e30803-1675-4199-bed8-5826dc7c2f91 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:20.867059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e30803-1675-4199-bed8-5826dc7c2f91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:20.867365 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e30803-1675-4199-bed8-5826dc7c2f91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:20.868871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e30803-1675-4199-bed8-5826dc7c2f91 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:20.905179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 269/543] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:20.909801 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e30803-1675-4199-bed8-5826dc7c2f91 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:20.912028 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1f8ce-d2e9-487f-b628-d2fea29ad68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:20.912775 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1f8ce-d2e9-487f-b628-d2fea29ad68f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:20.913079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1f8ce-d2e9-487f-b628-d2fea29ad68f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:20.913357 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1f8ce-d2e9-487f-b628-d2fea29ad68f None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:20.914179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1f8ce-d2e9-487f-b628-d2fea29ad68f None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:20.914485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1f8ce-d2e9-487f-b628-d2fea29ad68f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:20.915866 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1f8ce-d2e9-487f-b628-d2fea29ad68f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:20.926803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 275/544] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:20.932655 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1f8ce-d2e9-487f-b628-d2fea29ad68f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:21.057659 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e30803-1675-4199-bed8-5826dc7c2f91 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:21.111856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebff5d5-1eab-4d3f-9119-15dfc27f4890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:21.112455 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebff5d5-1eab-4d3f-9119-15dfc27f4890 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:21.118753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebff5d5-1eab-4d3f-9119-15dfc27f4890 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:21.119051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebff5d5-1eab-4d3f-9119-15dfc27f4890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:21.119923 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebff5d5-1eab-4d3f-9119-15dfc27f4890 None admin] RBAC: Adding query filter params (role.id=8a9636f0fea542a19f6fcaf54b9c1d11, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=c2908efc19944583810abceb4c5d8d5f) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:21.120242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebff5d5-1eab-4d3f-9119-15dfc27f4890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:21.121762 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebff5d5-1eab-4d3f-9119-15dfc27f4890 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:21.134072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 270/545] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:15:20 2022] GET /identity/v3/role_assignments?user.id=c2908efc19944583810abceb4c5d8d5f&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=8a9636f0fea542a19f6fcaf54b9c1d11 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:21.154461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1f8ce-d2e9-487f-b628-d2fea29ad68f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:21.191302 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d74afa-220b-4aec-9230-a955ca56ad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:21.192123 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d74afa-220b-4aec-9230-a955ca56ad2d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:21.192401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d74afa-220b-4aec-9230-a955ca56ad2d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:21.192708 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d74afa-220b-4aec-9230-a955ca56ad2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:21.204317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d74afa-220b-4aec-9230-a955ca56ad2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:21.205876 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d74afa-220b-4aec-9230-a955ca56ad2d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:21.222153 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:21.229593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-23d74afa-220b-4aec-9230-a955ca56ad2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:21.229593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:21.229593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:21.229593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:21.229593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:21.229593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:21.229593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:21.229593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:21.229593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:21.229593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:21.229593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:21.229593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:21.229593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:21.229593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:21.229593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:21.232788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:21.232788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:21.232788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:21.232788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:21.232788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:21.232788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:21.232788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:21.232788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:21.232788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:21.232788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:21.232788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:21.232788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:21.232788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:21.232788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:21.232788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:21.232788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:21.232788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:21.233614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:21.233614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:21.233614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:21.233614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:21.233614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 276/546] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:21.237321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebff5d5-1eab-4d3f-9119-15dfc27f4890 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:21.275501 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:21.362980 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebff5d5-1eab-4d3f-9119-15dfc27f4890 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:21.400020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45769111-b7f9-40be-a06d-021575a1eb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:21.400811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45769111-b7f9-40be-a06d-021575a1eb08 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:21.401097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45769111-b7f9-40be-a06d-021575a1eb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:21.401370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45769111-b7f9-40be-a06d-021575a1eb08 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:21.402111 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45769111-b7f9-40be-a06d-021575a1eb08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:21.402417 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45769111-b7f9-40be-a06d-021575a1eb08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:21.404112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45769111-b7f9-40be-a06d-021575a1eb08 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:21.420930 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 271/547] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:21.422299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d74afa-220b-4aec-9230-a955ca56ad2d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:21.529594 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d74afa-220b-4aec-9230-a955ca56ad2d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:21.564374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2aed2-a79d-4b19-9ff3-47fdece3793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:21.565218 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2aed2-a79d-4b19-9ff3-47fdece3793d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:21.565500 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2aed2-a79d-4b19-9ff3-47fdece3793d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:21.565770 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2aed2-a79d-4b19-9ff3-47fdece3793d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:21.573640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2aed2-a79d-4b19-9ff3-47fdece3793d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:21.575092 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2aed2-a79d-4b19-9ff3-47fdece3793d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:21.589978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-f9f2aed2-a79d-4b19-9ff3-47fdece3793d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 03:15:21.589978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:21.589978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:21.589978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:21.589978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:21.589978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:21.589978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:21.589978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:21.589978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:21.589978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:21.589978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:21.589978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:21.589978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:21.589978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:21.589978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:21.589978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:21.590969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:21.592501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:21.592501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:21.592501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:21.592501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:21.592501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:21.592501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:21.592501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:21.592501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:21.592501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 03:15:21.592501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:21.592501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 277/548] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:15:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:21.597765 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45769111-b7f9-40be-a06d-021575a1eb08 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:21.694239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:21.708823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45769111-b7f9-40be-a06d-021575a1eb08 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:21.752883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f525886-41c7-418b-be27-e0b6c5ff67f1 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:21.753497 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f525886-41c7-418b-be27-e0b6c5ff67f1 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:21.753962 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f525886-41c7-418b-be27-e0b6c5ff67f1 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:21.755785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 278/549] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:15:21.755907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e1f4f-194d-485a-90b8-9840abd2021e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:21.759761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e1f4f-194d-485a-90b8-9840abd2021e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:21.759761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e1f4f-194d-485a-90b8-9840abd2021e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:21.759761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e1f4f-194d-485a-90b8-9840abd2021e None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:21.759761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e1f4f-194d-485a-90b8-9840abd2021e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:21.759761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e1f4f-194d-485a-90b8-9840abd2021e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:21.760260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e1f4f-194d-485a-90b8-9840abd2021e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:21.761624 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad68af5-0ac6-4d47-916e-c0f2f2221df3 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:21.762101 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad68af5-0ac6-4d47-916e-c0f2f2221df3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:21.762559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad68af5-0ac6-4d47-916e-c0f2f2221df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:21.795783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 272/550] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Jul 12 03:15:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:21.797132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6ad68af5-0ac6-4d47-916e-c0f2f2221df3 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:21.798559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6ad68af5-0ac6-4d47-916e-c0f2f2221df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:21.801578 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e1f4f-194d-485a-90b8-9840abd2021e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:21.903485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:21.918724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 279/551] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:21.952687 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad68af5-0ac6-4d47-916e-c0f2f2221df3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:22.014095 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e1f4f-194d-485a-90b8-9840abd2021e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:22.073829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad68af5-0ac6-4d47-916e-c0f2f2221df3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:22.114878 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74090db3-0d85-40ea-828a-e276496be8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:22.115693 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74090db3-0d85-40ea-828a-e276496be8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:22.115971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74090db3-0d85-40ea-828a-e276496be8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:22.116243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74090db3-0d85-40ea-828a-e276496be8a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:22.120709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f222a8f-938e-43d8-8390-fc731306aaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:22.121368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f222a8f-938e-43d8-8390-fc731306aaea None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:22.121647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f222a8f-938e-43d8-8390-fc731306aaea None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:22.121919 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f222a8f-938e-43d8-8390-fc731306aaea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:22.141520 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74090db3-0d85-40ea-828a-e276496be8a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:22.149447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-74090db3-0d85-40ea-828a-e276496be8a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:22.149447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:22.149447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:22.149447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:22.149447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:22.149447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:22.149447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:22.149447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:22.149447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:22.149447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:22.149447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:22.149447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:22.149447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:22.149447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:22.149447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:22.149447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:22.150320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:22.150320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:22.150320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:22.150320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:22.150320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:22.150320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:22.150320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:22.150320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:22.150320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:22.150320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:22.150320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:22.150320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:22.150320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:22.150320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:22.150320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:22.150320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:22.151209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:22.151209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:22.151209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:22.151209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:22.151209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:22.151209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:22.151209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:22.151209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:22.151209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:22.151209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:22.151209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:22.151209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:22.151829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 280/552] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:22.159143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74090db3-0d85-40ea-828a-e276496be8a6 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:22.173143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:22.256010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:22.265416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f222a8f-938e-43d8-8390-fc731306aaea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:22.267215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f222a8f-938e-43d8-8390-fc731306aaea None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:22.354618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74090db3-0d85-40ea-828a-e276496be8a6 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:22.410772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921dd51-f96e-43a0-9f30-56b533a4e051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:22.411857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921dd51-f96e-43a0-9f30-56b533a4e051 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:22.412509 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921dd51-f96e-43a0-9f30-56b533a4e051 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:22.413778 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921dd51-f96e-43a0-9f30-56b533a4e051 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:22.414762 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921dd51-f96e-43a0-9f30-56b533a4e051 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:22.418208 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921dd51-f96e-43a0-9f30-56b533a4e051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:22.420043 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921dd51-f96e-43a0-9f30-56b533a4e051 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:22.441595 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 281/553] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:22.449585 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921dd51-f96e-43a0-9f30-56b533a4e051 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:22.469031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 273/554] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:15:22.471616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb62225-af68-4968-a4cb-3b59837d63a8 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:22.472623 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb62225-af68-4968-a4cb-3b59837d63a8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:22.473224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb62225-af68-4968-a4cb-3b59837d63a8 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:22.475909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 274/555] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:22.477025 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb62225-af68-4968-a4cb-3b59837d63a8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:22.542469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:22.578753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921dd51-f96e-43a0-9f30-56b533a4e051 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:22.590470 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:22.605622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb62225-af68-4968-a4cb-3b59837d63a8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:22.615006 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efb6b3-015f-40dd-90f0-d3b6fe6c3c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:22.615986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efb6b3-015f-40dd-90f0-d3b6fe6c3c8d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:22.616352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efb6b3-015f-40dd-90f0-d3b6fe6c3c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:22.616788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efb6b3-015f-40dd-90f0-d3b6fe6c3c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:22.627896 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efb6b3-015f-40dd-90f0-d3b6fe6c3c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:22.629566 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efb6b3-015f-40dd-90f0-d3b6fe6c3c8d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:22.642959 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37f718-1006-449d-9774-a1963038e38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:22.643948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f718-1006-449d-9774-a1963038e38e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:22.644374 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f718-1006-449d-9774-a1963038e38e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:22.644849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f718-1006-449d-9774-a1963038e38e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:22.650362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-56efb6b3-015f-40dd-90f0-d3b6fe6c3c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:22.650362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:22.650362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:22.650362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:22.650362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:22.650362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:22.650362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:22.650362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:22.650362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:22.650362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:22.650362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:22.650362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:22.650362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:22.650362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:22.650362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:22.651282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:22.651282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:22.651282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:22.651282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:22.651282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:22.651282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:22.651282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:22.651282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:22.651282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:22.651282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:22.651282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:22.651282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:22.651282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:22.651282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:22.651282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:22.651282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:22.651282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:22.652132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:22.652132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:22.652132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:22.652132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:22.652477 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 282/556] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:22.653994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36241c51-7ee3-4ee0-8460-5837c1c35544 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:22.654336 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36241c51-7ee3-4ee0-8460-5837c1c35544 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:22.655102 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36241c51-7ee3-4ee0-8460-5837c1c35544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:22.658910 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37f718-1006-449d-9774-a1963038e38e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:22.660747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37f718-1006-449d-9774-a1963038e38e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:22.674001 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-36241c51-7ee3-4ee0-8460-5837c1c35544 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:22.675294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-36241c51-7ee3-4ee0-8460-5837c1c35544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:22.683280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-6c37f718-1006-449d-9774-a1963038e38e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:22.683280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:22.683280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:22.683280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:22.683280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:22.683280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:22.683280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:22.683280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:22.683280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:22.683280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:22.683280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:22.683280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:22.683280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:22.683280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:22.683280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:22.684849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:22.684849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:22.684849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:22.684849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:22.684849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:22.684849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:22.684849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:22.684849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:22.684849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:22.684849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:22.684849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:22.684849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:22.684849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:22.684849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:22.684849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:22.684849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:22.684849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:22.685822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:22.685822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:22.685822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:22.685822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:22.688280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 275/557] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:22.689532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37f718-1006-449d-9774-a1963038e38e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:22.775185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 283/558] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:22.776405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36241c51-7ee3-4ee0-8460-5837c1c35544 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:22.829053 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37f718-1006-449d-9774-a1963038e38e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:22.833362 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:22.868250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f14b3-b929-4a6d-b3d8-d54b26f8a357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:22.869179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f14b3-b929-4a6d-b3d8-d54b26f8a357 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:22.869480 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f14b3-b929-4a6d-b3d8-d54b26f8a357 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:22.869874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f14b3-b929-4a6d-b3d8-d54b26f8a357 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:22.870550 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f14b3-b929-4a6d-b3d8-d54b26f8a357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:22.870852 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f14b3-b929-4a6d-b3d8-d54b26f8a357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:22.872616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f14b3-b929-4a6d-b3d8-d54b26f8a357 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:22.876180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:22.885158 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 276/559] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:22.886121 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36241c51-7ee3-4ee0-8460-5837c1c35544 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:22.886447 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f14b3-b929-4a6d-b3d8-d54b26f8a357 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:22.926304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f85ce-2294-4652-b5a6-215a6ba96195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:22.926967 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f85ce-2294-4652-b5a6-215a6ba96195 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:22.927240 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f85ce-2294-4652-b5a6-215a6ba96195 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:22.927508 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f85ce-2294-4652-b5a6-215a6ba96195 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:22.928228 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f85ce-2294-4652-b5a6-215a6ba96195 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:22.928754 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f85ce-2294-4652-b5a6-215a6ba96195 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:22.929903 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f85ce-2294-4652-b5a6-215a6ba96195 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:22.946285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 284/560] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:22.947522 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819ca01-53fb-4cbb-8e23-72c70bbd05c6 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:22.947809 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819ca01-53fb-4cbb-8e23-72c70bbd05c6 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:22.948061 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819ca01-53fb-4cbb-8e23-72c70bbd05c6 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:22.952698 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 285/561] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:22.952698 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819ca01-53fb-4cbb-8e23-72c70bbd05c6 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:22.993460 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f14b3-b929-4a6d-b3d8-d54b26f8a357 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:23.029003 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e290d-0f90-408f-a327-96642b35f261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:23.030119 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e290d-0f90-408f-a327-96642b35f261 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:23.030576 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e290d-0f90-408f-a327-96642b35f261 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:23.030840 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e290d-0f90-408f-a327-96642b35f261 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:23.041253 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e290d-0f90-408f-a327-96642b35f261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:23.048955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3b5e290d-0f90-408f-a327-96642b35f261 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:23.048955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:23.048955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:23.048955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:23.048955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:23.048955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:23.048955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:23.048955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:23.048955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:23.048955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:23.048955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:23.048955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:23.048955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:23.048955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:23.048955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:23.048955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:23.049857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:23.049857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:23.049857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:23.049857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:23.049857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:23.049857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:23.049857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:23.049857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:23.049857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:23.049857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:23.049857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:23.049857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:23.049857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:23.049857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:23.049857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:23.049857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:23.050744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:23.050744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:23.050744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:23.050744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:23.050744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:23.050744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:23.050744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:23.050744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:23.050744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:23.050744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:23.050744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:23.050744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:23.050744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 277/562] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:23.051433 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e290d-0f90-408f-a327-96642b35f261 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:23.069696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819ca01-53fb-4cbb-8e23-72c70bbd05c6 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:23.082726 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:23.106501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7e596-1f88-4f4b-9a6e-16271fa8bf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:23.107815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7e596-1f88-4f4b-9a6e-16271fa8bf8a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:23.108241 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7e596-1f88-4f4b-9a6e-16271fa8bf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:23.108712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7e596-1f88-4f4b-9a6e-16271fa8bf8a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:23.117130 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7e596-1f88-4f4b-9a6e-16271fa8bf8a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:23.118592 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7e596-1f88-4f4b-9a6e-16271fa8bf8a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:23.132629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-27a7e596-1f88-4f4b-9a6e-16271fa8bf8a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:15:23.132629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:23.132629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:23.132629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:23.132629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:23.132629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:23.132629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:23.132629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:23.132629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:23.132629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:23.132629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:23.132629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:23.132629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:23.132629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:23.132629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:23.132629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:23.133609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:23.134518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:23.134518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:23.134518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:23.134518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:23.134518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:23.134518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:23.134518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:23.134518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:23.134518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:15:23.134518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:23.134518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 286/563] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 03:15:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:23.135597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec14a91-a9b2-4d22-b92f-e3721c461968 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:23.135597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec14a91-a9b2-4d22-b92f-e3721c461968 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:23.135855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec14a91-a9b2-4d22-b92f-e3721c461968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:23.153229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9ec14a91-a9b2-4d22-b92f-e3721c461968 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:23.154468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9ec14a91-a9b2-4d22-b92f-e3721c461968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:23.162385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:23.167105 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e290d-0f90-408f-a327-96642b35f261 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:23.201749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3d60b-5244-4ef6-b868-6a3ab67a5faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:23.202562 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3d60b-5244-4ef6-b868-6a3ab67a5faa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:23.202841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3d60b-5244-4ef6-b868-6a3ab67a5faa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:23.203114 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3d60b-5244-4ef6-b868-6a3ab67a5faa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:23.210359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3d60b-5244-4ef6-b868-6a3ab67a5faa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:23.211817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3d60b-5244-4ef6-b868-6a3ab67a5faa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:23.226871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b8a3d60b-5244-4ef6-b868-6a3ab67a5faa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:23.226871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:23.226871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:23.226871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:23.226871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:23.226871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:23.226871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:23.226871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:23.226871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:23.226871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:23.226871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:23.226871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:23.226871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:23.226871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:23.226871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:23.227788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:23.227788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:23.227788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:23.227788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:23.227788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:23.227788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:23.227788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:23.227788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:23.227788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:23.227788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:23.227788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:23.227788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:23.227788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:23.227788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:23.227788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:23.227788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:23.227788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:23.228694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:23.228694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:23.228694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:23.228694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:23.228694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:23.228694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:23.228694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:23.228694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:23.228694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 278/564] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:23.229546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3d60b-5244-4ef6-b868-6a3ab67a5faa None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:23.234902 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 287/565] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:23.236118 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec14a91-a9b2-4d22-b92f-e3721c461968 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:23.320722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:23.339028 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3d60b-5244-4ef6-b868-6a3ab67a5faa None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:23.347920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec14a91-a9b2-4d22-b92f-e3721c461968 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:23.380477 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9785d15-3ed9-4288-a92f-6fe508fe8a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:23.381194 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9785d15-3ed9-4288-a92f-6fe508fe8a5b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:23.381719 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9785d15-3ed9-4288-a92f-6fe508fe8a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:23.382002 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9785d15-3ed9-4288-a92f-6fe508fe8a5b None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:23.383399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9785d15-3ed9-4288-a92f-6fe508fe8a5b None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:23.383691 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9785d15-3ed9-4288-a92f-6fe508fe8a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:23.385394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9785d15-3ed9-4288-a92f-6fe508fe8a5b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:23.387124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94deb89d-e5d9-4e8b-ae9d-da0343b9021a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:23.387794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94deb89d-e5d9-4e8b-ae9d-da0343b9021a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:23.388068 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94deb89d-e5d9-4e8b-ae9d-da0343b9021a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:23.388573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94deb89d-e5d9-4e8b-ae9d-da0343b9021a None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:23.389608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94deb89d-e5d9-4e8b-ae9d-da0343b9021a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:23.389911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94deb89d-e5d9-4e8b-ae9d-da0343b9021a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:23.391298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94deb89d-e5d9-4e8b-ae9d-da0343b9021a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:23.399529 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 279/566] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:23.399529 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9785d15-3ed9-4288-a92f-6fe508fe8a5b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:23.409443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:23.417764 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 288/567] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 03:15:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:23.418637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94deb89d-e5d9-4e8b-ae9d-da0343b9021a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:23.505285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9785d15-3ed9-4288-a92f-6fe508fe8a5b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:23.524464 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94deb89d-e5d9-4e8b-ae9d-da0343b9021a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:23.547724 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adad47-44c6-4ce0-985d-0ec019f48f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:23.548888 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adad47-44c6-4ce0-985d-0ec019f48f38 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:23.549367 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adad47-44c6-4ce0-985d-0ec019f48f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:23.549834 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adad47-44c6-4ce0-985d-0ec019f48f38 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:23.551110 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adad47-44c6-4ce0-985d-0ec019f48f38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:23.551497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adad47-44c6-4ce0-985d-0ec019f48f38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:23.553030 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adad47-44c6-4ce0-985d-0ec019f48f38 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:23.559062 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609f7e3-343e-49fb-bae2-94c4396891ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:23.559863 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609f7e3-343e-49fb-bae2-94c4396891ff None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:23.560265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609f7e3-343e-49fb-bae2-94c4396891ff None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:23.560547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609f7e3-343e-49fb-bae2-94c4396891ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:23.571535 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 280/568] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:23.571535 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adad47-44c6-4ce0-985d-0ec019f48f38 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:23.575970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609f7e3-343e-49fb-bae2-94c4396891ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:23.579051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:23.583681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-5609f7e3-343e-49fb-bae2-94c4396891ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:23.583681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:23.583681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:23.583681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:23.583681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:23.583681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:23.583681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:23.583681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:23.583681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:23.583681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:23.583681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:23.583681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:23.583681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:23.583681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:23.583681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:23.583681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:23.584641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:23.584641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:23.584641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:23.584641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:23.584641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:23.584641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:23.584641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:23.584641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:23.584641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:23.584641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:23.584641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:23.584641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:23.584641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:23.584641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:23.584641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:23.584641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:23.585469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:23.585469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:23.585469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:23.585469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:23.585469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:23.585469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:23.585469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:23.585469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:23.585469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:23.585469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:23.585469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:23.585469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:23.585469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 289/569] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:23.586137 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609f7e3-343e-49fb-bae2-94c4396891ff None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:23.651597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:23.685140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adad47-44c6-4ce0-985d-0ec019f48f38 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:23.701305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609f7e3-343e-49fb-bae2-94c4396891ff None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:23.722328 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2c094-43d6-428b-a488-ebb7f1e29990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:23.723129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2c094-43d6-428b-a488-ebb7f1e29990 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:23.723411 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2c094-43d6-428b-a488-ebb7f1e29990 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:23.723683 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2c094-43d6-428b-a488-ebb7f1e29990 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:23.733982 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2c094-43d6-428b-a488-ebb7f1e29990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:23.735511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2c094-43d6-428b-a488-ebb7f1e29990 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:23.736092 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe70b6c-f523-4c7f-b9a5-ad2ea7fc9c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:23.736923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe70b6c-f523-4c7f-b9a5-ad2ea7fc9c9d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:23.737196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe70b6c-f523-4c7f-b9a5-ad2ea7fc9c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:23.737450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe70b6c-f523-4c7f-b9a5-ad2ea7fc9c9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:23.748207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe70b6c-f523-4c7f-b9a5-ad2ea7fc9c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:23.749681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe70b6c-f523-4c7f-b9a5-ad2ea7fc9c9d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:23.753204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3cd2c094-43d6-428b-a488-ebb7f1e29990 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:23.753204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:23.753204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:23.753204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:23.753204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:23.753204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:23.753204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:23.753204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:23.753204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:23.753204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:23.753204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:23.753204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:23.753204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:23.753204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:23.753204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:23.754227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:23.754227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:23.754227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:23.754227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:23.754227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:23.754227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:23.754227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:23.754227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:23.754227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:23.754227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:23.754227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:23.754227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:23.754227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:23.754227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:23.754227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:23.754227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:23.754227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:23.760147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:23.760147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:23.760147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:23.760147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:23.760147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 281/570] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:23.760147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2c094-43d6-428b-a488-ebb7f1e29990 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:23.767303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7fe70b6c-f523-4c7f-b9a5-ad2ea7fc9c9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:23.767303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:23.767303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:23.767303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:23.767303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:23.767303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:23.767303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:23.767303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:23.767303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:23.767303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:23.767303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:23.767303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:23.767303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:23.767303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:23.767303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:23.768249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:23.768249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:23.768249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:23.768249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:23.768249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:23.768249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:23.768249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:23.768249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:23.768249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:23.768249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:23.768249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:23.768249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:23.768249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:23.768249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:23.768249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:23.768249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:23.768249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:23.769139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:23.769139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:23.769139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:23.769139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:23.769139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 290/571] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:23.769407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe70b6c-f523-4c7f-b9a5-ad2ea7fc9c9d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:23.816023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:23.858642 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2c094-43d6-428b-a488-ebb7f1e29990 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:23.868878 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe70b6c-f523-4c7f-b9a5-ad2ea7fc9c9d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:23.881608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:23.892791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96405586-94a7-43a7-804d-238434b98b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:23.893445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96405586-94a7-43a7-804d-238434b98b97 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:23.893726 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96405586-94a7-43a7-804d-238434b98b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:23.894001 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96405586-94a7-43a7-804d-238434b98b97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:23.894838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96405586-94a7-43a7-804d-238434b98b97 None admin] RBAC: Adding query filter params (role.id=8a9636f0fea542a19f6fcaf54b9c1d11, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=ffc4cbd87dd249868cfb704535774126) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:23.895148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96405586-94a7-43a7-804d-238434b98b97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:23.896615 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96405586-94a7-43a7-804d-238434b98b97 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:23.902228 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 282/572] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:15:23 2022] GET /identity/v3/role_assignments?user.id=ffc4cbd87dd249868cfb704535774126&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=8a9636f0fea542a19f6fcaf54b9c1d11 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:23.902704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f6031-6036-405e-9cc4-a7e8c15fb038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:23.903374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f6031-6036-405e-9cc4-a7e8c15fb038 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:23.903466 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fd74e-fcfd-4649-9568-349a8be47d66 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:23.903655 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f6031-6036-405e-9cc4-a7e8c15fb038 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:23.903786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fd74e-fcfd-4649-9568-349a8be47d66 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:23.903953 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f6031-6036-405e-9cc4-a7e8c15fb038 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:23.904151 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fd74e-fcfd-4649-9568-349a8be47d66 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:23.904829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f6031-6036-405e-9cc4-a7e8c15fb038 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:23.905136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f6031-6036-405e-9cc4-a7e8c15fb038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:23.905783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 283/573] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:23.906419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fd74e-fcfd-4649-9568-349a8be47d66 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:23.909695 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f6031-6036-405e-9cc4-a7e8c15fb038 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:23.919492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 291/574] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:23.920688 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f6031-6036-405e-9cc4-a7e8c15fb038 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:24.042904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fd74e-fcfd-4649-9568-349a8be47d66 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:24.053746 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f6031-6036-405e-9cc4-a7e8c15fb038 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:24.076879 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:24.092597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60b524-2ff8-4173-afc2-115da65af524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:24.093405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60b524-2ff8-4173-afc2-115da65af524 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:24.093761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60b524-2ff8-4173-afc2-115da65af524 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:24.094104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60b524-2ff8-4173-afc2-115da65af524 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:24.094908 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60b524-2ff8-4173-afc2-115da65af524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:24.095276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60b524-2ff8-4173-afc2-115da65af524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:24.097139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60b524-2ff8-4173-afc2-115da65af524 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:24.110432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 292/575] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:24.111887 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8af6-ef0c-477b-80d4-285271c94418 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:24.112243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8af6-ef0c-477b-80d4-285271c94418 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:24.112605 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8af6-ef0c-477b-80d4-285271c94418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:24.131437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-391d8af6-ef0c-477b-80d4-285271c94418 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:24.132774 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-391d8af6-ef0c-477b-80d4-285271c94418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:24.150203 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ca59e-f6b0-4fd3-8544-363899d794bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:24.151156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ca59e-f6b0-4fd3-8544-363899d794bc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:24.152785 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ca59e-f6b0-4fd3-8544-363899d794bc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:24.154080 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ca59e-f6b0-4fd3-8544-363899d794bc None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:24.154810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ca59e-f6b0-4fd3-8544-363899d794bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:24.156795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ca59e-f6b0-4fd3-8544-363899d794bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:24.158230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ca59e-f6b0-4fd3-8544-363899d794bc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:24.164978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:24.174308 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 284/576] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:24.175171 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ca59e-f6b0-4fd3-8544-363899d794bc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:24.212880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 293/577] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:24.213993 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d8af6-ef0c-477b-80d4-285271c94418 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:24.303325 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ca59e-f6b0-4fd3-8544-363899d794bc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:24.342477 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73f8bf-0450-421f-9f93-19f2fb6b98a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:24.343534 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73f8bf-0450-421f-9f93-19f2fb6b98a9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:24.344029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73f8bf-0450-421f-9f93-19f2fb6b98a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:24.344567 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73f8bf-0450-421f-9f93-19f2fb6b98a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:24.350452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d8af6-ef0c-477b-80d4-285271c94418 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:24.356755 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73f8bf-0450-421f-9f93-19f2fb6b98a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:24.358602 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73f8bf-0450-421f-9f93-19f2fb6b98a9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:24.375817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-0d73f8bf-0450-421f-9f93-19f2fb6b98a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:24.375817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:24.375817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:24.375817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:24.375817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:24.375817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:24.375817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:24.375817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:24.375817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:24.375817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:24.375817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:24.375817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:24.375817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:24.375817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:24.375817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:24.377247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:24.377247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:24.377247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:24.377247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:24.377247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:24.377247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:24.377247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:24.377247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:24.377247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:24.377247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:24.377247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:24.377247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:24.377247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:24.377247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:24.377247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:24.377247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:24.377247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:24.378129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:24.378129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:24.378129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:24.378129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:24.381731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 285/578] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:24.382595 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73f8bf-0450-421f-9f93-19f2fb6b98a9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:24.397676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82c764-0544-4104-94bd-40b40b7ec61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:24.398920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82c764-0544-4104-94bd-40b40b7ec61a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:24.399267 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82c764-0544-4104-94bd-40b40b7ec61a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:24.399875 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82c764-0544-4104-94bd-40b40b7ec61a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:24.408804 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82c764-0544-4104-94bd-40b40b7ec61a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:24.410732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82c764-0544-4104-94bd-40b40b7ec61a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:24.426139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:24.429044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2c82c764-0544-4104-94bd-40b40b7ec61a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:24.429044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:24.429044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:24.429044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:24.429044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:24.429044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:24.429044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:24.429044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:24.429044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:24.429044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:24.429044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:24.429044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:24.429044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:24.429044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:24.429044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:24.429885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:24.429885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:24.429885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:24.429885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:24.429885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:24.429885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:24.429885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:24.429885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:24.429885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:24.429885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:24.429885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:24.429885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:24.429885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:24.429885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:24.429885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:24.429885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:24.429885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:24.430745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:24.430745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:24.430745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:24.430745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:24.430745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:24.430745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:24.430745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:24.430745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:24.435531 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 294/579] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:24.436429 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82c764-0544-4104-94bd-40b40b7ec61a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:24.463435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:24.506194 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73f8bf-0450-421f-9f93-19f2fb6b98a9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:24.540382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a073d-4671-4fbe-af4c-b2269ef9ee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:24.540734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82c764-0544-4104-94bd-40b40b7ec61a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:24.541230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a073d-4671-4fbe-af4c-b2269ef9ee6d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:24.541483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a073d-4671-4fbe-af4c-b2269ef9ee6d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:24.541751 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a073d-4671-4fbe-af4c-b2269ef9ee6d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:24.550063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a073d-4671-4fbe-af4c-b2269ef9ee6d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:24.551635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a073d-4671-4fbe-af4c-b2269ef9ee6d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:24.567255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-792a073d-4671-4fbe-af4c-b2269ef9ee6d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 03:15:24.567255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:24.567255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:24.567255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:24.567255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:24.567255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:24.567255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:24.567255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:24.567255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:24.567255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:24.567255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:24.567255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:24.567255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:24.567255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:24.567255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:24.567255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:24.568179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:24.569140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:24.569140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:24.569140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:24.569140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:24.569140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:24.569140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:24.569140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:24.569140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:24.569140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 03:15:24.569140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:24.569140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 286/580] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:24.569800 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a073d-4671-4fbe-af4c-b2269ef9ee6d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:24.579777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033cd76-7f27-4abc-9d4b-b30d94db11e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:24.580612 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033cd76-7f27-4abc-9d4b-b30d94db11e6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:24.580894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033cd76-7f27-4abc-9d4b-b30d94db11e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:24.581165 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033cd76-7f27-4abc-9d4b-b30d94db11e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:24.592432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033cd76-7f27-4abc-9d4b-b30d94db11e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:24.603000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-0033cd76-7f27-4abc-9d4b-b30d94db11e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:24.603000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:24.603000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:24.603000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:24.603000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:24.603000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:24.603000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:24.603000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:24.603000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:24.603000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:24.603000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:24.603000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:24.603000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:24.603000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:24.603000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:24.603000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:24.603969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:24.603969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:24.603969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:24.603969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:24.603969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:24.603969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:24.603969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:24.603969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:24.603969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:24.603969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:24.603969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:24.603969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:24.603969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:24.603969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:24.603969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:24.603969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:24.604825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:24.604825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:24.604825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:24.604825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:24.604825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:24.604825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:24.604825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:24.604825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:24.604825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:24.604825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:24.604825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:24.604825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:24.604825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 295/581] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:24.605518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033cd76-7f27-4abc-9d4b-b30d94db11e6 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:24.673216 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:24.680680 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a073d-4671-4fbe-af4c-b2269ef9ee6d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:24.699716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:24.717709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033cd76-7f27-4abc-9d4b-b30d94db11e6 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:24.718593 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa65822-c722-47fa-992d-5f908a727516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:24.719323 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa65822-c722-47fa-992d-5f908a727516 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:24.719667 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa65822-c722-47fa-992d-5f908a727516 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:24.720037 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa65822-c722-47fa-992d-5f908a727516 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:24.720863 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa65822-c722-47fa-992d-5f908a727516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:24.721227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa65822-c722-47fa-992d-5f908a727516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:24.723021 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa65822-c722-47fa-992d-5f908a727516 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:24.739504 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 287/582] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:24.739504 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa65822-c722-47fa-992d-5f908a727516 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:24.759456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fa1a9-5ebc-4e10-8372-f5bb68e1f457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:24.760429 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fa1a9-5ebc-4e10-8372-f5bb68e1f457 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:24.760739 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fa1a9-5ebc-4e10-8372-f5bb68e1f457 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:24.761151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fa1a9-5ebc-4e10-8372-f5bb68e1f457 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:24.761942 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fa1a9-5ebc-4e10-8372-f5bb68e1f457 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:24.762256 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fa1a9-5ebc-4e10-8372-f5bb68e1f457 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:24.764141 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fa1a9-5ebc-4e10-8372-f5bb68e1f457 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:24.780955 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 296/583] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:24.780955 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fa1a9-5ebc-4e10-8372-f5bb68e1f457 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:24.843057 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa65822-c722-47fa-992d-5f908a727516 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:24.882872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e700817-59d1-4bc1-890e-23640a779805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:24.883537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e700817-59d1-4bc1-890e-23640a779805 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:24.883812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e700817-59d1-4bc1-890e-23640a779805 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:24.884025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fa1a9-5ebc-4e10-8372-f5bb68e1f457 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:24.884129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e700817-59d1-4bc1-890e-23640a779805 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:24.884944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e700817-59d1-4bc1-890e-23640a779805 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:24.885251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e700817-59d1-4bc1-890e-23640a779805 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:24.886697 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e700817-59d1-4bc1-890e-23640a779805 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:24.905012 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 288/584] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Jul 12 03:15:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:24.905823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e700817-59d1-4bc1-890e-23640a779805 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:24.921453 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:24.924883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ce486-7aed-4441-9a86-5bbd27d811d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:24.925505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ce486-7aed-4441-9a86-5bbd27d811d2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:24.925788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ce486-7aed-4441-9a86-5bbd27d811d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:24.926060 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ce486-7aed-4441-9a86-5bbd27d811d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:24.926808 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ce486-7aed-4441-9a86-5bbd27d811d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:24.927110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ce486-7aed-4441-9a86-5bbd27d811d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:24.928496 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ce486-7aed-4441-9a86-5bbd27d811d2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:24.941091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 297/585] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:24.941091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ce486-7aed-4441-9a86-5bbd27d811d2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:24.948041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:25.020307 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e700817-59d1-4bc1-890e-23640a779805 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:25.040824 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ce486-7aed-4441-9a86-5bbd27d811d2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:25.055419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc45e0b-7cc3-4668-828c-57666929c156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:25.056225 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc45e0b-7cc3-4668-828c-57666929c156 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:25.056498 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc45e0b-7cc3-4668-828c-57666929c156 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:25.056792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc45e0b-7cc3-4668-828c-57666929c156 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:25.064777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc45e0b-7cc3-4668-828c-57666929c156 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:25.066235 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc45e0b-7cc3-4668-828c-57666929c156 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:25.075069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789f760-a17b-4c78-84de-afa817816ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:25.076018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789f760-a17b-4c78-84de-afa817816ace None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:25.076367 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789f760-a17b-4c78-84de-afa817816ace None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:25.076679 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789f760-a17b-4c78-84de-afa817816ace None admin] PATH_INFO: `/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/0c43d9d0a6264b19a843077a4669ce70/roles/8a9636f0fea542a19f6fcaf54b9c1d11` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:25.081890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-8dc45e0b-7cc3-4668-828c-57666929c156 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 03:15:25.081890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:25.081890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:25.081890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:25.081890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:25.081890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:25.081890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:25.081890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:25.081890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:25.081890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:25.081890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:25.081890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:25.081890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:25.081890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:25.081890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:25.081890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:25.082802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:25.083736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:25.083736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:25.083736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:25.083736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:25.083736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:25.083736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:25.083736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:25.083736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:25.083736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 03:15:25.083736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:25.083736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 289/586] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:25.084306 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc45e0b-7cc3-4668-828c-57666929c156 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:25.097231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789f760-a17b-4c78-84de-afa817816ace None admin] RBAC: Authorizing `identity:create_grant(project_id=afd5f89a049d40dc8456bd351f01f603, user_id=0c43d9d0a6264b19a843077a4669ce70, role_id=8a9636f0fea542a19f6fcaf54b9c1d11)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:25.098693 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789f760-a17b-4c78-84de-afa817816ace None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:25.112036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 298/587] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:15:24 2022] PUT /identity/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/0c43d9d0a6264b19a843077a4669ce70/roles/8a9636f0fea542a19f6fcaf54b9c1d11 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:15:25.121562 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789f760-a17b-4c78-84de-afa817816ace None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:25.177258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:25.197106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:25.221055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc45e0b-7cc3-4668-828c-57666929c156 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:25.251657 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789f760-a17b-4c78-84de-afa817816ace None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:25.269184 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09aef2-4fab-48a8-9a23-1fa74b2f521b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:25.270084 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09aef2-4fab-48a8-9a23-1fa74b2f521b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:25.270360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09aef2-4fab-48a8-9a23-1fa74b2f521b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:25.271258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09aef2-4fab-48a8-9a23-1fa74b2f521b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:25.281568 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09aef2-4fab-48a8-9a23-1fa74b2f521b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:25.283175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09aef2-4fab-48a8-9a23-1fa74b2f521b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:25.300547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe06d6d-df6c-4cf7-83c0-158749713b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:25.301378 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe06d6d-df6c-4cf7-83c0-158749713b62 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:25.301656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe06d6d-df6c-4cf7-83c0-158749713b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:25.301924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe06d6d-df6c-4cf7-83c0-158749713b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:25.308337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7f09aef2-4fab-48a8-9a23-1fa74b2f521b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:25.308337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:25.308337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:25.308337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:25.308337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:25.308337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:25.308337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:25.308337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:25.308337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:25.308337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:25.308337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:25.308337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:25.308337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:25.308337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:25.308337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:25.309273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:25.309273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:25.309273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:25.309273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:25.309273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:25.309273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:25.309273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:25.309273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:25.309273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:25.309273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:25.309273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:25.309273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:25.309273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:25.309273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:25.309273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:25.309273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:25.309273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:25.315116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:25.315116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:25.315116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:25.315116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:25.315116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 290/588] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:25.315116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09aef2-4fab-48a8-9a23-1fa74b2f521b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:25.315480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe06d6d-df6c-4cf7-83c0-158749713b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:25.315480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe06d6d-df6c-4cf7-83c0-158749713b62 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:25.333971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-4fe06d6d-df6c-4cf7-83c0-158749713b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:25.333971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:25.333971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:25.333971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:25.333971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:25.333971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:25.333971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:25.333971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:25.333971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:25.333971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:25.333971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:25.333971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:25.333971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:25.333971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:25.333971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:25.334885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:25.334885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:25.334885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:25.334885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:25.334885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:25.334885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:25.334885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:25.334885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:25.334885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:25.334885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:25.334885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:25.334885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:25.334885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:25.334885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:25.334885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:25.334885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:25.334885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:25.335803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:25.335803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:25.335803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:25.335803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:25.335803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 299/589] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:25.336075 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe06d6d-df6c-4cf7-83c0-158749713b62 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:25.429858 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09aef2-4fab-48a8-9a23-1fa74b2f521b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:25.456959 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:25.473816 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d6180-de19-47a4-a26b-fb13d12a6f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:25.474492 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d6180-de19-47a4-a26b-fb13d12a6f95 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:25.474765 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d6180-de19-47a4-a26b-fb13d12a6f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:25.475030 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d6180-de19-47a4-a26b-fb13d12a6f95 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:25.475872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d6180-de19-47a4-a26b-fb13d12a6f95 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:25.476171 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d6180-de19-47a4-a26b-fb13d12a6f95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:25.477651 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d6180-de19-47a4-a26b-fb13d12a6f95 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:25.485188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe06d6d-df6c-4cf7-83c0-158749713b62 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:25.498844 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:25.504483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 291/590] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Jul 12 03:15:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:25.504483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d6180-de19-47a4-a26b-fb13d12a6f95 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:25.539349 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617adda1-a382-43a9-b479-6f5168740f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:25.540417 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617adda1-a382-43a9-b479-6f5168740f6a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:25.541136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617adda1-a382-43a9-b479-6f5168740f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:25.542900 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617adda1-a382-43a9-b479-6f5168740f6a None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:25.543797 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617adda1-a382-43a9-b479-6f5168740f6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:25.544342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617adda1-a382-43a9-b479-6f5168740f6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:25.546032 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617adda1-a382-43a9-b479-6f5168740f6a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:25.562506 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 300/591] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:25.563713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617adda1-a382-43a9-b479-6f5168740f6a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:25.615887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d6180-de19-47a4-a26b-fb13d12a6f95 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:25.652101 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd766790-54af-4011-bacf-417219038379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:25.652833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd766790-54af-4011-bacf-417219038379 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:25.653139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd766790-54af-4011-bacf-417219038379 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:25.653479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd766790-54af-4011-bacf-417219038379 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:25.654489 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd766790-54af-4011-bacf-417219038379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:25.654945 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd766790-54af-4011-bacf-417219038379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:25.656373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd766790-54af-4011-bacf-417219038379 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:25.674570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 292/592] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:25.674570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd766790-54af-4011-bacf-417219038379 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:25.692273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617adda1-a382-43a9-b479-6f5168740f6a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:25.726437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:25.744305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d0919-a052-4c80-8e98-4598a67e1bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:25.745282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d0919-a052-4c80-8e98-4598a67e1bbc None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:25.745654 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d0919-a052-4c80-8e98-4598a67e1bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:25.746041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d0919-a052-4c80-8e98-4598a67e1bbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:25.758130 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d0919-a052-4c80-8e98-4598a67e1bbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:25.759712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d0919-a052-4c80-8e98-4598a67e1bbc None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:25.778495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-269d0919-a052-4c80-8e98-4598a67e1bbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:25.778495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:25.778495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:25.778495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:25.778495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:25.778495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:25.778495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:25.778495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:25.778495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:25.778495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:25.778495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:25.778495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:25.778495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:25.778495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:25.778495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:25.779931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:25.779931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:25.779931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:25.779931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:25.779931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:25.779931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:25.779931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:25.779931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:25.779931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:25.779931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:25.779931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:25.779931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:25.779931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:25.779931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:25.779931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:25.779931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:25.779931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:25.780849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:25.780849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:25.780849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:25.780849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:25.785547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 301/593] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:25.786585 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d0919-a052-4c80-8e98-4598a67e1bbc None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:25.790209 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd766790-54af-4011-bacf-417219038379 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:25.810195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:25.825380 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1b7c6-d818-45a8-a574-e9d53c0a2f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:25.826523 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1b7c6-d818-45a8-a574-e9d53c0a2f56 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:25.827016 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1b7c6-d818-45a8-a574-e9d53c0a2f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:25.827481 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1b7c6-d818-45a8-a574-e9d53c0a2f56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:25.834942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1b7c6-d818-45a8-a574-e9d53c0a2f56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:25.836815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1b7c6-d818-45a8-a574-e9d53c0a2f56 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:25.852440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a3e1b7c6-d818-45a8-a574-e9d53c0a2f56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:25.852440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:25.852440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:25.852440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:25.852440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:25.852440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:25.852440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:25.852440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:25.852440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:25.852440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:25.852440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:25.852440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:25.852440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:25.852440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:25.852440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:25.853401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:25.853401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:25.853401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:25.853401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:25.853401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:25.853401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:25.853401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:25.853401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:25.853401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:25.853401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:25.853401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:25.853401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:25.853401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:25.853401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:25.853401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:25.853401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:25.853401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:25.854271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:25.854271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:25.854271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:25.854271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:25.854271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:25.854271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:25.854271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:25.854271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:25.857096 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 293/594] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:25.858076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1b7c6-d818-45a8-a574-e9d53c0a2f56 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:25.901118 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d0919-a052-4c80-8e98-4598a67e1bbc None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:25.940840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1938fc-ce2e-447f-ac35-30d7afc93b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:25.942803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1938fc-ce2e-447f-ac35-30d7afc93b98 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:25.943278 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1938fc-ce2e-447f-ac35-30d7afc93b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:25.943724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1938fc-ce2e-447f-ac35-30d7afc93b98 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:25.956184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1938fc-ce2e-447f-ac35-30d7afc93b98 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:25.957691 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1938fc-ce2e-447f-ac35-30d7afc93b98 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:25.971138 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1b7c6-d818-45a8-a574-e9d53c0a2f56 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:25.973166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:25.973744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2a1938fc-ce2e-447f-ac35-30d7afc93b98 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 03:15:25.973744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:25.973744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:25.973744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:25.973744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:25.973744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:25.973744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:25.973744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:25.973744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:25.973744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:25.973744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:25.973744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:25.973744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:25.973744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:25.973744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:25.973744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:25.974681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:25.975597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:25.975597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:25.975597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:25.975597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:25.975597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:25.975597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:25.975597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:25.975597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:25.975597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 03:15:25.975597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:25.975597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 302/595] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:25.976181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1938fc-ce2e-447f-ac35-30d7afc93b98 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:26.012543 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec294ed-faba-48f3-b6ab-87c2db5afab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:26.013291 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec294ed-faba-48f3-b6ab-87c2db5afab2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:26.013576 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec294ed-faba-48f3-b6ab-87c2db5afab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:26.013834 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec294ed-faba-48f3-b6ab-87c2db5afab2 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:26.014618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec294ed-faba-48f3-b6ab-87c2db5afab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:26.014865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec294ed-faba-48f3-b6ab-87c2db5afab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:26.016245 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec294ed-faba-48f3-b6ab-87c2db5afab2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:26.027983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 294/596] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:26.029696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a028-b96a-4e3c-92cc-fd96fa9c6ef6 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:26.029956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a028-b96a-4e3c-92cc-fd96fa9c6ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:26.030246 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a028-b96a-4e3c-92cc-fd96fa9c6ef6 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:26.031654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 295/597] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:26.036194 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761a028-b96a-4e3c-92cc-fd96fa9c6ef6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:26.069097 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:26.090815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1938fc-ce2e-447f-ac35-30d7afc93b98 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:26.128061 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bab17-5509-498a-a449-ea565f988350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:26.128740 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bab17-5509-498a-a449-ea565f988350 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:26.129122 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bab17-5509-498a-a449-ea565f988350 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:26.129393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bab17-5509-498a-a449-ea565f988350 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:26.130289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bab17-5509-498a-a449-ea565f988350 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:26.130592 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bab17-5509-498a-a449-ea565f988350 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:26.132131 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bab17-5509-498a-a449-ea565f988350 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:26.138876 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761a028-b96a-4e3c-92cc-fd96fa9c6ef6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:26.149822 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 303/598] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:26.149822 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bab17-5509-498a-a449-ea565f988350 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:26.178635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fdea3-3824-4fb6-a528-e6aa6815a6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:26.179359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fdea3-3824-4fb6-a528-e6aa6815a6fa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:26.179643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fdea3-3824-4fb6-a528-e6aa6815a6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:26.179918 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fdea3-3824-4fb6-a528-e6aa6815a6fa None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:26.180782 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fdea3-3824-4fb6-a528-e6aa6815a6fa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:26.181212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fdea3-3824-4fb6-a528-e6aa6815a6fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:26.182763 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fdea3-3824-4fb6-a528-e6aa6815a6fa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:26.201353 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 296/599] 10.222.0.26 () {56 vars in 1139 bytes} [Tue Jul 12 03:15:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:26.202590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493c096-02bd-4cbc-ba1f-bd938783126f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:26.202877 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493c096-02bd-4cbc-ba1f-bd938783126f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:26.203150 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493c096-02bd-4cbc-ba1f-bd938783126f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:26.219270 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e493c096-02bd-4cbc-ba1f-bd938783126f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:26.220444 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e493c096-02bd-4cbc-ba1f-bd938783126f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:26.235365 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:26.268200 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bab17-5509-498a-a449-ea565f988350 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:26.293354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 297/600] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:26.294778 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493c096-02bd-4cbc-ba1f-bd938783126f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:26.315827 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2ca18-c9c6-4415-8e33-8c096df7034e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:26.316676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2ca18-c9c6-4415-8e33-8c096df7034e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:26.316956 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2ca18-c9c6-4415-8e33-8c096df7034e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:26.317225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2ca18-c9c6-4415-8e33-8c096df7034e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:26.325348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2ca18-c9c6-4415-8e33-8c096df7034e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:26.328177 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2ca18-c9c6-4415-8e33-8c096df7034e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:26.331907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:26.347315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2bf2ca18-c9c6-4415-8e33-8c096df7034e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:26.347315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:26.347315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:26.347315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:26.347315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:26.347315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:26.347315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:26.347315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:26.347315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:26.347315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:26.347315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:26.347315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:26.347315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:26.347315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:26.347315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:26.348257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:26.348257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:26.348257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:26.348257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:26.348257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:26.348257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:26.348257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:26.348257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:26.348257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:26.348257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:26.348257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:26.348257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:26.348257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:26.348257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:26.348257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:26.348257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:26.348257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:26.349904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:26.349904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:26.349904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:26.349904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:26.349904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:26.349904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:26.349904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:26.349904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:26.349904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 304/601] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:26.349904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2ca18-c9c6-4415-8e33-8c096df7034e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:26.416806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493c096-02bd-4cbc-ba1f-bd938783126f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:26.453822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9ee4a-ada3-408b-ba25-90bc49f86e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:26.454981 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2ca18-c9c6-4415-8e33-8c096df7034e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:26.455259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9ee4a-ada3-408b-ba25-90bc49f86e22 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:26.455743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9ee4a-ada3-408b-ba25-90bc49f86e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:26.456223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9ee4a-ada3-408b-ba25-90bc49f86e22 None admin] PATH_INFO: `/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/97fe9d04ccb445208f3783a8b55cd31e/roles/8a9636f0fea542a19f6fcaf54b9c1d11` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:26.472667 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9ee4a-ada3-408b-ba25-90bc49f86e22 None admin] RBAC: Authorizing `identity:create_grant(project_id=afd5f89a049d40dc8456bd351f01f603, user_id=97fe9d04ccb445208f3783a8b55cd31e, role_id=8a9636f0fea542a19f6fcaf54b9c1d11)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:26.474357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9ee4a-ada3-408b-ba25-90bc49f86e22 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:26.486143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:26.490884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 298/602] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:15:26 2022] PUT /identity/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/97fe9d04ccb445208f3783a8b55cd31e/roles/8a9636f0fea542a19f6fcaf54b9c1d11 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:15:26.491292 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15ea74-2a16-453f-993b-7656288f5bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:26.492086 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15ea74-2a16-453f-993b-7656288f5bdf None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:26.492361 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15ea74-2a16-453f-993b-7656288f5bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:26.492666 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15ea74-2a16-453f-993b-7656288f5bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:26.501955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9ee4a-ada3-408b-ba25-90bc49f86e22 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:26.505186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15ea74-2a16-453f-993b-7656288f5bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:26.506757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15ea74-2a16-453f-993b-7656288f5bdf None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:26.526264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7a15ea74-2a16-453f-993b-7656288f5bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:26.526264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:26.526264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:26.526264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:26.526264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:26.526264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:26.526264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:26.526264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:26.526264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:26.526264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:26.526264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:26.526264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:26.526264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:26.526264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:26.526264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:26.527264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:26.527264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:26.527264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:26.527264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:26.527264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:26.527264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:26.527264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:26.527264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:26.527264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:26.527264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:26.527264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:26.527264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:26.527264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:26.527264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:26.527264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:26.527264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:26.527264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:26.528141 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:26.528141 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:26.528141 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:26.528141 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:26.532480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 305/603] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:26.533476 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15ea74-2a16-453f-993b-7656288f5bdf None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:26.604262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:26.653470 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9ee4a-ada3-408b-ba25-90bc49f86e22 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:26.671526 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15ea74-2a16-453f-993b-7656288f5bdf None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:26.699648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82650e1e-0053-48d2-a3e5-9ea1a7a2e70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:26.700494 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82650e1e-0053-48d2-a3e5-9ea1a7a2e70c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:26.701405 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82650e1e-0053-48d2-a3e5-9ea1a7a2e70c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:26.701693 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82650e1e-0053-48d2-a3e5-9ea1a7a2e70c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:26.713304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82650e1e-0053-48d2-a3e5-9ea1a7a2e70c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:26.722146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-82650e1e-0053-48d2-a3e5-9ea1a7a2e70c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:26.722146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:26.722146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:26.722146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:26.722146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:26.722146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:26.722146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:26.722146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:26.722146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:26.722146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:26.722146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:26.722146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:26.722146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:26.722146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:26.722146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:26.722146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:26.723136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:26.723136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:26.723136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:26.723136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:26.723136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:26.723136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:26.723136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:26.723136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:26.723136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:26.723136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:26.723136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:26.723136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:26.723136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:26.723136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:26.723136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:26.723136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:26.723969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:26.723969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:26.723969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:26.723969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:26.723969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:26.723969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:26.723969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:26.723969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:26.723969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:26.723969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:26.723969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:26.723969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:26.723969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 299/604] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:26.724737 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82650e1e-0053-48d2-a3e5-9ea1a7a2e70c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:26.725348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929b3f0-114f-46a6-b11b-9c25e87a9d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:26.726242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929b3f0-114f-46a6-b11b-9c25e87a9d4b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:26.731248 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929b3f0-114f-46a6-b11b-9c25e87a9d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:26.731821 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929b3f0-114f-46a6-b11b-9c25e87a9d4b None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:26.732924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929b3f0-114f-46a6-b11b-9c25e87a9d4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:26.733392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929b3f0-114f-46a6-b11b-9c25e87a9d4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:26.735000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929b3f0-114f-46a6-b11b-9c25e87a9d4b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:26.752651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 306/605] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:26.753647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929b3f0-114f-46a6-b11b-9c25e87a9d4b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:26.801258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:26.854167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82650e1e-0053-48d2-a3e5-9ea1a7a2e70c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:26.873538 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929b3f0-114f-46a6-b11b-9c25e87a9d4b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:26.889195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:26.896928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffc4e6-2cad-4139-9cbc-53adc35bf9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:26.897840 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffc4e6-2cad-4139-9cbc-53adc35bf9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:26.898276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffc4e6-2cad-4139-9cbc-53adc35bf9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:26.899113 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffc4e6-2cad-4139-9cbc-53adc35bf9d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:26.900263 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffc4e6-2cad-4139-9cbc-53adc35bf9d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:26.900730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffc4e6-2cad-4139-9cbc-53adc35bf9d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:26.902700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffc4e6-2cad-4139-9cbc-53adc35bf9d8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:26.915472 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee22fe-8352-4110-a24a-752c2d5ef9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:26.916195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee22fe-8352-4110-a24a-752c2d5ef9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:26.916474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee22fe-8352-4110-a24a-752c2d5ef9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:26.916767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee22fe-8352-4110-a24a-752c2d5ef9f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:26.917519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee22fe-8352-4110-a24a-752c2d5ef9f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:26.917820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee22fe-8352-4110-a24a-752c2d5ef9f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:26.919221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee22fe-8352-4110-a24a-752c2d5ef9f8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:26.925904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 300/606] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:26.925904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffc4e6-2cad-4139-9cbc-53adc35bf9d8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:26.934219 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 307/607] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:26.935123 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee22fe-8352-4110-a24a-752c2d5ef9f8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:27.050267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffc4e6-2cad-4139-9cbc-53adc35bf9d8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:27.050469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee22fe-8352-4110-a24a-752c2d5ef9f8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:27.072668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:27.086848 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aece7ea-9bdd-4982-85c8-d694a962adf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:27.087853 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aece7ea-9bdd-4982-85c8-d694a962adf7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:27.088137 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aece7ea-9bdd-4982-85c8-d694a962adf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:27.088481 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aece7ea-9bdd-4982-85c8-d694a962adf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:27.091799 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cc3c7-e247-402e-898a-e18d018186d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:27.093284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc3c7-e247-402e-898a-e18d018186d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:27.093801 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc3c7-e247-402e-898a-e18d018186d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:27.094263 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc3c7-e247-402e-898a-e18d018186d8 None admin] PATH_INFO: `/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/99605c4dd01f48e39a3e29a74114506d/roles/8a9636f0fea542a19f6fcaf54b9c1d11` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:27.097276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aece7ea-9bdd-4982-85c8-d694a962adf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:27.100012 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aece7ea-9bdd-4982-85c8-d694a962adf7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:27.112040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cc3c7-e247-402e-898a-e18d018186d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=afd5f89a049d40dc8456bd351f01f603, user_id=99605c4dd01f48e39a3e29a74114506d, role_id=8a9636f0fea542a19f6fcaf54b9c1d11)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:27.113920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cc3c7-e247-402e-898a-e18d018186d8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:27.118276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-4aece7ea-9bdd-4982-85c8-d694a962adf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:27.118276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:27.118276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:27.118276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:27.118276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:27.118276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:27.118276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:27.118276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:27.118276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:27.118276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:27.118276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:27.118276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:27.118276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:27.118276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:27.118276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:27.119283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:27.119283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:27.119283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:27.119283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:27.119283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:27.119283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:27.119283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:27.119283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:27.119283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:27.119283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:27.119283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:27.119283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:27.119283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:27.119283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:27.119283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:27.119283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:27.119283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:27.120281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:27.120281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:27.120281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:27.120281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:27.120281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:27.120281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:27.120281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:27.120281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:27.125708 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 308/608] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:27.125708 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aece7ea-9bdd-4982-85c8-d694a962adf7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:27.137465 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 301/609] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:15:26 2022] PUT /identity/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/99605c4dd01f48e39a3e29a74114506d/roles/8a9636f0fea542a19f6fcaf54b9c1d11 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:15:27.143017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cc3c7-e247-402e-898a-e18d018186d8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:27.200557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:27.313340 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aece7ea-9bdd-4982-85c8-d694a962adf7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:27.319294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cc3c7-e247-402e-898a-e18d018186d8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:27.360022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65b2bd-a172-4867-b63b-5b3ddc7fcf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:27.361302 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65b2bd-a172-4867-b63b-5b3ddc7fcf7d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:27.361302 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65b2bd-a172-4867-b63b-5b3ddc7fcf7d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:27.361508 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65b2bd-a172-4867-b63b-5b3ddc7fcf7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:27.365806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06978e7e-82f1-49a3-97a1-13bf92bf8e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:27.366477 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06978e7e-82f1-49a3-97a1-13bf92bf8e0a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:27.366761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06978e7e-82f1-49a3-97a1-13bf92bf8e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:27.367038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06978e7e-82f1-49a3-97a1-13bf92bf8e0a None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:27.367845 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06978e7e-82f1-49a3-97a1-13bf92bf8e0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:27.368156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06978e7e-82f1-49a3-97a1-13bf92bf8e0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:27.369643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06978e7e-82f1-49a3-97a1-13bf92bf8e0a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:27.379745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65b2bd-a172-4867-b63b-5b3ddc7fcf7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:27.381905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65b2bd-a172-4867-b63b-5b3ddc7fcf7d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:27.387035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 302/610] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:27.387035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d9400-c12a-44ed-8020-ae01235c1719 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:27.387035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d9400-c12a-44ed-8020-ae01235c1719 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:27.387035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d9400-c12a-44ed-8020-ae01235c1719 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:27.387035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 303/611] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:27.389152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d9400-c12a-44ed-8020-ae01235c1719 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:27.413434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2e65b2bd-a172-4867-b63b-5b3ddc7fcf7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:27.413434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:27.413434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:27.413434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:27.413434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:27.413434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:27.413434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:27.413434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:27.413434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:27.413434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:27.413434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:27.413434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:27.413434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:27.413434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:27.413434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:27.414543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:27.414543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:27.414543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:27.414543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:27.414543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:27.414543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:27.414543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:27.414543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:27.414543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:27.414543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:27.414543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:27.414543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:27.414543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:27.414543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:27.414543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:27.414543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:27.414543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:27.415630 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:27.415630 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:27.415630 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:27.415630 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:27.418282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 309/612] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:27.420646 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e950d50-9918-48a6-9e24-0d8ef483ea36 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:27.421339 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e950d50-9918-48a6-9e24-0d8ef483ea36 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:27.421755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e950d50-9918-48a6-9e24-0d8ef483ea36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:27.425781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:27.446581 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2e950d50-9918-48a6-9e24-0d8ef483ea36 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:27.448787 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2e950d50-9918-48a6-9e24-0d8ef483ea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:27.520185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 310/613] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:27.521085 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e950d50-9918-48a6-9e24-0d8ef483ea36 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:27.521862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d9400-c12a-44ed-8020-ae01235c1719 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:27.557799 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:27.562852 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a961eec-ba73-4c93-870e-6d924705a05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:27.564142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a961eec-ba73-4c93-870e-6d924705a05f None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:27.565099 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a961eec-ba73-4c93-870e-6d924705a05f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:27.565580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a961eec-ba73-4c93-870e-6d924705a05f None admin] PATH_INFO: `/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/c2908efc19944583810abceb4c5d8d5f/roles/8a9636f0fea542a19f6fcaf54b9c1d11` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:27.585021 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a961eec-ba73-4c93-870e-6d924705a05f None admin] RBAC: Authorizing `identity:create_grant(project_id=afd5f89a049d40dc8456bd351f01f603, user_id=c2908efc19944583810abceb4c5d8d5f, role_id=8a9636f0fea542a19f6fcaf54b9c1d11)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:27.587241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a961eec-ba73-4c93-870e-6d924705a05f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:27.608021 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 304/614] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:15:27 2022] PUT /identity/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/c2908efc19944583810abceb4c5d8d5f/roles/8a9636f0fea542a19f6fcaf54b9c1d11 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:15:27.613684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a961eec-ba73-4c93-870e-6d924705a05f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:27.727597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e950d50-9918-48a6-9e24-0d8ef483ea36 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:27.733494 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:27.762321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a961eec-ba73-4c93-870e-6d924705a05f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:27.818954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1ec77-39f1-4135-9b69-1d6b89f9f5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:27.819550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1ec77-39f1-4135-9b69-1d6b89f9f5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:27.819831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1ec77-39f1-4135-9b69-1d6b89f9f5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:27.820105 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1ec77-39f1-4135-9b69-1d6b89f9f5a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:27.820869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1ec77-39f1-4135-9b69-1d6b89f9f5a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:27.821175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1ec77-39f1-4135-9b69-1d6b89f9f5a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:27.822594 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1ec77-39f1-4135-9b69-1d6b89f9f5a2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:27.824898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1459ec1-8982-4812-97f8-ce36e573d71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:27.825851 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1459ec1-8982-4812-97f8-ce36e573d71d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:27.826440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1459ec1-8982-4812-97f8-ce36e573d71d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:27.826440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1459ec1-8982-4812-97f8-ce36e573d71d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:27.847044 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1459ec1-8982-4812-97f8-ce36e573d71d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:27.847570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 311/615] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:27.852766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1ec77-39f1-4135-9b69-1d6b89f9f5a2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:27.855338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e1459ec1-8982-4812-97f8-ce36e573d71d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:27.855338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:27.855338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:27.855338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:27.855338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:27.855338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:27.855338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:27.855338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:27.855338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:27.855338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:27.855338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:27.855338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:27.855338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:27.855338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:27.855338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:27.855338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:27.856334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:27.856334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:27.856334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:27.856334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:27.856334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:27.856334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:27.856334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:27.856334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:27.856334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:27.856334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:27.856334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:27.856334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:27.856334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:27.856334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:27.856334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:27.856334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:27.857942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:27.857942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:27.857942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:27.857942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:27.857942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:27.857942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:27.857942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:27.857942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:27.857942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:27.857942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:27.857942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:27.857942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:27.857942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 305/616] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:27.865117 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1459ec1-8982-4812-97f8-ce36e573d71d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:27.959661 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:27.986148 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1ec77-39f1-4135-9b69-1d6b89f9f5a2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:28.000768 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1459ec1-8982-4812-97f8-ce36e573d71d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:28.023618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957e2ea-e600-4b7a-a7d1-700dce9c9d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:28.024844 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957e2ea-e600-4b7a-a7d1-700dce9c9d16 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:28.025380 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957e2ea-e600-4b7a-a7d1-700dce9c9d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:28.025880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957e2ea-e600-4b7a-a7d1-700dce9c9d16 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:28.034493 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957e2ea-e600-4b7a-a7d1-700dce9c9d16 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:28.036042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957e2ea-e600-4b7a-a7d1-700dce9c9d16 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:28.043334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe5a2e-7ef5-4541-b5cc-c7d1aae7b79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:28.044389 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe5a2e-7ef5-4541-b5cc-c7d1aae7b79f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:28.044965 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe5a2e-7ef5-4541-b5cc-c7d1aae7b79f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:28.045537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe5a2e-7ef5-4541-b5cc-c7d1aae7b79f None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:28.046493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe5a2e-7ef5-4541-b5cc-c7d1aae7b79f None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:28.046984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe5a2e-7ef5-4541-b5cc-c7d1aae7b79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:28.048569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe5a2e-7ef5-4541-b5cc-c7d1aae7b79f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:28.052264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2957e2ea-e600-4b7a-a7d1-700dce9c9d16 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 03:15:28.052264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:28.052264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:28.052264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:28.052264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:28.052264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:28.052264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:28.052264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:28.052264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:28.052264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:28.052264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:28.052264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:28.052264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:28.052264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:28.052264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:28.052264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:28.053330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:28.054263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:28.054263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:28.054263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:28.054263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:28.054263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:28.054263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:28.054263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:28.054263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:28.054263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 03:15:28.054263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:28.054263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 312/617] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:15:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:28.061190 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 306/618] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:28.065909 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957e2ea-e600-4b7a-a7d1-700dce9c9d16 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:28.067133 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe5a2e-7ef5-4541-b5cc-c7d1aae7b79f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:28.070265 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:28.249803 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe5a2e-7ef5-4541-b5cc-c7d1aae7b79f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:28.289058 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957e2ea-e600-4b7a-a7d1-700dce9c9d16 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:28.297303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51dbb3-168c-47dc-9c2e-b711fe06562e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:28.298121 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51dbb3-168c-47dc-9c2e-b711fe06562e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:28.298400 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51dbb3-168c-47dc-9c2e-b711fe06562e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:28.298810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51dbb3-168c-47dc-9c2e-b711fe06562e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:28.310656 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51dbb3-168c-47dc-9c2e-b711fe06562e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:28.312630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51dbb3-168c-47dc-9c2e-b711fe06562e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:28.339176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1f51dbb3-168c-47dc-9c2e-b711fe06562e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:28.339176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:28.339176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:28.339176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:28.339176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:28.339176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:28.339176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:28.339176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:28.339176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:28.339176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:28.339176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:28.339176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:28.339176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:28.339176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:28.339176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:28.340100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:28.340100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:28.340100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:28.340100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:28.340100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:28.340100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:28.340100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:28.340100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:28.340100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:28.340100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:28.340100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:28.340100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:28.340100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:28.340100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:28.340100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:28.340100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:28.340100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:28.341971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:28.341971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:28.341971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:28.341971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:28.341971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 307/619] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:28.347906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51dbb3-168c-47dc-9c2e-b711fe06562e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:28.357411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1867700-412e-4034-ac49-5d5002386720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:28.358101 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1867700-412e-4034-ac49-5d5002386720 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:28.358381 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1867700-412e-4034-ac49-5d5002386720 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:28.358648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1867700-412e-4034-ac49-5d5002386720 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:28.359488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1867700-412e-4034-ac49-5d5002386720 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:28.359794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1867700-412e-4034-ac49-5d5002386720 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:28.361289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1867700-412e-4034-ac49-5d5002386720 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:28.369285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:28.407094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 313/620] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Jul 12 03:15:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:28.421837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1867700-412e-4034-ac49-5d5002386720 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:28.464893 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:28.521847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51dbb3-168c-47dc-9c2e-b711fe06562e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:28.559011 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f70e42-0d36-4052-a66f-fad96ddf7245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:28.559915 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f70e42-0d36-4052-a66f-fad96ddf7245 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:28.560306 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f70e42-0d36-4052-a66f-fad96ddf7245 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:28.560630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f70e42-0d36-4052-a66f-fad96ddf7245 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:28.561378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f70e42-0d36-4052-a66f-fad96ddf7245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:28.561681 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f70e42-0d36-4052-a66f-fad96ddf7245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:28.563474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f70e42-0d36-4052-a66f-fad96ddf7245 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:28.577217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 308/621] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:28.587248 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f70e42-0d36-4052-a66f-fad96ddf7245 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:28.627391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1867700-412e-4034-ac49-5d5002386720 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:28.705563 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e92e37-f864-4163-a5df-e60899061e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:28.706634 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92e37-f864-4163-a5df-e60899061e45 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:28.707113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92e37-f864-4163-a5df-e60899061e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:28.707579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92e37-f864-4163-a5df-e60899061e45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:28.718571 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e92e37-f864-4163-a5df-e60899061e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:28.720400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e92e37-f864-4163-a5df-e60899061e45 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:28.739420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-f7e92e37-f864-4163-a5df-e60899061e45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:28.739420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:28.739420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:28.739420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:28.739420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:28.739420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:28.739420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:28.739420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:28.739420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:28.739420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:28.739420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:28.739420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:28.739420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:28.739420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:28.739420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:28.740794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:28.740794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:28.740794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:28.740794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:28.740794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:28.740794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:28.740794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:28.740794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:28.740794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:28.740794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:28.740794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:28.740794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:28.740794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:28.740794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:28.740794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:28.740794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:28.740794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:28.741691 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:28.741691 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:28.741691 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:28.741691 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:28.744073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 314/622] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:28.745709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f911a97-a23b-4d1a-a4ec-c2bd7067e55a None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:28.746200 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f911a97-a23b-4d1a-a4ec-c2bd7067e55a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:28.746669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f911a97-a23b-4d1a-a4ec-c2bd7067e55a None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:28.747991 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f70e42-0d36-4052-a66f-fad96ddf7245 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:28.752970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 315/623] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:28.753973 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f911a97-a23b-4d1a-a4ec-c2bd7067e55a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:28.764960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:28.792342 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd016bc-fdbc-4712-b34d-d20b9b75d24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:28.793194 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd016bc-fdbc-4712-b34d-d20b9b75d24d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:28.793478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd016bc-fdbc-4712-b34d-d20b9b75d24d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:28.793753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd016bc-fdbc-4712-b34d-d20b9b75d24d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:28.803547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd016bc-fdbc-4712-b34d-d20b9b75d24d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:28.805478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd016bc-fdbc-4712-b34d-d20b9b75d24d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:28.809633 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:28.825702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-ecd016bc-fdbc-4712-b34d-d20b9b75d24d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:15:28.825702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:28.825702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:28.825702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:28.825702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:28.825702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:28.825702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:28.825702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:28.825702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:28.825702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:28.825702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:28.825702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:28.825702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:28.825702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:28.825702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:28.825702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:28.826831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:28.828258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:28.828258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:28.828258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:28.828258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:28.828258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:28.828258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:28.828258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:28.828258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:28.828258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:15:28.828258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:28.832467 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 309/624] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 03:15:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:28.834089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bf990-5c39-4236-89cd-e8de14cd84d7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:28.834378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bf990-5c39-4236-89cd-e8de14cd84d7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:28.834655 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bf990-5c39-4236-89cd-e8de14cd84d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:28.856034 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e19bf990-5c39-4236-89cd-e8de14cd84d7 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:28.857871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e19bf990-5c39-4236-89cd-e8de14cd84d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:28.880712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f911a97-a23b-4d1a-a4ec-c2bd7067e55a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:28.926073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f3196-cb6c-4867-820b-cfe3601e9355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:28.927001 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f3196-cb6c-4867-820b-cfe3601e9355 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:28.927298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f3196-cb6c-4867-820b-cfe3601e9355 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:28.927574 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f3196-cb6c-4867-820b-cfe3601e9355 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:28.928317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f3196-cb6c-4867-820b-cfe3601e9355 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:28.928651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f3196-cb6c-4867-820b-cfe3601e9355 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:28.930501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f3196-cb6c-4867-820b-cfe3601e9355 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:28.940641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 310/625] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:28.941990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bf990-5c39-4236-89cd-e8de14cd84d7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:28.943412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 316/626] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:28.948712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f3196-cb6c-4867-820b-cfe3601e9355 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:29.066408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bf990-5c39-4236-89cd-e8de14cd84d7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:29.070565 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:29.095869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f3196-cb6c-4867-820b-cfe3601e9355 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:29.105901 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:29.107730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c72d0-b695-4abf-ae03-a6e44d2de5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:29.108724 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c72d0-b695-4abf-ae03-a6e44d2de5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:29.109198 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c72d0-b695-4abf-ae03-a6e44d2de5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:29.109678 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c72d0-b695-4abf-ae03-a6e44d2de5a8 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:29.110739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c72d0-b695-4abf-ae03-a6e44d2de5a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:29.111256 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c72d0-b695-4abf-ae03-a6e44d2de5a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:29.112962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c72d0-b695-4abf-ae03-a6e44d2de5a8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:29.135679 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efda674-6edd-464a-be72-8f4a38e81b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:29.136947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efda674-6edd-464a-be72-8f4a38e81b1f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:29.137436 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efda674-6edd-464a-be72-8f4a38e81b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:29.137999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efda674-6edd-464a-be72-8f4a38e81b1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:29.140217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 311/627] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 03:15:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:29.141287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c72d0-b695-4abf-ae03-a6e44d2de5a8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:29.147523 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efda674-6edd-464a-be72-8f4a38e81b1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:29.149270 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efda674-6edd-464a-be72-8f4a38e81b1f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:29.164053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-5efda674-6edd-464a-be72-8f4a38e81b1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:29.164053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:29.164053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:29.164053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:29.164053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:29.164053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:29.164053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:29.164053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:29.164053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:29.164053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:29.164053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:29.164053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:29.164053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:29.164053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:29.164053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:29.165022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:29.165022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:29.165022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:29.165022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:29.165022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:29.165022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:29.165022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:29.165022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:29.165022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:29.165022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:29.165022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:29.165022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:29.165022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:29.165022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:29.165022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:29.165022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:29.165022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:29.165979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:29.165979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:29.165979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:29.165979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:29.165979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:29.165979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:29.165979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:29.165979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:29.168465 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 317/628] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:29.169669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efda674-6edd-464a-be72-8f4a38e81b1f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:29.265590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c72d0-b695-4abf-ae03-a6e44d2de5a8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:29.271129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efda674-6edd-464a-be72-8f4a38e81b1f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:29.306441 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4b330-b0ff-4637-b0bd-085bf5e97d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:29.307544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4b330-b0ff-4637-b0bd-085bf5e97d7e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:29.307863 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb924ae-13bc-42bd-a8f5-6029b5b4b470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:29.308287 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4b330-b0ff-4637-b0bd-085bf5e97d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:29.308702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb924ae-13bc-42bd-a8f5-6029b5b4b470 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:29.308986 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb924ae-13bc-42bd-a8f5-6029b5b4b470 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:29.309257 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb924ae-13bc-42bd-a8f5-6029b5b4b470 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:29.309546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4b330-b0ff-4637-b0bd-085bf5e97d7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:29.321885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb924ae-13bc-42bd-a8f5-6029b5b4b470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:29.332569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-9fb924ae-13bc-42bd-a8f5-6029b5b4b470 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:29.332569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:29.332569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:29.332569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:29.332569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:29.332569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:29.332569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:29.332569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:29.332569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:29.332569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:29.332569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:29.332569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:29.332569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:29.332569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:29.332569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:29.332569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:29.333510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:29.333510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:29.333510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:29.333510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:29.333510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:29.333510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:29.333510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:29.333510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:29.333510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:29.333510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:29.333510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:29.333510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:29.333510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:29.333510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:29.333510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:29.333510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:29.339277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:29.339277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:29.339277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:29.339277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:29.339277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:29.339277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:29.339277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:29.339277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:29.339277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:29.339277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:29.339277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:29.339277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:29.339277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 312/629] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:29.339277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb924ae-13bc-42bd-a8f5-6029b5b4b470 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:29.355051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:29.366654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:29.395564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4b330-b0ff-4637-b0bd-085bf5e97d7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:29.397721 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4b330-b0ff-4637-b0bd-085bf5e97d7e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:29.449198 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb924ae-13bc-42bd-a8f5-6029b5b4b470 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:29.486319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118a79f-f3c1-46d7-ab3d-fa402c51bbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:29.487624 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118a79f-f3c1-46d7-ab3d-fa402c51bbdf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:29.488388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118a79f-f3c1-46d7-ab3d-fa402c51bbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:29.488869 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118a79f-f3c1-46d7-ab3d-fa402c51bbdf None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:29.489825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118a79f-f3c1-46d7-ab3d-fa402c51bbdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:29.490300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118a79f-f3c1-46d7-ab3d-fa402c51bbdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:29.491921 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118a79f-f3c1-46d7-ab3d-fa402c51bbdf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:29.510729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 318/631] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:15:29.511076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 313/631] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:29.511695 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4b330-b0ff-4637-b0bd-085bf5e97d7e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:29.512892 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b92a7-9807-434d-b295-554aaf16943a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:29.513332 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b92a7-9807-434d-b295-554aaf16943a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:29.513795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b92a7-9807-434d-b295-554aaf16943a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:29.515675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 314/632] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:29.516568 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b92a7-9807-434d-b295-554aaf16943a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:29.588044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:29.605296 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:29.626325 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b92a7-9807-434d-b295-554aaf16943a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:29.627833 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4b330-b0ff-4637-b0bd-085bf5e97d7e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:29.663903 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e0d48-0e77-4c72-9392-471866afcb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:29.664464 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba98902-3ac2-4d2f-ae3b-e3bb147ba0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:29.664747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e0d48-0e77-4c72-9392-471866afcb8a None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:29.665028 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e0d48-0e77-4c72-9392-471866afcb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:29.665300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e0d48-0e77-4c72-9392-471866afcb8a None admin] PATH_INFO: `/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/ffc4cbd87dd249868cfb704535774126/roles/8a9636f0fea542a19f6fcaf54b9c1d11` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:29.665396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba98902-3ac2-4d2f-ae3b-e3bb147ba0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:29.665714 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba98902-3ac2-4d2f-ae3b-e3bb147ba0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:29.665996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba98902-3ac2-4d2f-ae3b-e3bb147ba0a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:29.666758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba98902-3ac2-4d2f-ae3b-e3bb147ba0a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:29.667066 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba98902-3ac2-4d2f-ae3b-e3bb147ba0a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:29.668455 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba98902-3ac2-4d2f-ae3b-e3bb147ba0a7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:29.678956 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 319/633] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:29.678956 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba98902-3ac2-4d2f-ae3b-e3bb147ba0a7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:29.686294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e0d48-0e77-4c72-9392-471866afcb8a None admin] RBAC: Authorizing `identity:create_grant(project_id=afd5f89a049d40dc8456bd351f01f603, user_id=ffc4cbd87dd249868cfb704535774126, role_id=8a9636f0fea542a19f6fcaf54b9c1d11)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:29.687787 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e0d48-0e77-4c72-9392-471866afcb8a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:29.716671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 315/634] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:15:29 2022] PUT /identity/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/ffc4cbd87dd249868cfb704535774126/roles/8a9636f0fea542a19f6fcaf54b9c1d11 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:15:29.716671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9bf99-9cc3-499c-8d52-451f6ca5b8e6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:29.716671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9bf99-9cc3-499c-8d52-451f6ca5b8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:29.716671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9bf99-9cc3-499c-8d52-451f6ca5b8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:29.733721 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8fb9bf99-9cc3-499c-8d52-451f6ca5b8e6 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:29.734943 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8fb9bf99-9cc3-499c-8d52-451f6ca5b8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:29.816994 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 316/635] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:29.818198 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9bf99-9cc3-499c-8d52-451f6ca5b8e6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:29.818962 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba98902-3ac2-4d2f-ae3b-e3bb147ba0a7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:29.855045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:29.867340 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a116b6-7ab4-4be6-8376-f9a4ed9f53ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:29.868441 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a116b6-7ab4-4be6-8376-f9a4ed9f53ce None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:29.868770 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a116b6-7ab4-4be6-8376-f9a4ed9f53ce None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:29.869073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a116b6-7ab4-4be6-8376-f9a4ed9f53ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:29.885615 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a116b6-7ab4-4be6-8376-f9a4ed9f53ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:29.887437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a116b6-7ab4-4be6-8376-f9a4ed9f53ce None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:29.911992 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:29.917271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-18a116b6-7ab4-4be6-8376-f9a4ed9f53ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:29.917271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:29.917271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:29.917271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:29.917271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:29.917271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:29.917271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:29.917271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:29.917271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:29.917271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:29.917271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:29.917271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:29.917271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:29.917271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:29.917271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:29.918385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:29.918385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:29.918385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:29.918385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:29.918385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:29.918385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:29.918385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:29.918385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:29.918385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:29.918385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:29.918385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:29.918385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:29.918385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:29.918385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:29.918385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:29.918385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:29.918385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:29.920184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:29.920184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:29.920184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:29.920184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:29.920184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 320/636] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:29.920184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a116b6-7ab4-4be6-8376-f9a4ed9f53ce None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:29.969202 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9bf99-9cc3-499c-8d52-451f6ca5b8e6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:30.009585 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37d46c-6709-4968-a3c2-397d45fdc905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:30.010398 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37d46c-6709-4968-a3c2-397d45fdc905 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:30.010716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37d46c-6709-4968-a3c2-397d45fdc905 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:30.010981 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37d46c-6709-4968-a3c2-397d45fdc905 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:30.022148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37d46c-6709-4968-a3c2-397d45fdc905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:30.023653 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37d46c-6709-4968-a3c2-397d45fdc905 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:30.031845 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a116b6-7ab4-4be6-8376-f9a4ed9f53ce None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:30.041837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-8f37d46c-6709-4968-a3c2-397d45fdc905 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:30.041837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:30.041837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:30.041837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:30.041837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:30.041837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:30.041837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:30.041837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:30.041837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:30.041837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:30.041837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:30.041837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:30.041837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:30.041837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:30.041837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:30.042713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:30.042713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:30.042713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:30.042713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:30.042713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:30.042713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:30.042713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:30.042713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:30.042713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:30.042713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:30.042713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:30.042713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:30.042713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:30.042713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:30.042713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:30.042713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:30.042713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:30.043571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:30.043571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:30.043571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:30.043571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:30.043571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 317/637] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:30.043894 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37d46c-6709-4968-a3c2-397d45fdc905 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:30.071442 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da7fd8-f9b1-40eb-a888-229497db2060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:30.072349 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da7fd8-f9b1-40eb-a888-229497db2060 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:30.072725 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da7fd8-f9b1-40eb-a888-229497db2060 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:30.072997 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da7fd8-f9b1-40eb-a888-229497db2060 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:30.083630 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da7fd8-f9b1-40eb-a888-229497db2060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:30.091439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-29da7fd8-f9b1-40eb-a888-229497db2060 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:30.091439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:30.091439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:30.091439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:30.091439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:30.091439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:30.091439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:30.091439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:30.091439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:30.091439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:30.091439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:30.091439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:30.091439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:30.091439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:30.091439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:30.091439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:30.092462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:30.092462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:30.092462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:30.092462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:30.092462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:30.092462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:30.092462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:30.092462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:30.092462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:30.092462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:30.092462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:30.092462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:30.092462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:30.092462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:30.092462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:30.092462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:30.093346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:30.093346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:30.093346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:30.093346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:30.093346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:30.093346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:30.093346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:30.093346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:30.093346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:30.093346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:30.093346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:30.093346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:30.093346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 321/638] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:30.094636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815be1a-e19f-4518-a4ef-e029cf68fa45 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:30.094636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815be1a-e19f-4518-a4ef-e029cf68fa45 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:30.094816 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815be1a-e19f-4518-a4ef-e029cf68fa45 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:30.096124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 322/639] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:30.100866 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815be1a-e19f-4518-a4ef-e029cf68fa45 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:30.147358 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:30.153961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37d46c-6709-4968-a3c2-397d45fdc905 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:30.168735 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:30.192526 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fd6c3-184e-4076-a0ac-cabb9a0ab9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:30.193236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fd6c3-184e-4076-a0ac-cabb9a0ab9ed None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:30.193497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fd6c3-184e-4076-a0ac-cabb9a0ab9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:30.193767 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fd6c3-184e-4076-a0ac-cabb9a0ab9ed None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:30.194502 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fd6c3-184e-4076-a0ac-cabb9a0ab9ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:30.194805 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fd6c3-184e-4076-a0ac-cabb9a0ab9ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:30.196191 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fd6c3-184e-4076-a0ac-cabb9a0ab9ed None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:30.207983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 318/640] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:30.209843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815be1a-e19f-4518-a4ef-e029cf68fa45 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:30.213006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fd6c3-184e-4076-a0ac-cabb9a0ab9ed None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:30.246216 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fc7b2-7252-4b7a-824b-ff1a561d0cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:30.246909 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fc7b2-7252-4b7a-824b-ff1a561d0cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:30.247246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fc7b2-7252-4b7a-824b-ff1a561d0cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:30.247525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fc7b2-7252-4b7a-824b-ff1a561d0cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:30.248297 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fc7b2-7252-4b7a-824b-ff1a561d0cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:30.248592 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fc7b2-7252-4b7a-824b-ff1a561d0cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:30.250010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fc7b2-7252-4b7a-824b-ff1a561d0cb8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:30.263791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 323/641] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:30.265176 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cd685-3cfb-4829-931a-71ceaa3d2881 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:30.265465 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cd685-3cfb-4829-931a-71ceaa3d2881 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:30.265737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cd685-3cfb-4829-931a-71ceaa3d2881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:30.282804 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-725cd685-3cfb-4829-931a-71ceaa3d2881 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:30.284226 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-725cd685-3cfb-4829-931a-71ceaa3d2881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:30.330867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fd6c3-184e-4076-a0ac-cabb9a0ab9ed None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:30.355615 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 324/642] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:30.356360 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cd685-3cfb-4829-931a-71ceaa3d2881 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:30.388252 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:30.389229 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04589c06-53f3-4ea9-bdd8-2ec24f5e91c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:30.389909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04589c06-53f3-4ea9-bdd8-2ec24f5e91c5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:30.390295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04589c06-53f3-4ea9-bdd8-2ec24f5e91c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:30.390531 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04589c06-53f3-4ea9-bdd8-2ec24f5e91c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:30.391323 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04589c06-53f3-4ea9-bdd8-2ec24f5e91c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:30.391604 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04589c06-53f3-4ea9-bdd8-2ec24f5e91c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:30.393074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04589c06-53f3-4ea9-bdd8-2ec24f5e91c5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:30.401622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 319/643] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:30.402422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04589c06-53f3-4ea9-bdd8-2ec24f5e91c5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:30.442934 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:30.467176 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cd685-3cfb-4829-931a-71ceaa3d2881 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:30.504234 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b726a3-72d0-4516-84b0-93298cdfd469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:30.505164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b726a3-72d0-4516-84b0-93298cdfd469 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:30.505443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b726a3-72d0-4516-84b0-93298cdfd469 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:30.505702 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b726a3-72d0-4516-84b0-93298cdfd469 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:30.513157 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b726a3-72d0-4516-84b0-93298cdfd469 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:30.514091 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04589c06-53f3-4ea9-bdd8-2ec24f5e91c5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:30.514586 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b726a3-72d0-4516-84b0-93298cdfd469 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:30.529143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-85b726a3-72d0-4516-84b0-93298cdfd469 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:30.529143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:30.529143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:30.529143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:30.529143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:30.529143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:30.529143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:30.529143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:30.529143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:30.529143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:30.529143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:30.529143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:30.529143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:30.529143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:30.529143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:30.530124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:30.530124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:30.530124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:30.530124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:30.530124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:30.530124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:30.530124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:30.530124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:30.530124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:30.530124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:30.530124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:30.530124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:30.530124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:30.530124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:30.530124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:30.530124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:30.530124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:30.531011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:30.531011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:30.531011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:30.531011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:30.531011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:30.531011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:30.531011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:30.531011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:30.531011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 325/644] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:30.531798 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b726a3-72d0-4516-84b0-93298cdfd469 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:30.553395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d98af-65fd-4ba1-a835-aa5d2cb3b6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:30.554209 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d98af-65fd-4ba1-a835-aa5d2cb3b6fc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:30.554484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d98af-65fd-4ba1-a835-aa5d2cb3b6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:30.554734 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d98af-65fd-4ba1-a835-aa5d2cb3b6fc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:30.562706 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d98af-65fd-4ba1-a835-aa5d2cb3b6fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:30.564144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d98af-65fd-4ba1-a835-aa5d2cb3b6fc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:30.579418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-800d98af-65fd-4ba1-a835-aa5d2cb3b6fc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 03:15:30.579418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:30.579418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:30.579418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:30.579418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:30.579418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:30.579418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:30.579418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:30.579418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:30.579418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:30.579418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:30.579418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:30.579418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:30.579418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:30.579418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:30.579418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:30.580361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:30.581511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:30.581511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:30.581511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:30.581511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:30.581511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:30.581511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:30.581511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:30.581511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:30.581511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 03:15:30.581511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:30.581511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 320/645] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:30.581511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d98af-65fd-4ba1-a835-aa5d2cb3b6fc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:30.635704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:30.650885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b726a3-72d0-4516-84b0-93298cdfd469 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:30.684890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:30.690773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc8b16-d23c-400c-ae04-bf97b50260a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:30.691585 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc8b16-d23c-400c-ae04-bf97b50260a3 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:30.691866 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc8b16-d23c-400c-ae04-bf97b50260a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:30.692136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc8b16-d23c-400c-ae04-bf97b50260a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:30.694625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d98af-65fd-4ba1-a835-aa5d2cb3b6fc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:30.707271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc8b16-d23c-400c-ae04-bf97b50260a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:30.715008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-aafc8b16-d23c-400c-ae04-bf97b50260a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:30.715008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:30.715008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:30.715008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:30.715008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:30.715008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:30.715008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:30.715008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:30.715008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:30.715008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:30.715008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:30.715008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:30.715008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:30.715008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:30.715008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:30.715008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:30.716051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:30.716051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:30.716051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:30.716051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:30.716051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:30.716051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:30.716051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:30.716051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:30.716051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:30.716051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:30.716051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:30.716051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:30.716051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:30.716051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:30.716051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:30.716051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:30.717482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:30.717482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:30.717482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:30.717482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:30.717482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:30.717482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:30.717482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:30.717482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:30.717482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:30.717482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:30.717482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:30.717482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:30.717482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 326/646] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:30.717482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc8b16-d23c-400c-ae04-bf97b50260a3 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:30.735558 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ed2ac-3c0c-4fbf-b77c-4241b7163b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:30.736365 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ed2ac-3c0c-4fbf-b77c-4241b7163b6e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:30.736674 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ed2ac-3c0c-4fbf-b77c-4241b7163b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:30.736947 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ed2ac-3c0c-4fbf-b77c-4241b7163b6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:30.747673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ed2ac-3c0c-4fbf-b77c-4241b7163b6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:30.749168 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ed2ac-3c0c-4fbf-b77c-4241b7163b6e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:30.766081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-451ed2ac-3c0c-4fbf-b77c-4241b7163b6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:30.766081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:30.766081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:30.766081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:30.766081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:30.766081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:30.766081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:30.766081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:30.766081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:30.766081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:30.766081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:30.766081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:30.766081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:30.766081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:30.766081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:30.767152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:30.767152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:30.767152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:30.767152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:30.767152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:30.767152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:30.767152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:30.767152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:30.767152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:30.767152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:30.767152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:30.767152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:30.767152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:30.767152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:30.767152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:30.767152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:30.767152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:30.768310 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:30.768310 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:30.768310 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:30.768310 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:30.771837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 321/647] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:30.772805 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ed2ac-3c0c-4fbf-b77c-4241b7163b6e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:30.833670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc8b16-d23c-400c-ae04-bf97b50260a3 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:30.871819 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a3a96-176f-45c0-ae88-c9b67a39afd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:30.873085 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a3a96-176f-45c0-ae88-c9b67a39afd7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:30.873577 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a3a96-176f-45c0-ae88-c9b67a39afd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:30.874023 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a3a96-176f-45c0-ae88-c9b67a39afd7 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:30.875021 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a3a96-176f-45c0-ae88-c9b67a39afd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:30.875530 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a3a96-176f-45c0-ae88-c9b67a39afd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:30.877079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a3a96-176f-45c0-ae88-c9b67a39afd7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:30.882598 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ed2ac-3c0c-4fbf-b77c-4241b7163b6e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:30.895906 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 327/648] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:30.895906 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a3a96-176f-45c0-ae88-c9b67a39afd7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:30.907965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:30.927658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd22eb-8635-4647-b7e9-706ec81b2ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:30.928332 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd22eb-8635-4647-b7e9-706ec81b2ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:30.928646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd22eb-8635-4647-b7e9-706ec81b2ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:30.928920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd22eb-8635-4647-b7e9-706ec81b2ad3 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:30.929759 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd22eb-8635-4647-b7e9-706ec81b2ad3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:30.930077 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd22eb-8635-4647-b7e9-706ec81b2ad3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:30.931517 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd22eb-8635-4647-b7e9-706ec81b2ad3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:30.949903 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 322/649] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Jul 12 03:15:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:30.950780 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd22eb-8635-4647-b7e9-706ec81b2ad3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:30.963081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:31.005252 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a3a96-176f-45c0-ae88-c9b67a39afd7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:31.041899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c67be-00f4-4076-a207-094d8cfe6f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:31.042564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c67be-00f4-4076-a207-094d8cfe6f6a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:31.042831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c67be-00f4-4076-a207-094d8cfe6f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:31.043095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c67be-00f4-4076-a207-094d8cfe6f6a None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:31.043832 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c67be-00f4-4076-a207-094d8cfe6f6a None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:31.044226 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c67be-00f4-4076-a207-094d8cfe6f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:31.045546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c67be-00f4-4076-a207-094d8cfe6f6a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:31.058233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 328/650] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:31.058233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c67be-00f4-4076-a207-094d8cfe6f6a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:31.065014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd22eb-8635-4647-b7e9-706ec81b2ad3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:31.100956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efad009-f551-4376-8de2-3f778a57da29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:31.101613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efad009-f551-4376-8de2-3f778a57da29 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:31.101891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efad009-f551-4376-8de2-3f778a57da29 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:31.102163 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efad009-f551-4376-8de2-3f778a57da29 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:31.102995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efad009-f551-4376-8de2-3f778a57da29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:31.103298 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efad009-f551-4376-8de2-3f778a57da29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:31.104812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efad009-f551-4376-8de2-3f778a57da29 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:31.121058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 323/651] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:31.121058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efad009-f551-4376-8de2-3f778a57da29 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:31.133546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:31.164663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c67be-00f4-4076-a207-094d8cfe6f6a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:31.192657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:31.199551 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbc582-3fca-4989-9765-574d48066874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:31.200299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbc582-3fca-4989-9765-574d48066874 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:31.201119 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbc582-3fca-4989-9765-574d48066874 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:31.201402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbc582-3fca-4989-9765-574d48066874 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:31.202238 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbc582-3fca-4989-9765-574d48066874 None admin] RBAC: Adding query filter params (role.id=8a9636f0fea542a19f6fcaf54b9c1d11, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=0c43d9d0a6264b19a843077a4669ce70) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:31.202551 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbc582-3fca-4989-9765-574d48066874 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:31.203995 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbc582-3fca-4989-9765-574d48066874 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:31.210275 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 329/652] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:15:31 2022] GET /identity/v3/role_assignments?user.id=0c43d9d0a6264b19a843077a4669ce70&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=8a9636f0fea542a19f6fcaf54b9c1d11 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:31.213803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbc582-3fca-4989-9765-574d48066874 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:31.231212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efad009-f551-4376-8de2-3f778a57da29 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:31.268998 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dbfd3-2588-42c0-8030-ce8a0539ca13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:31.269669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dbfd3-2588-42c0-8030-ce8a0539ca13 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:31.269952 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dbfd3-2588-42c0-8030-ce8a0539ca13 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:31.270226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dbfd3-2588-42c0-8030-ce8a0539ca13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:31.346791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6dbfd3-2588-42c0-8030-ce8a0539ca13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:31.348287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6dbfd3-2588-42c0-8030-ce8a0539ca13 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:31.364758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbc582-3fca-4989-9765-574d48066874 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:31.402886 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989a5fa-6611-40ac-9e05-ff2997dae2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:31.404040 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a5fa-6611-40ac-9e05-ff2997dae2fa None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:31.404548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a5fa-6611-40ac-9e05-ff2997dae2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:31.404989 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a5fa-6611-40ac-9e05-ff2997dae2fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:31.408032 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:31.418053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989a5fa-6611-40ac-9e05-ff2997dae2fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:31.419857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989a5fa-6611-40ac-9e05-ff2997dae2fa None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:31.427187 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:31.439000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-e989a5fa-6611-40ac-9e05-ff2997dae2fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:31.439000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:31.439000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:31.439000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:31.439000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:31.439000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:31.439000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:31.439000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:31.439000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:31.439000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:31.439000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:31.439000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:31.439000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:31.439000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:31.439000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:31.439945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:31.439945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:31.439945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:31.439945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:31.439945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:31.439945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:31.439945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:31.439945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:31.439945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:31.439945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:31.439945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:31.439945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:31.439945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:31.439945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:31.439945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:31.439945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:31.439945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:31.440915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:31.440915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:31.440915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:31.440915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:31.440915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 330/653] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:31.441352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989a5fa-6611-40ac-9e05-ff2997dae2fa None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:31.470864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 324/654] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:15:31.472263 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dbfd3-2588-42c0-8030-ce8a0539ca13 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:31.573172 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989a5fa-6611-40ac-9e05-ff2997dae2fa None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:31.594521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dbfd3-2588-42c0-8030-ce8a0539ca13 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:31.617964 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707e502-6b96-4d26-973c-1ce3d9e7e930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:31.619338 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707e502-6b96-4d26-973c-1ce3d9e7e930 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:31.620150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707e502-6b96-4d26-973c-1ce3d9e7e930 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:31.621031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707e502-6b96-4d26-973c-1ce3d9e7e930 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:31.631430 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2e823-1c93-4c28-bd8b-9b41f41f642b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:31.632094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2e823-1c93-4c28-bd8b-9b41f41f642b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:31.632372 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2e823-1c93-4c28-bd8b-9b41f41f642b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:31.632596 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707e502-6b96-4d26-973c-1ce3d9e7e930 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:31.632700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2e823-1c93-4c28-bd8b-9b41f41f642b None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:31.633404 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2e823-1c93-4c28-bd8b-9b41f41f642b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:31.633704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2e823-1c93-4c28-bd8b-9b41f41f642b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:31.634749 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707e502-6b96-4d26-973c-1ce3d9e7e930 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:31.635071 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2e823-1c93-4c28-bd8b-9b41f41f642b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:31.652030 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 325/655] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:31.656604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7707e502-6b96-4d26-973c-1ce3d9e7e930 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 03:15:31.656604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:31.656604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:31.656604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:31.656604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:31.656604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:31.656604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:31.656604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:31.656604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:31.656604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:31.656604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:31.656604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:31.656604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:31.656604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:31.656604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:31.656604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:31.657541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:31.658447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:31.658447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:31.658447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:31.658447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:31.658447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:31.658447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:31.658447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:31.658447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:31.658447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 03:15:31.658447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:31.658447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 331/656] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:31.658447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707e502-6b96-4d26-973c-1ce3d9e7e930 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:31.660600 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2e823-1c93-4c28-bd8b-9b41f41f642b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:31.696638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:31.733009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:31.778790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2e823-1c93-4c28-bd8b-9b41f41f642b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:31.779651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707e502-6b96-4d26-973c-1ce3d9e7e930 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:31.816439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54bdff-e5fa-4293-870f-2e308da375be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:31.817422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54bdff-e5fa-4293-870f-2e308da375be None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:31.817806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54bdff-e5fa-4293-870f-2e308da375be None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:31.818151 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54bdff-e5fa-4293-870f-2e308da375be None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:31.818792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbab84f-a7c4-463c-9764-62cd3750648e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:31.819563 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab84f-a7c4-463c-9764-62cd3750648e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:31.819835 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab84f-a7c4-463c-9764-62cd3750648e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:31.820133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab84f-a7c4-463c-9764-62cd3750648e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:31.826430 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54bdff-e5fa-4293-870f-2e308da375be None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:31.827902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54bdff-e5fa-4293-870f-2e308da375be None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:31.831637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbab84f-a7c4-463c-9764-62cd3750648e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:31.833153 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbab84f-a7c4-463c-9764-62cd3750648e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:31.844161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-ba54bdff-e5fa-4293-870f-2e308da375be None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 03:15:31.844161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:31.844161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:31.844161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:31.844161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:31.844161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:31.844161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:31.844161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:31.844161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:31.844161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:31.844161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:31.844161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:31.844161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:31.844161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:31.844161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:31.844161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:31.845312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:31.846226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:31.846226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:31.846226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:31.846226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:31.846226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:31.846226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:31.846226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:31.846226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:31.846226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 03:15:31.846226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:31.852649 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 326/657] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:31.852820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2dbab84f-a7c4-463c-9764-62cd3750648e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:31.852820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:31.852820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:31.852820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:31.852820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:31.852820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:31.852820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:31.852820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:31.852820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:31.852820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:31.852820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:31.852820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:31.852820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:31.852820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:31.852820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:31.854096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:31.854096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:31.854096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:31.854096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:31.854096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:31.854096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:31.854096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:31.854096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:31.854096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:31.854096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:31.854096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:31.854096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:31.854096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:31.854096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:31.854096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:31.854096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:31.854096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:31.854960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:31.854960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:31.854960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:31.854960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:31.855174 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54bdff-e5fa-4293-870f-2e308da375be None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:31.855243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 332/658] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:31.855243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c15678-5ed9-45ae-9d35-8298cdf0918f None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:31.855243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c15678-5ed9-45ae-9d35-8298cdf0918f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:31.855243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c15678-5ed9-45ae-9d35-8298cdf0918f None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:31.856651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 333/659] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:31.857410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c15678-5ed9-45ae-9d35-8298cdf0918f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:31.947519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:31.959392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:31.963440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54bdff-e5fa-4293-870f-2e308da375be None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:31.963575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c15678-5ed9-45ae-9d35-8298cdf0918f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:32.001078 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be2ccb-878c-46b5-ae2e-bb35d761db18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:32.001671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be2ccb-878c-46b5-ae2e-bb35d761db18 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:32.001950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be2ccb-878c-46b5-ae2e-bb35d761db18 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:32.002151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65a5d5-1b2d-45ea-92dc-464c50d95ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:32.002263 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be2ccb-878c-46b5-ae2e-bb35d761db18 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:32.002792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65a5d5-1b2d-45ea-92dc-464c50d95ddc None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:32.003044 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be2ccb-878c-46b5-ae2e-bb35d761db18 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:32.003152 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65a5d5-1b2d-45ea-92dc-464c50d95ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:32.003327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65a5d5-1b2d-45ea-92dc-464c50d95ddc None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:32.003421 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be2ccb-878c-46b5-ae2e-bb35d761db18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:32.004155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65a5d5-1b2d-45ea-92dc-464c50d95ddc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:32.004455 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65a5d5-1b2d-45ea-92dc-464c50d95ddc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:32.004793 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be2ccb-878c-46b5-ae2e-bb35d761db18 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:32.005885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65a5d5-1b2d-45ea-92dc-464c50d95ddc None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:32.029660 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 334/660] 10.222.0.26 () {56 vars in 1139 bytes} [Tue Jul 12 03:15:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:32.029660 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65a5d5-1b2d-45ea-92dc-464c50d95ddc None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:32.030322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 327/661] 10.222.0.26 () {56 vars in 1137 bytes} [Tue Jul 12 03:15:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:32.031540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd3c2c-0b10-402a-aa3e-3fb67c0cef2e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:32.031828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd3c2c-0b10-402a-aa3e-3fb67c0cef2e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:32.032102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd3c2c-0b10-402a-aa3e-3fb67c0cef2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:32.055144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-57bd3c2c-0b10-402a-aa3e-3fb67c0cef2e None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:32.057214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-57bd3c2c-0b10-402a-aa3e-3fb67c0cef2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:32.140650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65a5d5-1b2d-45ea-92dc-464c50d95ddc None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:32.140891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 328/662] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:32.140891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd3c2c-0b10-402a-aa3e-3fb67c0cef2e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:32.188533 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35172a04-eece-44b6-953a-d97c3ae23dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:32.189387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35172a04-eece-44b6-953a-d97c3ae23dae None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:32.189730 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35172a04-eece-44b6-953a-d97c3ae23dae None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:32.190077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35172a04-eece-44b6-953a-d97c3ae23dae None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:32.190885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35172a04-eece-44b6-953a-d97c3ae23dae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:32.191262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35172a04-eece-44b6-953a-d97c3ae23dae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:32.192669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35172a04-eece-44b6-953a-d97c3ae23dae None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:32.204073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 335/663] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:32.204888 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35172a04-eece-44b6-953a-d97c3ae23dae None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:32.222181 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:32.228018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:32.249679 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd3c2c-0b10-402a-aa3e-3fb67c0cef2e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:32.285270 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5713ae-ac14-498a-a715-5666ada8b773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:32.285846 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5713ae-ac14-498a-a715-5666ada8b773 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:32.286125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5713ae-ac14-498a-a715-5666ada8b773 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:32.286394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5713ae-ac14-498a-a715-5666ada8b773 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:32.313486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35172a04-eece-44b6-953a-d97c3ae23dae None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:32.348168 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196edee1-81d6-4bf8-b489-5775e4c1ff33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:32.348995 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196edee1-81d6-4bf8-b489-5775e4c1ff33 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:32.349285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196edee1-81d6-4bf8-b489-5775e4c1ff33 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:32.349627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196edee1-81d6-4bf8-b489-5775e4c1ff33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:32.357233 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5713ae-ac14-498a-a715-5666ada8b773 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:32.358715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5713ae-ac14-498a-a715-5666ada8b773 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:32.417613 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196edee1-81d6-4bf8-b489-5775e4c1ff33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:32.419107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196edee1-81d6-4bf8-b489-5775e4c1ff33 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:32.437860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:32.440213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:32.471129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 329/664] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:15:32.476593 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5713ae-ac14-498a-a715-5666ada8b773 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:32.529162 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 336/665] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:15:32.530341 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196edee1-81d6-4bf8-b489-5775e4c1ff33 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:32.581669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5713ae-ac14-498a-a715-5666ada8b773 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:32.619641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708696a-154f-4185-9668-a7d6b31290a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:32.620498 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708696a-154f-4185-9668-a7d6b31290a7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:32.620807 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708696a-154f-4185-9668-a7d6b31290a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:32.621080 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708696a-154f-4185-9668-a7d6b31290a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:32.631563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708696a-154f-4185-9668-a7d6b31290a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:32.635413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196edee1-81d6-4bf8-b489-5775e4c1ff33 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:32.639539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e708696a-154f-4185-9668-a7d6b31290a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:32.639539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:32.639539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:32.639539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:32.639539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:32.639539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:32.639539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:32.639539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:32.639539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:32.639539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:32.639539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:32.639539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:32.639539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:32.639539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:32.639539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:32.639539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:32.640478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:32.640478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:32.640478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:32.640478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:32.640478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:32.640478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:32.640478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:32.640478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:32.640478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:32.640478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:32.640478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:32.640478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:32.640478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:32.640478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:32.640478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:32.640478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:32.647015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:32.647015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:32.647015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:32.647015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:32.647015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:32.647015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:32.647015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:32.647015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:32.647015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:32.647015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:32.647015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:32.647015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:32.647015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 330/666] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:32.647015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708696a-154f-4185-9668-a7d6b31290a7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:32.658070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:32.680445 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc145c-26a9-4bbe-b0b4-0aaed0c7c221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:32.681277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc145c-26a9-4bbe-b0b4-0aaed0c7c221 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:32.681709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc145c-26a9-4bbe-b0b4-0aaed0c7c221 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:32.681945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc145c-26a9-4bbe-b0b4-0aaed0c7c221 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:32.684062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:32.689795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc145c-26a9-4bbe-b0b4-0aaed0c7c221 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:32.691255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc145c-26a9-4bbe-b0b4-0aaed0c7c221 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:32.705636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-9cbc145c-26a9-4bbe-b0b4-0aaed0c7c221 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:32.705636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:32.705636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:32.705636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:32.705636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:32.705636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:32.705636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:32.705636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:32.705636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:32.705636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:32.705636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:32.705636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:32.705636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:32.705636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:32.705636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:32.706475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:32.706475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:32.706475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:32.706475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:32.706475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:32.706475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:32.706475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:32.706475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:32.706475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:32.706475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:32.706475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:32.706475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:32.706475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:32.706475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:32.706475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:32.706475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:32.706475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:32.712196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:32.712196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:32.712196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:32.712196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:32.712196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:32.712196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:32.712196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:32.712196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:32.712196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 337/667] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:32.712196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc145c-26a9-4bbe-b0b4-0aaed0c7c221 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:32.763188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708696a-154f-4185-9668-a7d6b31290a7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:32.798395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe437e-450c-4858-9ed7-d859202d32ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:32.799198 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe437e-450c-4858-9ed7-d859202d32ae None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:32.799473 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe437e-450c-4858-9ed7-d859202d32ae None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:32.799743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe437e-450c-4858-9ed7-d859202d32ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:32.811253 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe437e-450c-4858-9ed7-d859202d32ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:32.812755 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe437e-450c-4858-9ed7-d859202d32ae None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:32.813747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc145c-26a9-4bbe-b0b4-0aaed0c7c221 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:32.830186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-18fe437e-450c-4858-9ed7-d859202d32ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:32.830186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:32.830186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:32.830186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:32.830186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:32.830186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:32.830186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:32.830186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:32.830186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:32.830186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:32.830186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:32.830186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:32.830186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:32.830186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:32.830186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:32.831153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:32.831153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:32.831153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:32.831153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:32.831153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:32.831153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:32.831153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:32.831153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:32.831153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:32.831153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:32.831153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:32.831153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:32.831153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:32.831153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:32.831153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:32.831153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:32.831153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:32.832079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:32.832079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:32.832079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:32.832079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:32.832079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 331/668] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:32.833133 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe437e-450c-4858-9ed7-d859202d32ae None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:32.855444 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600329fb-6094-4416-9ad4-c4adce920287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:32.856249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600329fb-6094-4416-9ad4-c4adce920287 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:32.856685 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600329fb-6094-4416-9ad4-c4adce920287 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:32.856919 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600329fb-6094-4416-9ad4-c4adce920287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:32.868633 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600329fb-6094-4416-9ad4-c4adce920287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:32.870125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600329fb-6094-4416-9ad4-c4adce920287 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:32.887255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-600329fb-6094-4416-9ad4-c4adce920287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:32.887255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:32.887255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:32.887255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:32.887255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:32.887255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:32.887255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:32.887255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:32.887255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:32.887255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:32.887255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:32.887255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:32.887255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:32.887255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:32.887255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:32.888463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:32.888463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:32.888463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:32.888463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:32.888463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:32.888463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:32.888463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:32.888463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:32.888463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:32.888463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:32.888463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:32.888463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:32.888463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:32.888463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:32.888463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:32.888463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:32.888463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:32.889405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:32.889405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:32.889405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:32.889405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:32.889405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 338/669] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:32.889405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600329fb-6094-4416-9ad4-c4adce920287 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:32.924300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:32.930412 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:32.947707 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe437e-450c-4858-9ed7-d859202d32ae None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:32.983846 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d40e21-472e-4dc8-a42f-21aba5c12c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:32.984815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d40e21-472e-4dc8-a42f-21aba5c12c6a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:32.985104 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d40e21-472e-4dc8-a42f-21aba5c12c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:32.985370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d40e21-472e-4dc8-a42f-21aba5c12c6a None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:32.986290 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d40e21-472e-4dc8-a42f-21aba5c12c6a None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:32.986596 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d40e21-472e-4dc8-a42f-21aba5c12c6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:32.988283 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d40e21-472e-4dc8-a42f-21aba5c12c6a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:33.003490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 332/670] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:33.003490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d40e21-472e-4dc8-a42f-21aba5c12c6a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:33.003751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600329fb-6094-4416-9ad4-c4adce920287 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:33.038553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1815bfc-62e7-4c74-ab1f-2b55e6a9eb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:33.039224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1815bfc-62e7-4c74-ab1f-2b55e6a9eb8f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:33.039503 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1815bfc-62e7-4c74-ab1f-2b55e6a9eb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:33.039775 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1815bfc-62e7-4c74-ab1f-2b55e6a9eb8f None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:33.040588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1815bfc-62e7-4c74-ab1f-2b55e6a9eb8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:33.040895 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1815bfc-62e7-4c74-ab1f-2b55e6a9eb8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:33.042452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1815bfc-62e7-4c74-ab1f-2b55e6a9eb8f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:33.060562 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 339/671] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:33.060562 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1815bfc-62e7-4c74-ab1f-2b55e6a9eb8f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:33.108355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d40e21-472e-4dc8-a42f-21aba5c12c6a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:33.143293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca49cb-5b6a-466d-a0c7-87f64279b5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:33.143956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca49cb-5b6a-466d-a0c7-87f64279b5dd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:33.144236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca49cb-5b6a-466d-a0c7-87f64279b5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:33.144502 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca49cb-5b6a-466d-a0c7-87f64279b5dd None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:33.145260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca49cb-5b6a-466d-a0c7-87f64279b5dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:33.145562 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca49cb-5b6a-466d-a0c7-87f64279b5dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:33.146940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca49cb-5b6a-466d-a0c7-87f64279b5dd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:33.153118 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:33.159571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 333/672] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:33.160218 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca49cb-5b6a-466d-a0c7-87f64279b5dd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:33.169950 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1815bfc-62e7-4c74-ab1f-2b55e6a9eb8f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:33.174155 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:33.208083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61965592-e8f5-46be-aafa-28d8ba5fa4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:33.208757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61965592-e8f5-46be-aafa-28d8ba5fa4bf None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:33.209050 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61965592-e8f5-46be-aafa-28d8ba5fa4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:33.209323 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61965592-e8f5-46be-aafa-28d8ba5fa4bf None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:33.210185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61965592-e8f5-46be-aafa-28d8ba5fa4bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:33.210490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61965592-e8f5-46be-aafa-28d8ba5fa4bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:33.211995 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61965592-e8f5-46be-aafa-28d8ba5fa4bf None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:33.228870 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 340/673] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:33.228870 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61965592-e8f5-46be-aafa-28d8ba5fa4bf None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:33.276208 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca49cb-5b6a-466d-a0c7-87f64279b5dd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:33.311432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a08a15-0b5c-406b-93f4-d4cf67fef772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:33.312236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a08a15-0b5c-406b-93f4-d4cf67fef772 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:33.312539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a08a15-0b5c-406b-93f4-d4cf67fef772 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:33.312822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a08a15-0b5c-406b-93f4-d4cf67fef772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:33.323425 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a08a15-0b5c-406b-93f4-d4cf67fef772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:33.324904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a08a15-0b5c-406b-93f4-d4cf67fef772 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:33.335431 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61965592-e8f5-46be-aafa-28d8ba5fa4bf None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:33.347826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-14a08a15-0b5c-406b-93f4-d4cf67fef772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:33.347826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:33.347826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:33.347826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:33.347826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:33.347826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:33.347826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:33.347826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:33.347826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:33.347826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:33.347826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:33.347826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:33.347826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:33.347826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:33.347826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:33.348776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:33.348776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:33.348776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:33.348776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:33.348776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:33.348776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:33.348776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:33.348776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:33.348776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:33.348776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:33.348776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:33.348776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:33.348776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:33.348776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:33.348776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:33.348776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:33.348776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:33.349631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:33.349631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:33.349631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:33.349631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:33.349631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 334/674] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:33.349907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a08a15-0b5c-406b-93f4-d4cf67fef772 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:33.374635 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f992f-7acd-4f47-8da8-ea32d4376b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:33.375312 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f992f-7acd-4f47-8da8-ea32d4376b83 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:33.375743 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f992f-7acd-4f47-8da8-ea32d4376b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:33.376094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f992f-7acd-4f47-8da8-ea32d4376b83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:33.377593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f992f-7acd-4f47-8da8-ea32d4376b83 None admin] RBAC: Adding query filter params (role.id=8a9636f0fea542a19f6fcaf54b9c1d11, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=97fe9d04ccb445208f3783a8b55cd31e) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:33.377910 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f992f-7acd-4f47-8da8-ea32d4376b83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:33.379810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f992f-7acd-4f47-8da8-ea32d4376b83 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:33.387253 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 341/675] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:15:33 2022] GET /identity/v3/role_assignments?user.id=97fe9d04ccb445208f3783a8b55cd31e&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=8a9636f0fea542a19f6fcaf54b9c1d11 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:33.388194 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f992f-7acd-4f47-8da8-ea32d4376b83 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:33.413258 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:33.417389 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:33.469429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a08a15-0b5c-406b-93f4-d4cf67fef772 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:33.508510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50c17d-8877-453b-b079-abad0e7863c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:33.509353 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50c17d-8877-453b-b079-abad0e7863c7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:33.509629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50c17d-8877-453b-b079-abad0e7863c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:33.509895 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50c17d-8877-453b-b079-abad0e7863c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:33.512215 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f992f-7acd-4f47-8da8-ea32d4376b83 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:33.517940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50c17d-8877-453b-b079-abad0e7863c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:33.519414 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50c17d-8877-453b-b079-abad0e7863c7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:33.534521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-bb50c17d-8877-453b-b079-abad0e7863c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:33.534521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:33.534521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:33.534521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:33.534521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:33.534521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:33.534521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:33.534521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:33.534521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:33.534521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:33.534521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:33.534521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:33.534521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:33.534521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:33.534521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:33.535490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:33.535490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:33.535490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:33.535490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:33.535490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:33.535490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:33.535490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:33.535490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:33.535490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:33.535490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:33.535490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:33.535490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:33.535490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:33.535490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:33.535490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:33.535490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:33.535490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:33.536368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:33.536368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:33.536368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:33.536368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:33.536368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:33.536368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:33.536368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:33.536368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:33.536368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 335/676] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:33.536886 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50c17d-8877-453b-b079-abad0e7863c7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:33.561560 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253fedd-c430-4c2f-b847-d218334f89a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:33.562717 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253fedd-c430-4c2f-b847-d218334f89a4 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:33.562971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253fedd-c430-4c2f-b847-d218334f89a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:33.563256 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253fedd-c430-4c2f-b847-d218334f89a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:33.573037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253fedd-c430-4c2f-b847-d218334f89a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:33.574615 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253fedd-c430-4c2f-b847-d218334f89a4 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:33.592245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-3253fedd-c430-4c2f-b847-d218334f89a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:33.592245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:33.592245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:33.592245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:33.592245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:33.592245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:33.592245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:33.592245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:33.592245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:33.592245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:33.592245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:33.592245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:33.592245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:33.592245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:33.592245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:33.593266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:33.593266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:33.593266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:33.593266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:33.593266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:33.593266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:33.593266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:33.593266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:33.593266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:33.593266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:33.593266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:33.593266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:33.593266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:33.593266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:33.593266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:33.593266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:33.593266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:33.594133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:33.594133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:33.594133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:33.594133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:33.594133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:33.594133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:33.594133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:33.594133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:33.594133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 342/677] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:33.595675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4939d8-78a3-401a-94f1-e964bcd40ab4 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:33.595957 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4939d8-78a3-401a-94f1-e964bcd40ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:33.596227 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4939d8-78a3-401a-94f1-e964bcd40ab4 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:33.598117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 343/678] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:33.598904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4939d8-78a3-401a-94f1-e964bcd40ab4 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:33.662924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50c17d-8877-453b-b079-abad0e7863c7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:33.687611 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:33.689351 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:33.706664 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cec75-c619-4ac6-8599-7f922a6982c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:33.707342 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cec75-c619-4ac6-8599-7f922a6982c7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:33.707620 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cec75-c619-4ac6-8599-7f922a6982c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:33.707892 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cec75-c619-4ac6-8599-7f922a6982c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:33.708660 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cec75-c619-4ac6-8599-7f922a6982c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:33.708972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cec75-c619-4ac6-8599-7f922a6982c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:33.710404 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cec75-c619-4ac6-8599-7f922a6982c7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:33.716235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4939d8-78a3-401a-94f1-e964bcd40ab4 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:33.727988 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 336/679] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:33.727988 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cec75-c619-4ac6-8599-7f922a6982c7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:33.753678 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859b0d3-6edb-485c-bf55-9fde97da5022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:33.754274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859b0d3-6edb-485c-bf55-9fde97da5022 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:33.754555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859b0d3-6edb-485c-bf55-9fde97da5022 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:33.754958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859b0d3-6edb-485c-bf55-9fde97da5022 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:33.755658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859b0d3-6edb-485c-bf55-9fde97da5022 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:33.755907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859b0d3-6edb-485c-bf55-9fde97da5022 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:33.757376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859b0d3-6edb-485c-bf55-9fde97da5022 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:33.770231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 344/680] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:33.771321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d1b47-fcc2-40f8-a543-2333cbcbf298 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:33.771603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d1b47-fcc2-40f8-a543-2333cbcbf298 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:33.771875 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d1b47-fcc2-40f8-a543-2333cbcbf298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:33.790365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4a4d1b47-fcc2-40f8-a543-2333cbcbf298 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:33.791565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4a4d1b47-fcc2-40f8-a543-2333cbcbf298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:33.836456 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cec75-c619-4ac6-8599-7f922a6982c7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:33.863211 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 345/681] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:33.863967 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d1b47-fcc2-40f8-a543-2333cbcbf298 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:33.883504 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d92e2-cd13-4dfb-8811-f943b2d1656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:33.884569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d92e2-cd13-4dfb-8811-f943b2d1656a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:33.885572 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d92e2-cd13-4dfb-8811-f943b2d1656a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:33.885857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d92e2-cd13-4dfb-8811-f943b2d1656a None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:33.886665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d92e2-cd13-4dfb-8811-f943b2d1656a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:33.886967 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d92e2-cd13-4dfb-8811-f943b2d1656a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:33.889243 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d92e2-cd13-4dfb-8811-f943b2d1656a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:33.901225 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 337/682] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:33.907191 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d92e2-cd13-4dfb-8811-f943b2d1656a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:33.927996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:33.957637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:33.970767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d1b47-fcc2-40f8-a543-2333cbcbf298 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:34.007549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a259b3-554b-471e-adfc-66c4b88600f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:34.008659 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a259b3-554b-471e-adfc-66c4b88600f2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:34.008947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a259b3-554b-471e-adfc-66c4b88600f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:34.009217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a259b3-554b-471e-adfc-66c4b88600f2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:34.017715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a259b3-554b-471e-adfc-66c4b88600f2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:34.019171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a259b3-554b-471e-adfc-66c4b88600f2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:34.020811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d92e2-cd13-4dfb-8811-f943b2d1656a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:34.033860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-a1a259b3-554b-471e-adfc-66c4b88600f2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 03:15:34.033860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:34.033860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:34.033860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:34.033860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:34.033860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:34.033860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:34.033860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:34.033860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:34.033860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:34.033860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:34.033860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:34.033860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:34.033860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:34.033860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:34.033860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:34.034796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:34.035792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:34.035792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:34.035792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:34.035792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:34.035792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:34.035792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:34.035792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:34.035792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:34.035792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 03:15:34.035792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:34.035792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 346/683] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:15:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:34.036384 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a259b3-554b-471e-adfc-66c4b88600f2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:34.060795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4734f-893d-4757-9d34-3647962655c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:34.061835 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4734f-893d-4757-9d34-3647962655c6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:34.062283 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4734f-893d-4757-9d34-3647962655c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:34.062734 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4734f-893d-4757-9d34-3647962655c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:34.063637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4734f-893d-4757-9d34-3647962655c6 None admin] RBAC: Adding query filter params (role.id=8a9636f0fea542a19f6fcaf54b9c1d11, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=c2908efc19944583810abceb4c5d8d5f) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:34.064101 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4734f-893d-4757-9d34-3647962655c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:34.065723 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4734f-893d-4757-9d34-3647962655c6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:34.080743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 338/684] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:15:33 2022] GET /identity/v3/role_assignments?user.id=c2908efc19944583810abceb4c5d8d5f&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=8a9636f0fea542a19f6fcaf54b9c1d11 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:34.081984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4734f-893d-4757-9d34-3647962655c6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:34.154269 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a259b3-554b-471e-adfc-66c4b88600f2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:34.182539 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:34.195923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb0d1e-d8c3-429a-a7c2-8d0104887a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:34.197088 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb0d1e-d8c3-429a-a7c2-8d0104887a8d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:34.197518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb0d1e-d8c3-429a-a7c2-8d0104887a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:34.197938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb0d1e-d8c3-429a-a7c2-8d0104887a8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:34.200137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4734f-893d-4757-9d34-3647962655c6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:34.203121 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:34.211430 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb0d1e-d8c3-429a-a7c2-8d0104887a8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:34.223608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-1fbb0d1e-d8c3-429a-a7c2-8d0104887a8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:15:34.223608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:34.223608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:34.223608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:34.223608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:34.223608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:34.223608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:34.223608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:34.223608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:34.223608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:34.223608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:34.223608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:34.223608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:34.223608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:34.223608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:34.223608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:34.224931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:34.224931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:34.224931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:34.224931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:34.224931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:34.224931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:34.224931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:34.224931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:34.224931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:34.224931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:34.224931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:34.224931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:34.224931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:34.224931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:34.224931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:34.224931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:34.225954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:34.225954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:34.225954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:34.225954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:34.225954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:34.225954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:34.225954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:34.225954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:34.225954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:34.225954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:34.225954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:15:34.225954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:34.233484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 347/685] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:15:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:34.234596 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb0d1e-d8c3-429a-a7c2-8d0104887a8d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:34.239728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a12bd-953f-41a4-8286-96546e1d78b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:34.240399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a12bd-953f-41a4-8286-96546e1d78b0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:34.241443 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a12bd-953f-41a4-8286-96546e1d78b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:34.241722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a12bd-953f-41a4-8286-96546e1d78b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:34.242618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a12bd-953f-41a4-8286-96546e1d78b0 None admin] RBAC: Adding query filter params (role.id=8a9636f0fea542a19f6fcaf54b9c1d11, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=99605c4dd01f48e39a3e29a74114506d) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:34.242884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a12bd-953f-41a4-8286-96546e1d78b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:34.244337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a12bd-953f-41a4-8286-96546e1d78b0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:34.250716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 339/686] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:15:34 2022] GET /identity/v3/role_assignments?user.id=99605c4dd01f48e39a3e29a74114506d&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=8a9636f0fea542a19f6fcaf54b9c1d11 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:34.251360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a12bd-953f-41a4-8286-96546e1d78b0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:34.351953 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb0d1e-d8c3-429a-a7c2-8d0104887a8d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:34.389582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a12bd-953f-41a4-8286-96546e1d78b0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:34.394665 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e397bb-3d57-481f-983c-3cb12fb0a231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:34.395351 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e397bb-3d57-481f-983c-3cb12fb0a231 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:34.395632 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e397bb-3d57-481f-983c-3cb12fb0a231 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:34.395904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e397bb-3d57-481f-983c-3cb12fb0a231 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:34.396799 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e397bb-3d57-481f-983c-3cb12fb0a231 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:34.397107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e397bb-3d57-481f-983c-3cb12fb0a231 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:34.398581 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e397bb-3d57-481f-983c-3cb12fb0a231 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:34.421313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 348/687] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Jul 12 03:15:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:34.427339 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e397bb-3d57-481f-983c-3cb12fb0a231 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:34.456298 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13651aa-c3ad-404b-bae8-ed119bc52bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:34.456936 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13651aa-c3ad-404b-bae8-ed119bc52bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:34.457219 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13651aa-c3ad-404b-bae8-ed119bc52bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:34.457492 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13651aa-c3ad-404b-bae8-ed119bc52bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:34.458269 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13651aa-c3ad-404b-bae8-ed119bc52bb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:34.458579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13651aa-c3ad-404b-bae8-ed119bc52bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:34.459983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13651aa-c3ad-404b-bae8-ed119bc52bb1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:34.472149 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 340/688] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:34.478881 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13651aa-c3ad-404b-bae8-ed119bc52bb1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:34.490021 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:34.521938 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:34.561723 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e397bb-3d57-481f-983c-3cb12fb0a231 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:34.608217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf5ab1-40df-43e9-ad20-f6cd1049b9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:34.608909 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf5ab1-40df-43e9-ad20-f6cd1049b9ff None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:34.609184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf5ab1-40df-43e9-ad20-f6cd1049b9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:34.609452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf5ab1-40df-43e9-ad20-f6cd1049b9ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:34.621445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13651aa-c3ad-404b-bae8-ed119bc52bb1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:34.667267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be3236-7226-4bd1-a5b3-7d717d31e765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:34.668320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be3236-7226-4bd1-a5b3-7d717d31e765 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:34.668641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be3236-7226-4bd1-a5b3-7d717d31e765 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:34.668977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be3236-7226-4bd1-a5b3-7d717d31e765 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:34.689275 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be3236-7226-4bd1-a5b3-7d717d31e765 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:34.691023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be3236-7226-4bd1-a5b3-7d717d31e765 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:34.696082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf5ab1-40df-43e9-ad20-f6cd1049b9ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:34.697688 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf5ab1-40df-43e9-ad20-f6cd1049b9ff None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:34.719354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-18be3236-7226-4bd1-a5b3-7d717d31e765 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:34.719354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:34.719354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:34.719354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:34.719354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:34.719354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:34.719354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:34.719354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:34.719354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:34.719354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:34.719354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:34.719354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:34.719354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:34.719354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:34.719354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:34.720260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:34.720260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:34.720260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:34.720260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:34.720260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:34.720260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:34.720260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:34.720260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:34.720260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:34.720260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:34.720260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:34.720260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:34.720260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:34.720260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:34.720260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:34.720260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:34.720260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:34.721207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:34.721207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:34.721207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:34.721207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:34.722563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 341/689] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:34.733656 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be3236-7226-4bd1-a5b3-7d717d31e765 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:34.749747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:34.836661 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 349/690] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 03:15:34.841840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf5ab1-40df-43e9-ad20-f6cd1049b9ff None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:34.930153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:34.952600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf5ab1-40df-43e9-ad20-f6cd1049b9ff None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:34.975417 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be3236-7226-4bd1-a5b3-7d717d31e765 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:35.021382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f1903-5a64-4fbc-aedf-942182a8f031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:35.022201 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f1903-5a64-4fbc-aedf-942182a8f031 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:35.022482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f1903-5a64-4fbc-aedf-942182a8f031 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:35.022758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f1903-5a64-4fbc-aedf-942182a8f031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:35.037048 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f1903-5a64-4fbc-aedf-942182a8f031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:35.038898 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f1903-5a64-4fbc-aedf-942182a8f031 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:35.041208 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:35.060970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-3d1f1903-5a64-4fbc-aedf-942182a8f031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:35.060970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:35.060970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:35.060970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:35.060970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:35.060970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:35.060970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:35.060970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:35.060970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:35.060970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:35.060970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:35.060970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:35.060970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:35.060970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:35.060970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:35.061943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:35.061943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:35.061943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:35.061943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:35.061943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:35.061943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:35.061943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:35.061943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:35.061943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:35.061943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:35.061943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:35.061943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:35.061943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:35.061943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:35.061943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:35.061943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:35.061943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:35.062926 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:35.062926 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:35.062926 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:35.062926 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:35.063162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258bdfc-53f0-4f8d-a2bd-b9199be8ad5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:35.063162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258bdfc-53f0-4f8d-a2bd-b9199be8ad5c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:35.063162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258bdfc-53f0-4f8d-a2bd-b9199be8ad5c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:35.063162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258bdfc-53f0-4f8d-a2bd-b9199be8ad5c None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:35.063919 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258bdfc-53f0-4f8d-a2bd-b9199be8ad5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:35.064092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258bdfc-53f0-4f8d-a2bd-b9199be8ad5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:35.065636 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258bdfc-53f0-4f8d-a2bd-b9199be8ad5c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:35.066080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 350/691] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:35.072066 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f1903-5a64-4fbc-aedf-942182a8f031 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:35.102862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 342/692] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:35.113577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258bdfc-53f0-4f8d-a2bd-b9199be8ad5c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:35.187688 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f1903-5a64-4fbc-aedf-942182a8f031 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:35.232035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a54e9-b214-421e-a33c-8038cb868e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:35.233077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a54e9-b214-421e-a33c-8038cb868e62 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:35.234484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a54e9-b214-421e-a33c-8038cb868e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:35.235508 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a54e9-b214-421e-a33c-8038cb868e62 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:35.237357 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a54e9-b214-421e-a33c-8038cb868e62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:35.239188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a54e9-b214-421e-a33c-8038cb868e62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:35.240854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a54e9-b214-421e-a33c-8038cb868e62 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:35.272854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 351/693] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:35.289923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a54e9-b214-421e-a33c-8038cb868e62 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:35.327213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258bdfc-53f0-4f8d-a2bd-b9199be8ad5c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:35.391149 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:35.393239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91602088-899d-4da9-bb04-4116bc84d363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:35.394060 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91602088-899d-4da9-bb04-4116bc84d363 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:35.396880 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91602088-899d-4da9-bb04-4116bc84d363 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:35.396880 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91602088-899d-4da9-bb04-4116bc84d363 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:35.409664 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91602088-899d-4da9-bb04-4116bc84d363 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:35.411124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91602088-899d-4da9-bb04-4116bc84d363 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:35.438195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a54e9-b214-421e-a33c-8038cb868e62 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:35.449294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-91602088-899d-4da9-bb04-4116bc84d363 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:15:35.449294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:35.449294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:35.449294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:35.449294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:35.449294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:35.449294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:35.449294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:35.449294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:35.449294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:35.449294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:35.449294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:35.449294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:35.449294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:35.449294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:35.449294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:35.450259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:35.451197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:35.451197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:35.451197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:35.451197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:35.451197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:35.451197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:35.451197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:35.451197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:35.451197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:15:35.451197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:35.451197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 343/694] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 03:15:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:35.456176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91602088-899d-4da9-bb04-4116bc84d363 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:35.462624 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:35.473389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b32144-9414-4e3a-9140-2d018ea8b112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:35.474620 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b32144-9414-4e3a-9140-2d018ea8b112 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:35.474913 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b32144-9414-4e3a-9140-2d018ea8b112 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:35.475165 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b32144-9414-4e3a-9140-2d018ea8b112 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:35.483452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b32144-9414-4e3a-9140-2d018ea8b112 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:35.485244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b32144-9414-4e3a-9140-2d018ea8b112 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:35.501171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-f1b32144-9414-4e3a-9140-2d018ea8b112 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:35.501171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:35.501171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:35.501171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:35.501171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:35.501171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:35.501171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:35.501171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:35.501171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:35.501171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:35.501171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:35.501171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:35.501171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:35.501171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:35.501171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:35.502081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:35.502081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:35.502081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:35.502081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:35.502081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:35.502081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:35.502081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:35.502081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:35.502081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:35.502081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:35.502081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:35.502081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:35.502081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:35.502081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:35.502081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:35.502081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:35.502081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:35.502965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:35.502965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:35.502965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:35.502965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:35.502965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:35.502965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:35.502965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:35.502965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:35.502965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 352/695] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:35.510812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b32144-9414-4e3a-9140-2d018ea8b112 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:35.651892 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91602088-899d-4da9-bb04-4116bc84d363 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:35.694156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2e097-3b22-4c45-8b1f-064d71fe16c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:35.695200 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2e097-3b22-4c45-8b1f-064d71fe16c2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:35.695703 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2e097-3b22-4c45-8b1f-064d71fe16c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:35.696193 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2e097-3b22-4c45-8b1f-064d71fe16c2 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:35.697279 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2e097-3b22-4c45-8b1f-064d71fe16c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:35.697475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b32144-9414-4e3a-9140-2d018ea8b112 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:35.697976 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2e097-3b22-4c45-8b1f-064d71fe16c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:35.699666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2e097-3b22-4c45-8b1f-064d71fe16c2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:35.718761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:35.726351 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 344/696] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 03:15:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:35.728825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b6e6-554a-4a57-9a62-2ab6f198870d None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:35.729314 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b6e6-554a-4a57-9a62-2ab6f198870d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:35.729830 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b6e6-554a-4a57-9a62-2ab6f198870d None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:35.732107 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 345/697] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:35.733241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77b6e6-554a-4a57-9a62-2ab6f198870d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:35.748121 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4aae6-a7b8-4314-a15a-e156025b8326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:35.749133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4aae6-a7b8-4314-a15a-e156025b8326 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:35.749638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4aae6-a7b8-4314-a15a-e156025b8326 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:35.750123 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4aae6-a7b8-4314-a15a-e156025b8326 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:35.751114 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4aae6-a7b8-4314-a15a-e156025b8326 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:35.751628 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4aae6-a7b8-4314-a15a-e156025b8326 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:35.753401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4aae6-a7b8-4314-a15a-e156025b8326 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:35.766245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 353/698] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:35.772688 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4932ee-0149-44dc-9872-7bf816d1a815 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:35.773190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4932ee-0149-44dc-9872-7bf816d1a815 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:35.773682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4932ee-0149-44dc-9872-7bf816d1a815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:35.791212 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2f4932ee-0149-44dc-9872-7bf816d1a815 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:35.792811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2f4932ee-0149-44dc-9872-7bf816d1a815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:35.813571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:35.860050 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77b6e6-554a-4a57-9a62-2ab6f198870d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:35.863830 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 354/699] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:35.865013 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4932ee-0149-44dc-9872-7bf816d1a815 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:35.919587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3be6e8-6ca9-49c7-a9ad-718b5bc6c74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:35.920246 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3be6e8-6ca9-49c7-a9ad-718b5bc6c74f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:35.920540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3be6e8-6ca9-49c7-a9ad-718b5bc6c74f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:35.920826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3be6e8-6ca9-49c7-a9ad-718b5bc6c74f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:35.968757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4932ee-0149-44dc-9872-7bf816d1a815 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:35.972210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:35.990916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3be6e8-6ca9-49c7-a9ad-718b5bc6c74f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:35.992372 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3be6e8-6ca9-49c7-a9ad-718b5bc6c74f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:36.008155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc5591-d3bd-4001-92aa-ad39053769ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:36.009155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc5591-d3bd-4001-92aa-ad39053769ef None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:36.009656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc5591-d3bd-4001-92aa-ad39053769ef None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:36.010122 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc5591-d3bd-4001-92aa-ad39053769ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:36.011146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc5591-d3bd-4001-92aa-ad39053769ef None admin] RBAC: Adding query filter params (role.id=8a9636f0fea542a19f6fcaf54b9c1d11, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=ffc4cbd87dd249868cfb704535774126) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:36.011652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc5591-d3bd-4001-92aa-ad39053769ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:36.013402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc5591-d3bd-4001-92aa-ad39053769ef None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:36.020175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 355/700] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:15:35 2022] GET /identity/v3/role_assignments?user.id=ffc4cbd87dd249868cfb704535774126&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=8a9636f0fea542a19f6fcaf54b9c1d11 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:36.028430 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc5591-d3bd-4001-92aa-ad39053769ef None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:36.052829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:36.099418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 346/701] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 03:15:36.109886 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3be6e8-6ca9-49c7-a9ad-718b5bc6c74f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:36.168566 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc5591-d3bd-4001-92aa-ad39053769ef None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:36.201358 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504d387-3ead-4d17-9b7c-cf817c1008f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:36.202351 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504d387-3ead-4d17-9b7c-cf817c1008f6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:36.202732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504d387-3ead-4d17-9b7c-cf817c1008f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:36.203093 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504d387-3ead-4d17-9b7c-cf817c1008f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:36.215883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504d387-3ead-4d17-9b7c-cf817c1008f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:36.217702 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504d387-3ead-4d17-9b7c-cf817c1008f6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:36.237268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-3504d387-3ead-4d17-9b7c-cf817c1008f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:36.237268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:36.237268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:36.237268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:36.237268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:36.237268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:36.237268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:36.237268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:36.237268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:36.237268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:36.237268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:36.237268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:36.237268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:36.237268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:36.237268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:36.238377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:36.238377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:36.238377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:36.238377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:36.238377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:36.238377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:36.238377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:36.238377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:36.238377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:36.238377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:36.238377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:36.238377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:36.238377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:36.238377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:36.238377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:36.238377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:36.238377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:36.239505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:36.239505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:36.239505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:36.239505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:36.241188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 356/702] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:36.247969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504d387-3ead-4d17-9b7c-cf817c1008f6 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:36.294600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:36.322816 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3be6e8-6ca9-49c7-a9ad-718b5bc6c74f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:36.363757 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a7cd4-824d-4093-afde-60517c2fa620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:36.364854 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a7cd4-824d-4093-afde-60517c2fa620 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:36.365299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a7cd4-824d-4093-afde-60517c2fa620 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:36.365707 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a7cd4-824d-4093-afde-60517c2fa620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:36.379190 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a7cd4-824d-4093-afde-60517c2fa620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:36.380739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a7cd4-824d-4093-afde-60517c2fa620 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:36.395478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504d387-3ead-4d17-9b7c-cf817c1008f6 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:36.400825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-389a7cd4-824d-4093-afde-60517c2fa620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:36.400825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:36.400825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:36.400825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:36.400825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:36.400825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:36.400825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:36.400825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:36.400825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:36.400825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:36.400825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:36.400825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:36.400825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:36.400825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:36.400825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:36.401708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:36.401708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:36.401708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:36.401708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:36.401708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:36.401708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:36.401708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:36.401708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:36.401708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:36.401708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:36.401708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:36.401708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:36.401708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:36.401708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:36.401708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:36.401708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:36.401708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:36.402583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:36.402583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:36.402583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:36.402583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:36.402583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 347/703] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:36.408211 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a7cd4-824d-4093-afde-60517c2fa620 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:36.426394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:36.449813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d69cc8-4dc7-4de4-a55d-2ce2a22f873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:36.451472 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69cc8-4dc7-4de4-a55d-2ce2a22f873c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:36.451940 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69cc8-4dc7-4de4-a55d-2ce2a22f873c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:36.452387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69cc8-4dc7-4de4-a55d-2ce2a22f873c None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:36.453589 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d69cc8-4dc7-4de4-a55d-2ce2a22f873c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:36.454073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d69cc8-4dc7-4de4-a55d-2ce2a22f873c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:36.456646 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d69cc8-4dc7-4de4-a55d-2ce2a22f873c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:36.473870 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 357/704] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:36.481403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d69cc8-4dc7-4de4-a55d-2ce2a22f873c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:36.540029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a7cd4-824d-4093-afde-60517c2fa620 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:36.576581 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:36.581399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054f85e-3cad-42f5-83fe-18e3bb02de38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:36.582315 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054f85e-3cad-42f5-83fe-18e3bb02de38 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:36.582773 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054f85e-3cad-42f5-83fe-18e3bb02de38 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:36.583252 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054f85e-3cad-42f5-83fe-18e3bb02de38 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:36.584184 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054f85e-3cad-42f5-83fe-18e3bb02de38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:36.584492 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054f85e-3cad-42f5-83fe-18e3bb02de38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:36.585916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054f85e-3cad-42f5-83fe-18e3bb02de38 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:36.601624 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 348/705] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:36.601834 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d69cc8-4dc7-4de4-a55d-2ce2a22f873c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:36.601954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d53bb2-9a2d-4034-9e17-eb51d6655acc None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:36.601954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d53bb2-9a2d-4034-9e17-eb51d6655acc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:36.601954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d53bb2-9a2d-4034-9e17-eb51d6655acc None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:36.601954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 349/706] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:36.609611 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cf077-cb2c-42a7-a100-8ecb86c0e26b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:36.610013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cf077-cb2c-42a7-a100-8ecb86c0e26b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:36.610383 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cf077-cb2c-42a7-a100-8ecb86c0e26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:36.632233 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a67cf077-cb2c-42a7-a100-8ecb86c0e26b None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:36.634198 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a67cf077-cb2c-42a7-a100-8ecb86c0e26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:36.643537 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868dc47-3884-4e27-bd74-483034e532fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:36.644357 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868dc47-3884-4e27-bd74-483034e532fa None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:36.645147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868dc47-3884-4e27-bd74-483034e532fa None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:36.645147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868dc47-3884-4e27-bd74-483034e532fa None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:36.645867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868dc47-3884-4e27-bd74-483034e532fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:36.647554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868dc47-3884-4e27-bd74-483034e532fa None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:36.672188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 358/707] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:15:36 2022] POST /identity/v3/users => generated 254 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:15:36.673502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868dc47-3884-4e27-bd74-483034e532fa None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:36.743343 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 350/708] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:15:36.766582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b65a2-dc68-4822-b533-47fd5cde6498 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:36.767264 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b65a2-dc68-4822-b533-47fd5cde6498 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:36.767934 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b65a2-dc68-4822-b533-47fd5cde6498 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:36.771008 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 351/709] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:15:36.776184 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272ae3b-af52-4c2a-8be3-0bf7f6a4a110 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:36.776858 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272ae3b-af52-4c2a-8be3-0bf7f6a4a110 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:36.777420 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272ae3b-af52-4c2a-8be3-0bf7f6a4a110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:36.796958 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:36.798842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868dc47-3884-4e27-bd74-483034e532fa None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:36.799581 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f272ae3b-af52-4c2a-8be3-0bf7f6a4a110 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:36.801325 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f272ae3b-af52-4c2a-8be3-0bf7f6a4a110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:36.844401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7db50-830f-47a0-a045-4bf5200cfd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:36.845167 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7db50-830f-47a0-a045-4bf5200cfd9c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:36.845463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7db50-830f-47a0-a045-4bf5200cfd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:36.847006 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7db50-830f-47a0-a045-4bf5200cfd9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:36.850296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:36.856089 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7db50-830f-47a0-a045-4bf5200cfd9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:36.858714 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7db50-830f-47a0-a045-4bf5200cfd9c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:36.878889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-9ef7db50-830f-47a0-a045-4bf5200cfd9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:36.878889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:36.878889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:36.878889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:36.878889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:36.878889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:36.878889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:36.878889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:36.878889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:36.878889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:36.878889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:36.878889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:36.878889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:36.878889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:36.878889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:36.880009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:36.880009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:36.880009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:36.880009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:36.880009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:36.880009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:36.880009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:36.880009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:36.880009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:36.880009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:36.880009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:36.880009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:36.880009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:36.880009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:36.880009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:36.880009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:36.880009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:36.881159 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:36.881159 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:36.881159 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:36.881159 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:36.881159 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:36.881159 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:36.881159 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:36.881159 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:36.884342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 359/710] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:36.884342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7db50-830f-47a0-a045-4bf5200cfd9c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:36.902826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 352/711] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:36.904020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272ae3b-af52-4c2a-8be3-0bf7f6a4a110 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:37.005045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7db50-830f-47a0-a045-4bf5200cfd9c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:37.025951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272ae3b-af52-4c2a-8be3-0bf7f6a4a110 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:37.051600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be96863-0456-4ee7-9ab5-d87c4d2dc570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:37.053018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be96863-0456-4ee7-9ab5-d87c4d2dc570 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:37.053689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be96863-0456-4ee7-9ab5-d87c4d2dc570 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:37.054571 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be96863-0456-4ee7-9ab5-d87c4d2dc570 None admin] PATH_INFO: `/v3/services/network` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:37.055719 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be96863-0456-4ee7-9ab5-d87c4d2dc570 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:37.057511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:37.058855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be96863-0456-4ee7-9ab5-d87c4d2dc570 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:37.065247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a635522-1223-4a09-a12f-bed40b16f55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:37.066057 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a635522-1223-4a09-a12f-bed40b16f55a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:37.066387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a635522-1223-4a09-a12f-bed40b16f55a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:37.066665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a635522-1223-4a09-a12f-bed40b16f55a None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:37.067474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a635522-1223-4a09-a12f-bed40b16f55a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:37.067779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a635522-1223-4a09-a12f-bed40b16f55a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:37.069257 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a635522-1223-4a09-a12f-bed40b16f55a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:37.076837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7be96863-0456-4ee7-9ab5-d87c4d2dc570 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 03:15:37.076837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:37.076837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:15:37.076837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:15:37.076837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:15:37.076837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:15:37.076837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:15:37.076837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:37.076837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 03:15:37.076837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:37.076837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:15:37.076837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:37.076837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:37.076837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:37.076837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:37.076837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:37.076837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:37.077924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:37.077924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:37.077924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:37.077924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:37.077924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:37.077924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:37.077924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:15:37.077924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:15:37.077924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:15:37.077924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:15:37.077924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:37.077924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:37.077924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:37.077924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:37.077924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:37.077924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:37.078800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:37.078800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:37.078800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:37.078800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:37.078800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:37.078800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:37.078800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:37.078800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:37.078800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:37.078800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:37.078800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:15:37.078800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:37.078800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 03:15:37.078800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:37.083699 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 360/712] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:36 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:37.084429 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be96863-0456-4ee7-9ab5-d87c4d2dc570 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:37.092569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 353/713] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:37.093773 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a635522-1223-4a09-a12f-bed40b16f55a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:37.172990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:37.223861 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a635522-1223-4a09-a12f-bed40b16f55a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:37.224329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be96863-0456-4ee7-9ab5-d87c4d2dc570 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:37.259249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be2bc3-1e07-4bb0-bdad-9e27e6c407bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:37.260260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be2bc3-1e07-4bb0-bdad-9e27e6c407bc None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:37.260372 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be2bc3-1e07-4bb0-bdad-9e27e6c407bc None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:37.260616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be2bc3-1e07-4bb0-bdad-9e27e6c407bc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:37.261271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be2bc3-1e07-4bb0-bdad-9e27e6c407bc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:37.262672 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be2bc3-1e07-4bb0-bdad-9e27e6c407bc None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:37.269945 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9779a-529e-4d85-af75-095bb15d282a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:37.270921 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9779a-529e-4d85-af75-095bb15d282a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:37.271413 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9779a-529e-4d85-af75-095bb15d282a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:37.271918 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9779a-529e-4d85-af75-095bb15d282a None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:37.272865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9779a-529e-4d85-af75-095bb15d282a None admin] RBAC: Adding query filter params (name=network) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:37.273383 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9779a-529e-4d85-af75-095bb15d282a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:37.274947 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9779a-529e-4d85-af75-095bb15d282a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:37.277164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-37be2bc3-1e07-4bb0-bdad-9e27e6c407bc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 03:15:37.277164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:37.277164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:15:37.277164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:15:37.277164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:15:37.277164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:15:37.277164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:15:37.277164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:37.277164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 03:15:37.277164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:37.277164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:15:37.277164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:37.277164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:37.277164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:37.277164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:37.277164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:37.278209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:37.278209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:37.278209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:37.278209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:37.278209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:37.278209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:37.278209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:37.278209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:15:37.278209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:15:37.278209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:15:37.278209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:15:37.278209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:37.278209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:37.278209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:37.278209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:37.278209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:37.279246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:37.279246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:37.279246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:37.279246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:37.279246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:37.279246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:37.279246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:37.279246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:37.279246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:37.279246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:37.279246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:37.279246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:15:37.279246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:37.279246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 03:15:37.279246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:37.283335 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 361/714] 10.222.0.26 () {56 vars in 1129 bytes} [Tue Jul 12 03:15:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:37.283767 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 354/715] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 03:15:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:37.284297 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be2bc3-1e07-4bb0-bdad-9e27e6c407bc None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:37.288561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9779a-529e-4d85-af75-095bb15d282a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:37.352493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:37.399441 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9779a-529e-4d85-af75-095bb15d282a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:37.435407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be2bc3-1e07-4bb0-bdad-9e27e6c407bc None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:37.449563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b946b6-dd61-4665-9cbb-e838ba96776b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:37.451410 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b946b6-dd61-4665-9cbb-e838ba96776b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:37.451795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b946b6-dd61-4665-9cbb-e838ba96776b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:37.452165 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b946b6-dd61-4665-9cbb-e838ba96776b None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:37.453038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b946b6-dd61-4665-9cbb-e838ba96776b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:37.453628 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b946b6-dd61-4665-9cbb-e838ba96776b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:37.455779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b946b6-dd61-4665-9cbb-e838ba96776b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:37.462297 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 355/716] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Jul 12 03:15:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:37.463230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b946b6-dd61-4665-9cbb-e838ba96776b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:37.466696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:37.481926 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b54839-c178-4e25-bbef-116be0d76c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:37.483119 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b54839-c178-4e25-bbef-116be0d76c3a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:37.483551 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b54839-c178-4e25-bbef-116be0d76c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:37.484001 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b54839-c178-4e25-bbef-116be0d76c3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:37.485757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b54839-c178-4e25-bbef-116be0d76c3a None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=0c43d9d0a6264b19a843077a4669ce70) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:37.486278 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b54839-c178-4e25-bbef-116be0d76c3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:37.488425 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b54839-c178-4e25-bbef-116be0d76c3a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:37.496273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 362/717] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:15:37 2022] GET /identity/v3/role_assignments?user.id=0c43d9d0a6264b19a843077a4669ce70&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:37.497807 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b54839-c178-4e25-bbef-116be0d76c3a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:37.669922 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b946b6-dd61-4665-9cbb-e838ba96776b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:37.684417 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b54839-c178-4e25-bbef-116be0d76c3a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:37.695906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:37.714125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa09500-cddf-4a16-a5de-f577e0fd119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:37.714801 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa09500-cddf-4a16-a5de-f577e0fd119d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:37.715082 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa09500-cddf-4a16-a5de-f577e0fd119d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:37.715354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa09500-cddf-4a16-a5de-f577e0fd119d None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:37.717830 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa09500-cddf-4a16-a5de-f577e0fd119d None admin] RBAC: Adding query filter params (type=network) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:37.718143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa09500-cddf-4a16-a5de-f577e0fd119d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:37.719546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa09500-cddf-4a16-a5de-f577e0fd119d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:37.726231 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 356/718] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 03:15:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:37.739470 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9dd0d-c2e9-4821-a3ab-07376d0d4e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:37.740290 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9dd0d-c2e9-4821-a3ab-07376d0d4e30 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:37.740667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9dd0d-c2e9-4821-a3ab-07376d0d4e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:37.741017 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9dd0d-c2e9-4821-a3ab-07376d0d4e30 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:37.741818 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9dd0d-c2e9-4821-a3ab-07376d0d4e30 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:37.742247 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9dd0d-c2e9-4821-a3ab-07376d0d4e30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:37.743677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9dd0d-c2e9-4821-a3ab-07376d0d4e30 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:37.757096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 363/719] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Jul 12 03:15:37 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:38.759069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686f659-7d9b-4fad-80ce-77b94bebd069 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:38.759587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686f659-7d9b-4fad-80ce-77b94bebd069 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:38.759663 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686f659-7d9b-4fad-80ce-77b94bebd069 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:38.761246 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 357/720] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:38.766937 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce06e89-df2c-4ffb-ae35-d3562c71348e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:38.767387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce06e89-df2c-4ffb-ae35-d3562c71348e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:38.767570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce06e89-df2c-4ffb-ae35-d3562c71348e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:38.786241 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-1ce06e89-df2c-4ffb-ae35-d3562c71348e None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:38.787438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1ce06e89-df2c-4ffb-ae35-d3562c71348e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:38.847512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:38.874287 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 364/721] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 03:15:38.901272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686f659-7d9b-4fad-80ce-77b94bebd069 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:39.039178 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0176c1-5282-441e-9337-54a650c6bf61 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:39.039354 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0176c1-5282-441e-9337-54a650c6bf61 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:39.039655 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0176c1-5282-441e-9337-54a650c6bf61 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:39.041311 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 365/722] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:15:39.045717 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f0929-1ac5-4602-ab03-778f1ee83053 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:39.046226 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f0929-1ac5-4602-ab03-778f1ee83053 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:39.046694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f0929-1ac5-4602-ab03-778f1ee83053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:39.065395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686f659-7d9b-4fad-80ce-77b94bebd069 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:39.085505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ea0f0929-1ac5-4602-ab03-778f1ee83053 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:39.087126 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ea0f0929-1ac5-4602-ab03-778f1ee83053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:39.102049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56f6f7-d57d-4f9a-a46a-2573834dca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:39.102853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56f6f7-d57d-4f9a-a46a-2573834dca8b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:39.103138 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56f6f7-d57d-4f9a-a46a-2573834dca8b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:39.103410 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56f6f7-d57d-4f9a-a46a-2573834dca8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:39.114958 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56f6f7-d57d-4f9a-a46a-2573834dca8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:39.123483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-ae56f6f7-d57d-4f9a-a46a-2573834dca8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:15:39.123483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:39.123483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:39.123483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:39.123483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:39.123483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:39.123483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:39.123483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:39.123483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:39.123483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:39.123483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:39.123483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:39.123483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:39.123483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:39.123483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:39.123483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:39.124390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:39.124390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:39.124390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:39.124390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:39.124390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:39.124390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:39.124390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:39.124390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:39.124390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:39.124390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:39.124390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:39.124390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:39.124390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:39.124390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:39.124390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:39.124390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:39.125640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:39.125640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:39.125640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:39.125640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:39.125640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:39.125640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:39.125640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:39.125640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:39.125640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:39.125640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:39.125640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:15:39.125640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:39.125640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 358/723] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:15:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:39.131181 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56f6f7-d57d-4f9a-a46a-2573834dca8b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:39.185491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:39.242955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56f6f7-d57d-4f9a-a46a-2573834dca8b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:39.280009 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31ab26-dc83-471a-882d-51d099a2daa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:39.280719 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31ab26-dc83-471a-882d-51d099a2daa0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:39.281006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31ab26-dc83-471a-882d-51d099a2daa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:39.281537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31ab26-dc83-471a-882d-51d099a2daa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:39.282303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31ab26-dc83-471a-882d-51d099a2daa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:39.282609 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31ab26-dc83-471a-882d-51d099a2daa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:39.284260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31ab26-dc83-471a-882d-51d099a2daa0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:39.294473 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 359/724] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:39.296436 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 366/725] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:39.299406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31ab26-dc83-471a-882d-51d099a2daa0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:39.331321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f0929-1ac5-4602-ab03-778f1ee83053 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:39.408427 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31ab26-dc83-471a-882d-51d099a2daa0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:39.439953 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:39.443699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11ff31-586e-4371-b9d0-a84b5b4010bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:39.444507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11ff31-586e-4371-b9d0-a84b5b4010bc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:39.444821 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11ff31-586e-4371-b9d0-a84b5b4010bc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:39.445101 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11ff31-586e-4371-b9d0-a84b5b4010bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:39.457023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11ff31-586e-4371-b9d0-a84b5b4010bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:39.458571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11ff31-586e-4371-b9d0-a84b5b4010bc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:39.476618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7f11ff31-586e-4371-b9d0-a84b5b4010bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:39.476618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:39.476618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:39.476618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:39.476618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:39.476618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:39.476618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:39.476618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:39.476618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:39.476618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:39.476618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:39.476618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:39.476618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:39.476618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:39.476618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:39.477532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:39.477532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:39.477532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:39.477532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:39.477532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:39.477532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:39.477532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:39.477532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:39.477532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:39.477532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:39.477532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:39.477532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:39.477532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:39.477532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:39.477532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:39.477532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:39.477532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:39.478397 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:39.478397 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:39.478397 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:39.478397 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:39.478397 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 360/726] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:39.483528 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11ff31-586e-4371-b9d0-a84b5b4010bc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:39.519281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f0929-1ac5-4602-ab03-778f1ee83053 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:39.549210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:39.588617 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11ff31-586e-4371-b9d0-a84b5b4010bc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:39.588813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da2788-cb5d-45cc-8dc2-7e58516e2213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:39.589463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da2788-cb5d-45cc-8dc2-7e58516e2213 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:39.589739 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da2788-cb5d-45cc-8dc2-7e58516e2213 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:39.590008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da2788-cb5d-45cc-8dc2-7e58516e2213 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:39.613685 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da2788-cb5d-45cc-8dc2-7e58516e2213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:39.623405 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d6c67-5423-48ec-b15b-06fad9597858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:39.624080 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d6c67-5423-48ec-b15b-06fad9597858 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:39.624363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d6c67-5423-48ec-b15b-06fad9597858 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:39.624671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d6c67-5423-48ec-b15b-06fad9597858 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:39.625414 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d6c67-5423-48ec-b15b-06fad9597858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:39.625720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d6c67-5423-48ec-b15b-06fad9597858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:39.627105 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d6c67-5423-48ec-b15b-06fad9597858 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:39.629734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-e3da2788-cb5d-45cc-8dc2-7e58516e2213 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:39.629734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:39.629734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:39.629734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:39.629734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:39.629734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:39.629734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:39.629734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:39.629734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:39.629734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:39.629734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:39.629734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:39.629734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:39.629734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:39.629734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:39.629734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:39.630662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:39.630662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:39.630662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:39.630662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:39.630662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:39.630662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:39.630662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:39.630662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:39.630662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:39.630662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:39.630662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:39.630662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:39.630662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:39.630662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:39.630662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:39.630662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:39.631490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:39.631490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:39.631490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:39.631490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:39.631490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:39.631490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:39.631490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:39.631490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:39.631490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:39.631490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:39.631490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:39.631490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:39.635422 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 367/727] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:39.636497 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da2788-cb5d-45cc-8dc2-7e58516e2213 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:39.640277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 361/728] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:39.645725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d6c67-5423-48ec-b15b-06fad9597858 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:39.678867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:39.751183 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d6c67-5423-48ec-b15b-06fad9597858 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:39.795347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7801ce5-c537-4b10-95ba-5b93b212d7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:39.796157 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7801ce5-c537-4b10-95ba-5b93b212d7ef None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:39.796437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7801ce5-c537-4b10-95ba-5b93b212d7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:39.796737 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7801ce5-c537-4b10-95ba-5b93b212d7ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:39.810416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7801ce5-c537-4b10-95ba-5b93b212d7ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:39.811813 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7801ce5-c537-4b10-95ba-5b93b212d7ef None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:39.829987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a7801ce5-c537-4b10-95ba-5b93b212d7ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 03:15:39.829987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:39.829987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:39.829987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:39.829987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:39.829987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:39.829987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:39.829987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:39.829987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:39.829987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:39.829987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:39.829987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:39.829987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:39.829987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:39.829987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:39.829987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:39.830975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:39.832387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:39.832387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:39.832387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:39.832387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:39.832387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:39.832387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:39.832387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:39.832387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:39.832387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 03:15:39.832387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:39.832387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 362/729] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:15:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:39.837046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7801ce5-c537-4b10-95ba-5b93b212d7ef None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:39.887385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da2788-cb5d-45cc-8dc2-7e58516e2213 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:39.921874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:39.941105 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7801ce5-c537-4b10-95ba-5b93b212d7ef None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:39.977331 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadc306-986f-467f-85aa-e87defbb7cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:39.978120 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadc306-986f-467f-85aa-e87defbb7cab None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:39.978407 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadc306-986f-467f-85aa-e87defbb7cab None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:39.978683 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadc306-986f-467f-85aa-e87defbb7cab None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:39.979537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadc306-986f-467f-85aa-e87defbb7cab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:39.979854 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadc306-986f-467f-85aa-e87defbb7cab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:39.981501 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadc306-986f-467f-85aa-e87defbb7cab None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:40.000491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 363/730] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Jul 12 03:15:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:40.006138 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadc306-986f-467f-85aa-e87defbb7cab None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:40.007806 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d0603-c165-46cd-8193-31d9835bfff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:40.008490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d0603-c165-46cd-8193-31d9835bfff4 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:40.008792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d0603-c165-46cd-8193-31d9835bfff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:40.009057 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d0603-c165-46cd-8193-31d9835bfff4 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:40.009812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d0603-c165-46cd-8193-31d9835bfff4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:40.010108 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d0603-c165-46cd-8193-31d9835bfff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:40.011478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d0603-c165-46cd-8193-31d9835bfff4 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:40.027041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 368/731] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:40.037601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d0603-c165-46cd-8193-31d9835bfff4 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:40.107042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:40.112480 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadc306-986f-467f-85aa-e87defbb7cab None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:40.148841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626e055-6ee7-4d07-9a59-e0aaa056904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:40.149756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626e055-6ee7-4d07-9a59-e0aaa056904f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:40.150184 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626e055-6ee7-4d07-9a59-e0aaa056904f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:40.150634 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626e055-6ee7-4d07-9a59-e0aaa056904f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:40.169608 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:40.222979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d0603-c165-46cd-8193-31d9835bfff4 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:40.224219 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626e055-6ee7-4d07-9a59-e0aaa056904f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:40.225984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626e055-6ee7-4d07-9a59-e0aaa056904f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:40.259587 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451bf72-1fc2-4f5d-84ad-ee3901132285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:40.260536 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451bf72-1fc2-4f5d-84ad-ee3901132285 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:40.260829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451bf72-1fc2-4f5d-84ad-ee3901132285 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:40.261106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451bf72-1fc2-4f5d-84ad-ee3901132285 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:40.272492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451bf72-1fc2-4f5d-84ad-ee3901132285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:40.273972 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451bf72-1fc2-4f5d-84ad-ee3901132285 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:40.291435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-9451bf72-1fc2-4f5d-84ad-ee3901132285 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:40.291435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:40.291435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:40.291435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:40.291435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:40.291435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:40.291435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:40.291435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:40.291435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:40.291435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:40.291435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:40.291435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:40.291435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:40.291435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:40.291435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:40.292329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:40.292329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:40.292329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:40.292329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:40.292329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:40.292329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:40.292329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:40.292329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:40.292329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:40.292329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:40.292329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:40.292329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:40.292329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:40.292329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:40.292329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:40.292329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:40.292329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:40.293277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:40.293277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:40.293277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:40.293277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:40.293277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 369/732] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:40.293957 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb56a58-a5e3-41bf-bb04-74e296a452fd None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:40.294283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb56a58-a5e3-41bf-bb04-74e296a452fd None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:40.294582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb56a58-a5e3-41bf-bb04-74e296a452fd None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:40.300025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 370/733] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:40.300025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f82f5-7a51-4591-83ef-fdb05123c94c None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:40.300025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f82f5-7a51-4591-83ef-fdb05123c94c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:40.300025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f82f5-7a51-4591-83ef-fdb05123c94c None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:40.300025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 371/734] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:40.300025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f82f5-7a51-4591-83ef-fdb05123c94c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:40.350951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 364/735] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 03:15:40.352883 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c324a-f0b0-4e6a-9a9f-cd59d030e8f1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:40.353872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c324a-f0b0-4e6a-9a9f-cd59d030e8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:40.354461 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c324a-f0b0-4e6a-9a9f-cd59d030e8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:40.372565 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-161c324a-f0b0-4e6a-9a9f-cd59d030e8f1 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:40.373672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-161c324a-f0b0-4e6a-9a9f-cd59d030e8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:40.392394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:40.401583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:40.407831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f82f5-7a51-4591-83ef-fdb05123c94c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:40.439681 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 365/736] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:40.440049 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c310eba-9872-45e9-bf50-c30157392b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:40.440774 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c310eba-9872-45e9-bf50-c30157392b7c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:40.441075 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c310eba-9872-45e9-bf50-c30157392b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:40.441187 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5da9c-097f-4035-b75b-4acbe40c1186 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:40.441355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c310eba-9872-45e9-bf50-c30157392b7c None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:40.441450 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5da9c-097f-4035-b75b-4acbe40c1186 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:40.441625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5da9c-097f-4035-b75b-4acbe40c1186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:40.442081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c310eba-9872-45e9-bf50-c30157392b7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:40.442385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c310eba-9872-45e9-bf50-c30157392b7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:40.443762 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c310eba-9872-45e9-bf50-c30157392b7c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:40.458268 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-58d5da9c-097f-4035-b75b-4acbe40c1186 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:40.459205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-58d5da9c-097f-4035-b75b-4acbe40c1186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:40.463650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 372/737] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:40.464490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c310eba-9872-45e9-bf50-c30157392b7c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:40.524822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 366/738] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:40.526145 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039475d-5b0e-43bf-af2d-a541f4fc124e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:40.526436 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039475d-5b0e-43bf-af2d-a541f4fc124e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:40.526710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039475d-5b0e-43bf-af2d-a541f4fc124e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:40.528290 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 367/739] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:40.529094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039475d-5b0e-43bf-af2d-a541f4fc124e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:40.564915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c310eba-9872-45e9-bf50-c30157392b7c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:40.598232 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f0cd0-c6be-4682-a11b-14317d107032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:40.599022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f0cd0-c6be-4682-a11b-14317d107032 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:40.599303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f0cd0-c6be-4682-a11b-14317d107032 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:40.599573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f0cd0-c6be-4682-a11b-14317d107032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:40.609408 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f0cd0-c6be-4682-a11b-14317d107032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:40.610854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f0cd0-c6be-4682-a11b-14317d107032 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:40.617520 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:40.629190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-fe2f0cd0-c6be-4682-a11b-14317d107032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:40.629190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:40.629190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:40.629190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:40.629190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:40.629190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:40.629190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:40.629190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:40.629190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:40.629190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:40.629190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:40.629190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:40.629190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:40.629190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:40.629190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:40.630113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:40.630113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:40.630113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:40.630113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:40.630113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:40.630113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:40.630113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:40.630113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:40.630113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:40.630113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:40.630113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:40.630113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:40.630113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:40.630113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:40.630113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:40.630113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:40.630113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:40.631011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:40.631011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:40.631011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:40.631011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:40.631011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 373/740] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:40.631293 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f0cd0-c6be-4682-a11b-14317d107032 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:40.636164 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:40.643885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039475d-5b0e-43bf-af2d-a541f4fc124e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:40.677890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcbae7-db57-4917-9aef-7da73eb3ffb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:40.678701 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcbae7-db57-4917-9aef-7da73eb3ffb7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:40.679050 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcbae7-db57-4917-9aef-7da73eb3ffb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:40.679243 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcbae7-db57-4917-9aef-7da73eb3ffb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:40.689972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcbae7-db57-4917-9aef-7da73eb3ffb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:40.697538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-68fcbae7-db57-4917-9aef-7da73eb3ffb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:15:40.697538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:40.697538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:40.697538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:40.697538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:40.697538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:40.697538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:40.697538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:40.697538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:40.697538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:40.697538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:40.697538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:40.697538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:40.697538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:40.697538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:40.697538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:40.698452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:40.698452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:40.698452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:40.698452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:40.698452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:40.698452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:40.698452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:40.698452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:40.698452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:40.698452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:40.698452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:40.698452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:40.698452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:40.698452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:40.698452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:40.698452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:40.699337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:40.699337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:40.699337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:40.699337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:40.699337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:40.699337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:40.699337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:40.699337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:40.699337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:40.699337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:40.699337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:15:40.699337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:40.703854 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 368/741] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:15:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:40.705460 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab15ed-1b15-4cdf-95cd-b8f18ef3a9a6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:40.705460 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab15ed-1b15-4cdf-95cd-b8f18ef3a9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:40.705629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab15ed-1b15-4cdf-95cd-b8f18ef3a9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:40.722781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-46ab15ed-1b15-4cdf-95cd-b8f18ef3a9a6 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:40.723937 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-46ab15ed-1b15-4cdf-95cd-b8f18ef3a9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:40.733044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f0cd0-c6be-4682-a11b-14317d107032 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:40.768046 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c93110-a125-4ded-bb51-5f9673cfbc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:40.768884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c93110-a125-4ded-bb51-5f9673cfbc63 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:40.769157 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c93110-a125-4ded-bb51-5f9673cfbc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:40.769421 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c93110-a125-4ded-bb51-5f9673cfbc63 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:40.776656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c93110-a125-4ded-bb51-5f9673cfbc63 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:40.778221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c93110-a125-4ded-bb51-5f9673cfbc63 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:40.789153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 369/742] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 03:15:40.789943 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab15ed-1b15-4cdf-95cd-b8f18ef3a9a6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:40.793766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-64c93110-a125-4ded-bb51-5f9673cfbc63 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 03:15:40.793766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:40.793766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:40.793766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:40.793766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:40.793766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:40.793766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:40.793766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:40.793766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:40.793766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:40.793766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:40.793766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:40.793766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:40.793766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:40.793766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:40.793766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:40.794696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:40.795638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:40.795638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:40.795638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:40.795638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:40.795638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:40.795638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:40.795638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:40.795638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:40.795638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 03:15:40.795638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:40.795638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 374/743] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 03:15:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:40.796219 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c93110-a125-4ded-bb51-5f9673cfbc63 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:40.863273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:40.874142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:40.889403 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab15ed-1b15-4cdf-95cd-b8f18ef3a9a6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:40.905905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c93110-a125-4ded-bb51-5f9673cfbc63 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:40.921993 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5d3fd-d3dc-4c67-8a52-34ef1c684f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:40.922630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5d3fd-d3dc-4c67-8a52-34ef1c684f30 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:40.922910 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5d3fd-d3dc-4c67-8a52-34ef1c684f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:40.923186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5d3fd-d3dc-4c67-8a52-34ef1c684f30 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:40.923908 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5d3fd-d3dc-4c67-8a52-34ef1c684f30 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:40.925324 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5d3fd-d3dc-4c67-8a52-34ef1c684f30 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:40.940450 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 370/744] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 03:15:40 2022] POST /identity/v3/services => generated 251 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:15:40.941279 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5d3fd-d3dc-4c67-8a52-34ef1c684f30 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:40.954949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03934de0-cfeb-48b7-a51d-4485741f9ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:40.955303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03934de0-cfeb-48b7-a51d-4485741f9ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:40.955580 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03934de0-cfeb-48b7-a51d-4485741f9ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:40.955846 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03934de0-cfeb-48b7-a51d-4485741f9ee0 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:40.956645 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03934de0-cfeb-48b7-a51d-4485741f9ee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:40.956950 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03934de0-cfeb-48b7-a51d-4485741f9ee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:40.958373 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03934de0-cfeb-48b7-a51d-4485741f9ee0 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:40.972828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 375/745] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:40.973605 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03934de0-cfeb-48b7-a51d-4485741f9ee0 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:41.074489 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5d3fd-d3dc-4c67-8a52-34ef1c684f30 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:41.093014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03934de0-cfeb-48b7-a51d-4485741f9ee0 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:41.111049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bf7c1-6968-4aa4-a5ee-450e78404905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:41.111724 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bf7c1-6968-4aa4-a5ee-450e78404905 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:41.112009 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bf7c1-6968-4aa4-a5ee-450e78404905 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:41.112291 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bf7c1-6968-4aa4-a5ee-450e78404905 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:41.112870 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:41.113126 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bf7c1-6968-4aa4-a5ee-450e78404905 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:41.113433 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bf7c1-6968-4aa4-a5ee-450e78404905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:41.114903 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bf7c1-6968-4aa4-a5ee-450e78404905 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:41.124154 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 371/746] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:41.124962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bf7c1-6968-4aa4-a5ee-450e78404905 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:41.140379 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80c54e-d832-4351-8ab8-93165fc72693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:41.141314 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80c54e-d832-4351-8ab8-93165fc72693 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:41.141758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80c54e-d832-4351-8ab8-93165fc72693 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:41.142032 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80c54e-d832-4351-8ab8-93165fc72693 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:41.142994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80c54e-d832-4351-8ab8-93165fc72693 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:41.143332 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80c54e-d832-4351-8ab8-93165fc72693 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:41.145062 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80c54e-d832-4351-8ab8-93165fc72693 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:41.145635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:41.164501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 376/747] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Jul 12 03:15:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:41.165393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80c54e-d832-4351-8ab8-93165fc72693 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:41.237320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bf7c1-6968-4aa4-a5ee-450e78404905 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:41.269263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80c54e-d832-4351-8ab8-93165fc72693 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:41.270954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2fad2-109c-4dd4-bafc-46b0a63a7c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:41.271877 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2fad2-109c-4dd4-bafc-46b0a63a7c18 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:41.272229 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2fad2-109c-4dd4-bafc-46b0a63a7c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:41.272505 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2fad2-109c-4dd4-bafc-46b0a63a7c18 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:41.273254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2fad2-109c-4dd4-bafc-46b0a63a7c18 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:41.274629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2fad2-109c-4dd4-bafc-46b0a63a7c18 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:41.300556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 372/748] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 03:15:41 2022] POST /identity/v3/services => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:15:41.300556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2fad2-109c-4dd4-bafc-46b0a63a7c18 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:41.324570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6034da-d6fe-4765-b2c6-b5ffa98bc05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:41.325805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6034da-d6fe-4765-b2c6-b5ffa98bc05b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:41.326196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6034da-d6fe-4765-b2c6-b5ffa98bc05b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:41.326745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6034da-d6fe-4765-b2c6-b5ffa98bc05b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:41.335431 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6034da-d6fe-4765-b2c6-b5ffa98bc05b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:41.337187 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6034da-d6fe-4765-b2c6-b5ffa98bc05b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:41.354570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-9a6034da-d6fe-4765-b2c6-b5ffa98bc05b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:41.354570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:41.354570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:41.354570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:41.354570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:41.354570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:41.354570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:41.354570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:41.354570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:41.354570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:41.354570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:41.354570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:41.354570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:41.354570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:41.354570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:41.355547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:41.355547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:41.355547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:41.355547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:41.355547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:41.355547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:41.355547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:41.355547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:41.355547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:41.355547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:41.355547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:41.355547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:41.355547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:41.355547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:41.355547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:41.355547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:41.355547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:41.356919 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:41.356919 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:41.356919 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:41.356919 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:41.356919 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:41.356919 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:41.356919 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:41.356919 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:41.361343 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 377/749] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:41.362707 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6034da-d6fe-4765-b2c6-b5ffa98bc05b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:41.388005 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:41.402556 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:41.439622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2fad2-109c-4dd4-bafc-46b0a63a7c18 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:41.497734 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33deca-2b19-49c7-b002-0f19ed8e4861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:41.498354 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6034da-d6fe-4765-b2c6-b5ffa98bc05b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:41.498547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33deca-2b19-49c7-b002-0f19ed8e4861 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:41.498832 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33deca-2b19-49c7-b002-0f19ed8e4861 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:41.499104 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33deca-2b19-49c7-b002-0f19ed8e4861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:41.513490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33deca-2b19-49c7-b002-0f19ed8e4861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:41.514990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33deca-2b19-49c7-b002-0f19ed8e4861 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:41.533134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4d33deca-2b19-49c7-b002-0f19ed8e4861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:41.533134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:41.533134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:41.533134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:41.533134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:41.533134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:41.533134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:41.533134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:41.533134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:41.533134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:41.533134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:41.533134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:41.533134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:41.533134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:41.533134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:41.534065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:41.534065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:41.534065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:41.534065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:41.534065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:41.534065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:41.534065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:41.534065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:41.534065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:41.534065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:41.534065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:41.534065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:41.534065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:41.534065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:41.534065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:41.534065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:41.534065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:41.534948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:41.534948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:41.534948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:41.534948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:41.534948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 373/750] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:41.535224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33deca-2b19-49c7-b002-0f19ed8e4861 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:41.550719 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99465875-ac0f-404c-826a-3d7fdf8d4ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:41.551766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99465875-ac0f-404c-826a-3d7fdf8d4ebd None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:41.552054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99465875-ac0f-404c-826a-3d7fdf8d4ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:41.552330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99465875-ac0f-404c-826a-3d7fdf8d4ebd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:41.645336 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99465875-ac0f-404c-826a-3d7fdf8d4ebd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:41.646793 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99465875-ac0f-404c-826a-3d7fdf8d4ebd None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:41.650407 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33deca-2b19-49c7-b002-0f19ed8e4861 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:41.672957 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:41.685949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:41.691725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497774d0-fce9-4e1f-b55e-ab1f56c2599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:41.692395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497774d0-fce9-4e1f-b55e-ab1f56c2599b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:41.692704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497774d0-fce9-4e1f-b55e-ab1f56c2599b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:41.692974 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497774d0-fce9-4e1f-b55e-ab1f56c2599b None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:41.693777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497774d0-fce9-4e1f-b55e-ab1f56c2599b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:41.694087 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497774d0-fce9-4e1f-b55e-ab1f56c2599b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:41.695653 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497774d0-fce9-4e1f-b55e-ab1f56c2599b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:41.711073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 374/751] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:41.712066 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497774d0-fce9-4e1f-b55e-ab1f56c2599b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:41.775761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 378/752] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 03:15:41.776782 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99465875-ac0f-404c-826a-3d7fdf8d4ebd None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:41.817221 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497774d0-fce9-4e1f-b55e-ab1f56c2599b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:41.855386 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf4ba6-3516-44e8-9eac-dcb9b6033bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:41.856154 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf4ba6-3516-44e8-9eac-dcb9b6033bbd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:41.857161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf4ba6-3516-44e8-9eac-dcb9b6033bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:41.857440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf4ba6-3516-44e8-9eac-dcb9b6033bbd None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:41.858187 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf4ba6-3516-44e8-9eac-dcb9b6033bbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:41.858493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf4ba6-3516-44e8-9eac-dcb9b6033bbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:41.859949 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf4ba6-3516-44e8-9eac-dcb9b6033bbd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:41.876645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 375/753] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:41.877556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf4ba6-3516-44e8-9eac-dcb9b6033bbd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:41.888014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99465875-ac0f-404c-826a-3d7fdf8d4ebd None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:41.916638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:41.931569 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029183c-325f-4deb-8e52-e4bae1bd3dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:41.932592 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029183c-325f-4deb-8e52-e4bae1bd3dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:41.933605 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029183c-325f-4deb-8e52-e4bae1bd3dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:41.934132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029183c-325f-4deb-8e52-e4bae1bd3dd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:41.935191 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029183c-325f-4deb-8e52-e4bae1bd3dd6 None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=ffc4cbd87dd249868cfb704535774126) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:41.935996 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:41.936896 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029183c-325f-4deb-8e52-e4bae1bd3dd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:41.939960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029183c-325f-4deb-8e52-e4bae1bd3dd6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:41.947561 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 379/754] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:15:41 2022] GET /identity/v3/role_assignments?user.id=ffc4cbd87dd249868cfb704535774126&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:41.948715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029183c-325f-4deb-8e52-e4bae1bd3dd6 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:42.041713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf4ba6-3516-44e8-9eac-dcb9b6033bbd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:42.058926 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029183c-325f-4deb-8e52-e4bae1bd3dd6 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:42.097881 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4658c-2d3c-4921-9125-6cdcb351c62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:42.099097 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4658c-2d3c-4921-9125-6cdcb351c62a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:42.099581 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4658c-2d3c-4921-9125-6cdcb351c62a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:42.100055 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4658c-2d3c-4921-9125-6cdcb351c62a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:42.106255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b3776-746e-4943-be47-e715aab3fed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:42.107073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b3776-746e-4943-be47-e715aab3fed2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:42.107358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b3776-746e-4943-be47-e715aab3fed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:42.107634 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b3776-746e-4943-be47-e715aab3fed2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:42.111049 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4658c-2d3c-4921-9125-6cdcb351c62a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:42.112989 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4658c-2d3c-4921-9125-6cdcb351c62a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:42.128467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-9ec4658c-2d3c-4921-9125-6cdcb351c62a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:15:42.128467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:42.128467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:42.128467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:42.128467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:42.128467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:42.128467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:42.128467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:42.128467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:42.128467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:42.128467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:42.128467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:42.128467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:42.128467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:42.128467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:42.128467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:42.129487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:42.130412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:42.130412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:42.130412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:42.130412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:42.130412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:42.130412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:42.130412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:42.130412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:42.130412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:15:42.130412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:42.131592 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b3776-746e-4943-be47-e715aab3fed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:42.133122 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b3776-746e-4943-be47-e715aab3fed2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:42.133602 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 380/755] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 03:15:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:42.140571 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4658c-2d3c-4921-9125-6cdcb351c62a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:42.169454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-299b3776-746e-4943-be47-e715aab3fed2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:42.169454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:42.169454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:42.169454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:42.169454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:42.169454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:42.169454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:42.169454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:42.169454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:42.169454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:42.169454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:42.169454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:42.169454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:42.169454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:42.169454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:42.170559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:42.170559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:42.170559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:42.170559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:42.170559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:42.170559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:42.170559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:42.170559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:42.170559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:42.170559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:42.170559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:42.170559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:42.170559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:42.170559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:42.170559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:42.170559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:42.170559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:42.171666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:42.171666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:42.171666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:42.171666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:42.173568 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 376/756] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:42.179185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b3776-746e-4943-be47-e715aab3fed2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:42.277607 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:42.285092 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:42.288800 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b3776-746e-4943-be47-e715aab3fed2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:42.325413 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed7ea1-f6a6-403c-941a-f8dbd3e4039f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:42.326334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7ea1-f6a6-403c-941a-f8dbd3e4039f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:42.326827 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7ea1-f6a6-403c-941a-f8dbd3e4039f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:42.327516 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7ea1-f6a6-403c-941a-f8dbd3e4039f None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:42.328490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed7ea1-f6a6-403c-941a-f8dbd3e4039f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:42.331087 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed7ea1-f6a6-403c-941a-f8dbd3e4039f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:42.331087 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed7ea1-f6a6-403c-941a-f8dbd3e4039f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:42.344071 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 377/757] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:42.349949 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed7ea1-f6a6-403c-941a-f8dbd3e4039f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:42.418700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4658c-2d3c-4921-9125-6cdcb351c62a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:42.454583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed7ea1-f6a6-403c-941a-f8dbd3e4039f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:42.490527 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b29047-c13a-4786-9fce-8b1d236e7e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:42.491604 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b29047-c13a-4786-9fce-8b1d236e7e1c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:42.492034 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b29047-c13a-4786-9fce-8b1d236e7e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:42.492579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b29047-c13a-4786-9fce-8b1d236e7e1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:42.500893 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b29047-c13a-4786-9fce-8b1d236e7e1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:42.502659 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b29047-c13a-4786-9fce-8b1d236e7e1c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:42.512880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa4879-3466-417a-9dbf-a4d8356d480e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:42.513540 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa4879-3466-417a-9dbf-a4d8356d480e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:42.513823 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa4879-3466-417a-9dbf-a4d8356d480e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:42.514099 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa4879-3466-417a-9dbf-a4d8356d480e None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:42.514944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa4879-3466-417a-9dbf-a4d8356d480e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:42.515249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa4879-3466-417a-9dbf-a4d8356d480e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:42.516712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa4879-3466-417a-9dbf-a4d8356d480e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:42.518519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-39b29047-c13a-4786-9fce-8b1d236e7e1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:42.518519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:42.518519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:42.518519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:42.518519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:42.518519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:42.518519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:42.518519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:42.518519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:42.518519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:42.518519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:42.518519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:42.518519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:42.518519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:42.518519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:42.519587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:42.519587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:42.519587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:42.519587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:42.519587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:42.519587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:42.519587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:42.519587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:42.519587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:42.519587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:42.519587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:42.519587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:42.519587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:42.519587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:42.519587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:42.519587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:42.519587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:42.520729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:42.520729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:42.520729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:42.520729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:42.520729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:42.520729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:42.520729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:42.520729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:42.522912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 378/758] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:42.529050 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b29047-c13a-4786-9fce-8b1d236e7e1c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:42.545346 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:42.548182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 381/759] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 03:15:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:42.553879 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa4879-3466-417a-9dbf-a4d8356d480e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:42.639261 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b29047-c13a-4786-9fce-8b1d236e7e1c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:42.675990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1064796-3c49-49db-8699-9f0ecfabb3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:42.677005 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1064796-3c49-49db-8699-9f0ecfabb3ed None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:42.677502 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1064796-3c49-49db-8699-9f0ecfabb3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:42.677958 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1064796-3c49-49db-8699-9f0ecfabb3ed None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:42.678963 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1064796-3c49-49db-8699-9f0ecfabb3ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:42.679467 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1064796-3c49-49db-8699-9f0ecfabb3ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:42.681235 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1064796-3c49-49db-8699-9f0ecfabb3ed None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:42.695596 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 379/760] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:42.701929 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1064796-3c49-49db-8699-9f0ecfabb3ed None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:42.729339 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa4879-3466-417a-9dbf-a4d8356d480e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:42.760927 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:42.769804 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43e7cb-3e90-4e65-ab2a-f439120260d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:42.770629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43e7cb-3e90-4e65-ab2a-f439120260d0 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:42.770931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43e7cb-3e90-4e65-ab2a-f439120260d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:42.771187 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43e7cb-3e90-4e65-ab2a-f439120260d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:42.778493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:42.782761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e43e7cb-3e90-4e65-ab2a-f439120260d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:42.784451 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e43e7cb-3e90-4e65-ab2a-f439120260d0 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:42.805432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7e43e7cb-3e90-4e65-ab2a-f439120260d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:42.805432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:42.805432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:42.805432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:42.805432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:42.805432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:42.805432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:42.805432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:42.805432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:42.805432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:42.805432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:42.805432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:42.805432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:42.805432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:42.805432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:42.806392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:42.806392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:42.806392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:42.806392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:42.806392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:42.806392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:42.806392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:42.806392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:42.806392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:42.806392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:42.806392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:42.806392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:42.806392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:42.806392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:42.806392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:42.806392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:42.806392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:42.807291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:42.807291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:42.807291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:42.807291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:42.814446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 382/761] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:42.815972 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43e7cb-3e90-4e65-ab2a-f439120260d0 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:42.842782 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1064796-3c49-49db-8699-9f0ecfabb3ed None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:42.904174 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdb465-e660-4549-b907-a07e140a3bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:42.904917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdb465-e660-4549-b907-a07e140a3bff None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:42.905149 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdb465-e660-4549-b907-a07e140a3bff None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:42.905424 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdb465-e660-4549-b907-a07e140a3bff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:42.906269 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdb465-e660-4549-b907-a07e140a3bff None admin] RBAC: Adding query filter params (role.id=8a9636f0fea542a19f6fcaf54b9c1d11, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=e23aea853cce44698b19d6bc087093c1) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:42.906577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdb465-e660-4549-b907-a07e140a3bff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:42.908018 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdb465-e660-4549-b907-a07e140a3bff None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:42.922029 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43e7cb-3e90-4e65-ab2a-f439120260d0 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:42.923629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 380/762] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:15:42 2022] GET /identity/v3/role_assignments?user.id=e23aea853cce44698b19d6bc087093c1&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=8a9636f0fea542a19f6fcaf54b9c1d11 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:42.960895 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5fadc-ee8e-4a82-8632-238b30b27ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:42.961883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5fadc-ee8e-4a82-8632-238b30b27ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:42.962344 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5fadc-ee8e-4a82-8632-238b30b27ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:42.962795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5fadc-ee8e-4a82-8632-238b30b27ed1 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:42.963747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5fadc-ee8e-4a82-8632-238b30b27ed1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:42.964228 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5fadc-ee8e-4a82-8632-238b30b27ed1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:42.966515 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5fadc-ee8e-4a82-8632-238b30b27ed1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:42.984657 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 383/763] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:42.986440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdb465-e660-4549-b907-a07e140a3bff None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:43.117045 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdb465-e660-4549-b907-a07e140a3bff None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:43.164174 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d8c8a-276d-432a-89b9-73cd2a0c167e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:43.165295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d8c8a-276d-432a-89b9-73cd2a0c167e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:43.165749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d8c8a-276d-432a-89b9-73cd2a0c167e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:43.166190 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d8c8a-276d-432a-89b9-73cd2a0c167e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:43.170176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:43.175022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d8c8a-276d-432a-89b9-73cd2a0c167e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:43.176725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d8c8a-276d-432a-89b9-73cd2a0c167e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:43.191944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-6f0d8c8a-276d-432a-89b9-73cd2a0c167e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:43.191944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:43.191944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:43.191944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:43.191944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:43.191944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:43.191944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:43.191944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:43.191944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:43.191944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:43.191944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:43.191944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:43.191944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:43.191944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:43.191944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:43.192940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:43.192940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:43.192940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:43.192940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:43.192940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:43.192940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:43.192940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:43.192940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:43.192940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:43.192940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:43.192940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:43.192940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:43.192940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:43.192940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:43.192940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:43.192940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:43.192940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:43.193815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:43.193815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:43.193815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:43.193815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:43.193815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:43.193815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:43.193815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:43.193815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:43.200721 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 381/764] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:43.203002 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5fadc-ee8e-4a82-8632-238b30b27ed1 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:43.232912 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:43.310819 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5fadc-ee8e-4a82-8632-238b30b27ed1 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:43.346854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673525e8-c15f-49ec-8a04-25cf963b773e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:43.347772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673525e8-c15f-49ec-8a04-25cf963b773e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:43.348196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673525e8-c15f-49ec-8a04-25cf963b773e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:43.348640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673525e8-c15f-49ec-8a04-25cf963b773e None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:43.349608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673525e8-c15f-49ec-8a04-25cf963b773e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:43.350057 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673525e8-c15f-49ec-8a04-25cf963b773e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:43.351636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673525e8-c15f-49ec-8a04-25cf963b773e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:43.358796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dccc11-f031-4bb3-93d6-b6eb18f73b87 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:43.359282 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dccc11-f031-4bb3-93d6-b6eb18f73b87 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:43.359803 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dccc11-f031-4bb3-93d6-b6eb18f73b87 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:43.361339 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 382/765] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:15:43.376031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59786e-1abc-4bca-9469-8b49627baf27 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:43.376550 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59786e-1abc-4bca-9469-8b49627baf27 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:43.376971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59786e-1abc-4bca-9469-8b49627baf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:43.378904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 384/766] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:43.386360 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673525e8-c15f-49ec-8a04-25cf963b773e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:43.406249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4b59786e-1abc-4bca-9469-8b49627baf27 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:43.409667 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4b59786e-1abc-4bca-9469-8b49627baf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:43.488904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 383/767] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:15:43.518851 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59786e-1abc-4bca-9469-8b49627baf27 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:43.558309 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:43.594766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673525e8-c15f-49ec-8a04-25cf963b773e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:43.665903 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ac172-ea2e-4c01-9405-f7e13f63bf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:43.667281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ac172-ea2e-4c01-9405-f7e13f63bf68 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:43.667871 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ac172-ea2e-4c01-9405-f7e13f63bf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:43.670462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ac172-ea2e-4c01-9405-f7e13f63bf68 None admin] PATH_INFO: `/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/0c43d9d0a6264b19a843077a4669ce70/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:43.674288 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ac172-ea2e-4c01-9405-f7e13f63bf68 None admin] RBAC: Authorizing `identity:create_grant(project_id=afd5f89a049d40dc8456bd351f01f603, user_id=0c43d9d0a6264b19a843077a4669ce70, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:43.675926 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ac172-ea2e-4c01-9405-f7e13f63bf68 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:43.710246 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59786e-1abc-4bca-9469-8b49627baf27 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:43.714273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 385/768] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:15:43 2022] PUT /identity/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/0c43d9d0a6264b19a843077a4669ce70/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:15:43.764765 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:43.769745 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518aed14-88c7-48bb-a690-1c1d47c4740b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:43.771036 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aed14-88c7-48bb-a690-1c1d47c4740b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:43.771484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aed14-88c7-48bb-a690-1c1d47c4740b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:43.771916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aed14-88c7-48bb-a690-1c1d47c4740b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:43.772835 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518aed14-88c7-48bb-a690-1c1d47c4740b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:43.774535 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518aed14-88c7-48bb-a690-1c1d47c4740b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:43.799390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-518aed14-88c7-48bb-a690-1c1d47c4740b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 03:15:43.799390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:43.799390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:15:43.799390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:15:43.799390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:15:43.799390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:15:43.799390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:15:43.799390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:43.799390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 03:15:43.799390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:43.799390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:15:43.799390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:43.799390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:43.799390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:43.799390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:43.799390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:43.800395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:43.800395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:43.800395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:43.800395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:43.800395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:43.800395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:43.800395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:43.800395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:15:43.800395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:15:43.800395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:15:43.800395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:15:43.800395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:43.800395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:43.800395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:43.800395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:43.800395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:43.801242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:43.801242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:43.801242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:43.801242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:43.801242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:43.801242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:43.801242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:43.801242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:43.801242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:43.801242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:43.801242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:43.801242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:15:43.801242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:43.801242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 03:15:43.801242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:43.801242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 384/769] 10.222.0.26 () {56 vars in 1129 bytes} [Tue Jul 12 03:15:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:43.808438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ac172-ea2e-4c01-9405-f7e13f63bf68 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:43.833995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32635a46-cde1-4d29-93de-06d3e41e0617 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:43.834281 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32635a46-cde1-4d29-93de-06d3e41e0617 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:43.834563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32635a46-cde1-4d29-93de-06d3e41e0617 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:43.840547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 385/770] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:43.841728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d4f50-8de7-4a20-a4ab-7d0deec3ea7d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:43.842020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d4f50-8de7-4a20-a4ab-7d0deec3ea7d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:43.842303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d4f50-8de7-4a20-a4ab-7d0deec3ea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:43.867083 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8f0d4f50-8de7-4a20-a4ab-7d0deec3ea7d None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:43.868022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8f0d4f50-8de7-4a20-a4ab-7d0deec3ea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:43.975718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ac172-ea2e-4c01-9405-f7e13f63bf68 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:43.999912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 386/771] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 03:15:44.025510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d4f50-8de7-4a20-a4ab-7d0deec3ea7d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:44.033190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014804a8-cde4-4f73-b0a1-459f2c7e8824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:44.033520 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014804a8-cde4-4f73-b0a1-459f2c7e8824 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:44.033801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014804a8-cde4-4f73-b0a1-459f2c7e8824 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:44.034071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014804a8-cde4-4f73-b0a1-459f2c7e8824 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:44.034786 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014804a8-cde4-4f73-b0a1-459f2c7e8824 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:44.035088 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014804a8-cde4-4f73-b0a1-459f2c7e8824 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:44.037061 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014804a8-cde4-4f73-b0a1-459f2c7e8824 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:44.047374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 386/772] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Jul 12 03:15:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:44.049377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014804a8-cde4-4f73-b0a1-459f2c7e8824 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:44.061669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:44.203827 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d4f50-8de7-4a20-a4ab-7d0deec3ea7d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:44.225839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:44.233276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014804a8-cde4-4f73-b0a1-459f2c7e8824 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:44.242543 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5125893-9ef4-4aa6-9ecf-091612d59b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:44.243370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5125893-9ef4-4aa6-9ecf-091612d59b5e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:44.243652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5125893-9ef4-4aa6-9ecf-091612d59b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:44.243931 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5125893-9ef4-4aa6-9ecf-091612d59b5e None admin] PATH_INFO: `/v3/services/network` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:44.244645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5125893-9ef4-4aa6-9ecf-091612d59b5e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:44.246097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5125893-9ef4-4aa6-9ecf-091612d59b5e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:44.258839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a5125893-9ef4-4aa6-9ecf-091612d59b5e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 03:15:44.258839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:44.258839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:15:44.258839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:15:44.258839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:15:44.258839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:15:44.258839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:15:44.258839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:44.258839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 03:15:44.258839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:44.258839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:15:44.258839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:44.258839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:44.258839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:44.258839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:44.258839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:44.258839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:44.259868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:44.259868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:44.259868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:44.259868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:44.259868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:44.259868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:44.259868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:15:44.259868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:15:44.259868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:15:44.259868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:15:44.259868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:44.259868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:44.259868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:44.259868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:44.259868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:44.259868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:44.260730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:44.260730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:44.260730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:44.260730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:44.260730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:44.260730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:44.260730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:44.260730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:44.260730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:44.260730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:44.260730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:15:44.260730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:44.260730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 03:15:44.260730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:44.260730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 387/773] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:44 2022] GET /identity/v3/services/network => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:44.266227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5125893-9ef4-4aa6-9ecf-091612d59b5e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:44.323639 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364a977-4ddc-46a8-b637-014a1a08c756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:44.324860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a977-4ddc-46a8-b637-014a1a08c756 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:44.325394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a977-4ddc-46a8-b637-014a1a08c756 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:44.325881 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a977-4ddc-46a8-b637-014a1a08c756 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:44.326802 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364a977-4ddc-46a8-b637-014a1a08c756 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:44.327297 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364a977-4ddc-46a8-b637-014a1a08c756 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:44.328895 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364a977-4ddc-46a8-b637-014a1a08c756 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:44.340333 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 387/774] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Jul 12 03:15:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:44.346569 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364a977-4ddc-46a8-b637-014a1a08c756 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:44.373404 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5125893-9ef4-4aa6-9ecf-091612d59b5e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:44.412025 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82e1d4-a741-4ad9-9d9c-8b3b9fcc49f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:44.412748 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82e1d4-a741-4ad9-9d9c-8b3b9fcc49f9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:44.413028 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82e1d4-a741-4ad9-9d9c-8b3b9fcc49f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:44.413301 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82e1d4-a741-4ad9-9d9c-8b3b9fcc49f9 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:44.414024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82e1d4-a741-4ad9-9d9c-8b3b9fcc49f9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:44.414329 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82e1d4-a741-4ad9-9d9c-8b3b9fcc49f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:44.415838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82e1d4-a741-4ad9-9d9c-8b3b9fcc49f9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:44.421266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 388/775] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 03:15:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:44.422608 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8539541-29dd-436b-a081-7bf3045a88a3 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:44.422895 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8539541-29dd-436b-a081-7bf3045a88a3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:44.423172 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8539541-29dd-436b-a081-7bf3045a88a3 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:44.428925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 389/776] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:44.434317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8539541-29dd-436b-a081-7bf3045a88a3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:44.439498 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:44.474378 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364a977-4ddc-46a8-b637-014a1a08c756 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:44.490185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:44.511972 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0692d8-a3b9-4c8e-96a1-d8d0e1b2516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:44.513622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0692d8-a3b9-4c8e-96a1-d8d0e1b2516d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:44.514101 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0692d8-a3b9-4c8e-96a1-d8d0e1b2516d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:44.514613 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0692d8-a3b9-4c8e-96a1-d8d0e1b2516d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:44.515607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0692d8-a3b9-4c8e-96a1-d8d0e1b2516d None admin] RBAC: Adding query filter params (interface=public, service_id=ea1e2e3ba9f044f98c39b3cdcb43c548, region_id=RegionOne) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:44.516131 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0692d8-a3b9-4c8e-96a1-d8d0e1b2516d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:44.517744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0692d8-a3b9-4c8e-96a1-d8d0e1b2516d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:44.526049 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 388/777] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Jul 12 03:15:44 2022] GET /identity/v3/endpoints?service_id=ea1e2e3ba9f044f98c39b3cdcb43c548&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:44.527681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ed701-cdb1-428b-8e56-f931fae98d23 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:44.528770 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ed701-cdb1-428b-8e56-f931fae98d23 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:44.529255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ed701-cdb1-428b-8e56-f931fae98d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:44.547725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8539541-29dd-436b-a081-7bf3045a88a3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:44.548304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-384ed701-cdb1-428b-8e56-f931fae98d23 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:44.549759 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-384ed701-cdb1-428b-8e56-f931fae98d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:44.584014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b8171-f673-48ff-91d1-fd51bbdccaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:44.584796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b8171-f673-48ff-91d1-fd51bbdccaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:44.585094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b8171-f673-48ff-91d1-fd51bbdccaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:44.586701 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b8171-f673-48ff-91d1-fd51bbdccaa8 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:44.587570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b8171-f673-48ff-91d1-fd51bbdccaa8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:44.587883 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b8171-f673-48ff-91d1-fd51bbdccaa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:44.589464 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b8171-f673-48ff-91d1-fd51bbdccaa8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:44.600322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 390/778] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 03:15:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:44.601354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b8171-f673-48ff-91d1-fd51bbdccaa8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:44.628625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 389/779] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:15:44.629832 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ed701-cdb1-428b-8e56-f931fae98d23 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:44.711026 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b8171-f673-48ff-91d1-fd51bbdccaa8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:44.714314 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:44.727813 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:44.752788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97aa76-bfdc-40f5-af22-1f65f17db706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:44.753288 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97aa76-bfdc-40f5-af22-1f65f17db706 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:44.753570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97aa76-bfdc-40f5-af22-1f65f17db706 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:44.753844 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97aa76-bfdc-40f5-af22-1f65f17db706 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:44.754573 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97aa76-bfdc-40f5-af22-1f65f17db706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:44.755916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97aa76-bfdc-40f5-af22-1f65f17db706 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:44.756836 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ed701-cdb1-428b-8e56-f931fae98d23 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:44.763364 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 391/780] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 03:15:44 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:44.763364 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97aa76-bfdc-40f5-af22-1f65f17db706 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:44.798543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e3462-e371-4b70-a528-9c0e39e205f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:44.799473 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e3462-e371-4b70-a528-9c0e39e205f8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:44.799896 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e3462-e371-4b70-a528-9c0e39e205f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:44.800313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e3462-e371-4b70-a528-9c0e39e205f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:44.801410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e3462-e371-4b70-a528-9c0e39e205f8 None admin] RBAC: Adding query filter params (interface=public, service_id=75e8015b5d054e74b393f451a3108010, region_id=RegionOne) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:44.801919 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e3462-e371-4b70-a528-9c0e39e205f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:44.803484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e3462-e371-4b70-a528-9c0e39e205f8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:44.814514 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 390/781] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Jul 12 03:15:44 2022] GET /identity/v3/endpoints?service_id=75e8015b5d054e74b393f451a3108010&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:44.816228 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e3462-e371-4b70-a528-9c0e39e205f8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:44.880367 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97aa76-bfdc-40f5-af22-1f65f17db706 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:44.918579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83492de-ae3e-4df0-86a9-2fc10dff465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:44.919381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83492de-ae3e-4df0-86a9-2fc10dff465a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:44.919666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83492de-ae3e-4df0-86a9-2fc10dff465a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:44.919941 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83492de-ae3e-4df0-86a9-2fc10dff465a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:44.926838 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e3462-e371-4b70-a528-9c0e39e205f8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:44.932553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83492de-ae3e-4df0-86a9-2fc10dff465a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:44.941073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a83492de-ae3e-4df0-86a9-2fc10dff465a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:15:44.941073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:44.941073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:44.941073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:44.941073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:44.941073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:44.941073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:44.941073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:44.941073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:44.941073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:44.941073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:44.941073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:44.941073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:44.941073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:44.941073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:44.941073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:44.942051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:44.942051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:44.942051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:44.942051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:44.942051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:44.942051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:44.942051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:44.942051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:44.942051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:44.942051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:44.942051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:44.942051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:44.942051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:44.942051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:44.942051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:44.942051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:44.943278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:44.943278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:44.943278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:44.943278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:44.943278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:44.943278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:44.943278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:44.943278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:44.943278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:44.943278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:44.943278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:15:44.943278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:44.943278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 392/782] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:15:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:44.948556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83492de-ae3e-4df0-86a9-2fc10dff465a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:44.961824 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:44.970697 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da84399-fc3e-4b69-ac45-1304535beb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:44.971815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da84399-fc3e-4b69-ac45-1304535beb36 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:44.972216 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da84399-fc3e-4b69-ac45-1304535beb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:44.972621 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da84399-fc3e-4b69-ac45-1304535beb36 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:44.973407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da84399-fc3e-4b69-ac45-1304535beb36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:44.974877 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da84399-fc3e-4b69-ac45-1304535beb36 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:44.984905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 391/783] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 03:15:44 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:44.991701 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:45.073203 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83492de-ae3e-4df0-86a9-2fc10dff465a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:45.116688 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c49697-c683-4637-8fbe-73e41c902b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:45.117639 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c49697-c683-4637-8fbe-73e41c902b82 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:45.118070 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c49697-c683-4637-8fbe-73e41c902b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:45.118494 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c49697-c683-4637-8fbe-73e41c902b82 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:45.119434 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c49697-c683-4637-8fbe-73e41c902b82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:45.119908 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c49697-c683-4637-8fbe-73e41c902b82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:45.121531 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c49697-c683-4637-8fbe-73e41c902b82 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:45.132918 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 393/784] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:45.140546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da84399-fc3e-4b69-ac45-1304535beb36 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:45.201659 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888c6d8-4285-41d4-99c5-c2738b10b089 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:45.201941 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888c6d8-4285-41d4-99c5-c2738b10b089 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:45.202223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888c6d8-4285-41d4-99c5-c2738b10b089 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:45.203990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 394/785] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:15:45.209165 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492be8cf-f8c8-4aab-ad76-0945d6828f2c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:45.209451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492be8cf-f8c8-4aab-ad76-0945d6828f2c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:45.209729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492be8cf-f8c8-4aab-ad76-0945d6828f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:45.228058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-492be8cf-f8c8-4aab-ad76-0945d6828f2c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:45.229163 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-492be8cf-f8c8-4aab-ad76-0945d6828f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:45.269317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da84399-fc3e-4b69-ac45-1304535beb36 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:45.303651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394522a3-c887-4fd5-a21c-f305ce0436a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:45.304456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394522a3-c887-4fd5-a21c-f305ce0436a6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:45.304794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394522a3-c887-4fd5-a21c-f305ce0436a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:45.305079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394522a3-c887-4fd5-a21c-f305ce0436a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:45.312015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 395/786] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:15:45.327714 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394522a3-c887-4fd5-a21c-f305ce0436a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:45.329303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394522a3-c887-4fd5-a21c-f305ce0436a6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:45.354800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-394522a3-c887-4fd5-a21c-f305ce0436a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:45.354800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:45.354800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:45.354800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:45.354800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:45.354800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:45.354800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:45.354800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:45.354800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:45.354800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:45.354800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:45.354800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:45.354800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:45.354800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:45.354800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:45.355791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:45.355791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:45.355791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:45.355791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:45.355791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:45.355791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:45.355791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:45.355791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:45.355791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:45.355791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:45.355791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:45.355791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:45.355791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:45.355791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:45.355791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:45.355791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:45.355791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:45.356804 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:45.356804 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:45.356804 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:45.356804 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:45.356804 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 392/787] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:45.362203 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492be8cf-f8c8-4aab-ad76-0945d6828f2c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:45.383658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394522a3-c887-4fd5-a21c-f305ce0436a6 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:45.418079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:45.460014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:45.519940 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394522a3-c887-4fd5-a21c-f305ce0436a6 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:45.558777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d766c16-17da-4cf9-b8d2-43368590b771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:45.559645 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d766c16-17da-4cf9-b8d2-43368590b771 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:45.559930 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d766c16-17da-4cf9-b8d2-43368590b771 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:45.560211 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d766c16-17da-4cf9-b8d2-43368590b771 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:45.571853 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d766c16-17da-4cf9-b8d2-43368590b771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:45.581772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-3d766c16-17da-4cf9-b8d2-43368590b771 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:45.581772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:45.581772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:45.581772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:45.581772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:45.581772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:45.581772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:45.581772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:45.581772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:45.581772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:45.581772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:45.581772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:45.581772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:45.581772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:45.581772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:45.581772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:45.582734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:45.582734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:45.582734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:45.582734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:45.582734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:45.582734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:45.582734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:45.582734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:45.582734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:45.582734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:45.582734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:45.582734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:45.582734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:45.582734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:45.582734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:45.582734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:45.583579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:45.583579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:45.583579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:45.583579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:45.583579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:45.583579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:45.583579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:45.583579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:45.583579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:45.583579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:45.583579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:45.583579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:45.583579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 393/788] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:45.584817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492be8cf-f8c8-4aab-ad76-0945d6828f2c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:45.590933 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d766c16-17da-4cf9-b8d2-43368590b771 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:45.651144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76312b4d-311b-493e-a9e3-6a2b123a2e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:45.651815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76312b4d-311b-493e-a9e3-6a2b123a2e35 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:45.652092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76312b4d-311b-493e-a9e3-6a2b123a2e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:45.652363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76312b4d-311b-493e-a9e3-6a2b123a2e35 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:45.653184 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76312b4d-311b-493e-a9e3-6a2b123a2e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:45.653543 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76312b4d-311b-493e-a9e3-6a2b123a2e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:45.654924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76312b4d-311b-493e-a9e3-6a2b123a2e35 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:45.678535 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 396/789] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:45.685068 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76312b4d-311b-493e-a9e3-6a2b123a2e35 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:45.744868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d766c16-17da-4cf9-b8d2-43368590b771 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:45.752919 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:45.812596 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae1f95-7647-48bf-8f3e-9590eed044ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:45.813740 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae1f95-7647-48bf-8f3e-9590eed044ab None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:45.814225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae1f95-7647-48bf-8f3e-9590eed044ab None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:45.814697 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae1f95-7647-48bf-8f3e-9590eed044ab None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:45.816117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae1f95-7647-48bf-8f3e-9590eed044ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:45.816694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae1f95-7647-48bf-8f3e-9590eed044ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:45.816870 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:45.818464 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae1f95-7647-48bf-8f3e-9590eed044ab None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:45.828946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 394/790] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:45.839311 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae1f95-7647-48bf-8f3e-9590eed044ab None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:45.846413 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76312b4d-311b-493e-a9e3-6a2b123a2e35 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:45.895236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59f019-f5af-4008-b1df-5739c69daefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:45.896046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59f019-f5af-4008-b1df-5739c69daefb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:45.896317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59f019-f5af-4008-b1df-5739c69daefb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:45.896682 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59f019-f5af-4008-b1df-5739c69daefb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:45.917770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59f019-f5af-4008-b1df-5739c69daefb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:45.919703 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59f019-f5af-4008-b1df-5739c69daefb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:45.938798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4c59f019-f5af-4008-b1df-5739c69daefb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 03:15:45.938798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:45.938798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:45.938798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:45.938798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:45.938798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:45.938798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:45.938798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:45.938798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:45.938798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:45.938798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:45.938798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:45.938798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:45.938798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:45.938798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:45.938798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:45.939790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:45.940770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:45.940770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:45.940770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:45.940770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:45.940770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:45.940770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:45.940770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:45.940770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:45.940770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 03:15:45.940770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:45.940770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 397/791] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:15:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:45.949070 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59f019-f5af-4008-b1df-5739c69daefb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:46.032472 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae1f95-7647-48bf-8f3e-9590eed044ab None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:46.097230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b5b35-18f9-4da5-be98-0eea42e7d4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:46.097949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b5b35-18f9-4da5-be98-0eea42e7d4ab None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:46.098220 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b5b35-18f9-4da5-be98-0eea42e7d4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:46.098489 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b5b35-18f9-4da5-be98-0eea42e7d4ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:46.120022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b5b35-18f9-4da5-be98-0eea42e7d4ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:46.122711 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b5b35-18f9-4da5-be98-0eea42e7d4ab None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:46.127433 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59f019-f5af-4008-b1df-5739c69daefb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:46.155681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-cc2b5b35-18f9-4da5-be98-0eea42e7d4ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:46.155681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:46.155681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:46.155681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:46.155681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:46.155681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:46.155681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:46.155681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:46.155681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:46.155681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:46.155681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:46.155681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:46.155681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:46.155681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:46.155681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:46.156676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:46.156676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:46.156676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:46.156676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:46.156676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:46.156676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:46.156676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:46.156676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:46.156676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:46.156676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:46.156676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:46.156676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:46.156676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:46.156676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:46.156676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:46.156676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:46.156676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:46.157557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:46.157557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:46.157557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:46.157557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:46.157557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 395/792] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:46.162595 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b5b35-18f9-4da5-be98-0eea42e7d4ab None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:46.194056 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5d549-8362-4939-9ea8-ce1b396d0e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:46.195863 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5d549-8362-4939-9ea8-ce1b396d0e6b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:46.196149 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5d549-8362-4939-9ea8-ce1b396d0e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:46.196419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5d549-8362-4939-9ea8-ce1b396d0e6b None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:46.197293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5d549-8362-4939-9ea8-ce1b396d0e6b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:46.197592 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5d549-8362-4939-9ea8-ce1b396d0e6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:46.199027 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5d549-8362-4939-9ea8-ce1b396d0e6b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:46.204172 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:46.229567 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 398/793] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Jul 12 03:15:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:46.238248 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5d549-8362-4939-9ea8-ce1b396d0e6b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:46.248743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:46.299681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b5b35-18f9-4da5-be98-0eea42e7d4ab None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:46.340214 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203f12a-2e92-405e-8535-909d28126ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:46.341010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203f12a-2e92-405e-8535-909d28126ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:46.341418 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203f12a-2e92-405e-8535-909d28126ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:46.341695 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203f12a-2e92-405e-8535-909d28126ea4 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:46.342467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203f12a-2e92-405e-8535-909d28126ea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:46.342774 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203f12a-2e92-405e-8535-909d28126ea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:46.344576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203f12a-2e92-405e-8535-909d28126ea4 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:46.357103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5d549-8362-4939-9ea8-ce1b396d0e6b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:46.359370 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 396/794] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:46.360868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43007753-8693-47ac-be4a-369cccc731ae None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:46.361160 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43007753-8693-47ac-be4a-369cccc731ae None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:46.361432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43007753-8693-47ac-be4a-369cccc731ae None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:46.362923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 397/795] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:46.364587 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43007753-8693-47ac-be4a-369cccc731ae None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:46.405073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9b209-8cc8-46a3-80fa-67a886ec9876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:46.405875 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9b209-8cc8-46a3-80fa-67a886ec9876 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:46.406153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9b209-8cc8-46a3-80fa-67a886ec9876 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:46.406419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9b209-8cc8-46a3-80fa-67a886ec9876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:46.423789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9b209-8cc8-46a3-80fa-67a886ec9876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:46.426246 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9b209-8cc8-46a3-80fa-67a886ec9876 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:46.451139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-04e9b209-8cc8-46a3-80fa-67a886ec9876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:46.451139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:46.451139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:46.451139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:46.451139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:46.451139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:46.451139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:46.451139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:46.451139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:46.451139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:46.451139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:46.451139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:46.451139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:46.451139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:46.451139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:46.452055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:46.452055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:46.452055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:46.452055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:46.452055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:46.452055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:46.452055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:46.452055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:46.452055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:46.452055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:46.452055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:46.452055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:46.452055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:46.452055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:46.452055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:46.452055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:46.452055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:46.453017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:46.453017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:46.453017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:46.453017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:46.459106 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 399/796] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:46.459106 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430418a-f530-4c98-a6fe-d08740f2eabc None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:46.459106 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430418a-f530-4c98-a6fe-d08740f2eabc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:46.459106 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430418a-f530-4c98-a6fe-d08740f2eabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:46.460196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:46.480593 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e430418a-f530-4c98-a6fe-d08740f2eabc None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:46.482093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e430418a-f530-4c98-a6fe-d08740f2eabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:46.486004 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43007753-8693-47ac-be4a-369cccc731ae None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:46.524495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4188281-50b8-42c5-a7a9-22bb281f2a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:46.525734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4188281-50b8-42c5-a7a9-22bb281f2a48 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:46.526216 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4188281-50b8-42c5-a7a9-22bb281f2a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:46.526704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4188281-50b8-42c5-a7a9-22bb281f2a48 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:46.534412 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:46.535722 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4188281-50b8-42c5-a7a9-22bb281f2a48 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:46.537700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4188281-50b8-42c5-a7a9-22bb281f2a48 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:46.553554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-a4188281-50b8-42c5-a7a9-22bb281f2a48 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 03:15:46.553554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:46.553554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:46.553554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:46.553554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:46.553554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:46.553554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:46.553554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:46.553554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:46.553554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:46.553554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:46.553554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:46.553554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:46.553554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:46.553554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:46.553554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:46.554544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:46.555478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:46.555478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:46.555478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:46.555478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:46.555478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:46.555478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:46.555478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:46.555478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:46.555478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 03:15:46.555478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:46.556667 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 400/797] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:15:46.557529 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430418a-f530-4c98-a6fe-d08740f2eabc None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:46.558506 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 398/798] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 03:15:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:46.564450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4188281-50b8-42c5-a7a9-22bb281f2a48 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:46.668638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4188281-50b8-42c5-a7a9-22bb281f2a48 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:46.671567 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430418a-f530-4c98-a6fe-d08740f2eabc None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:46.707283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb4865-a772-41c0-a290-cca1fc9dfd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:46.708205 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb4865-a772-41c0-a290-cca1fc9dfd40 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:46.708728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb4865-a772-41c0-a290-cca1fc9dfd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:46.709203 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb4865-a772-41c0-a290-cca1fc9dfd40 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:46.710264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb4865-a772-41c0-a290-cca1fc9dfd40 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:46.710784 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb4865-a772-41c0-a290-cca1fc9dfd40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:46.712432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb4865-a772-41c0-a290-cca1fc9dfd40 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:46.717319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b71ecc-108e-4df4-9d9c-c809eb2e0d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:46.718039 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71ecc-108e-4df4-9d9c-c809eb2e0d36 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:46.718318 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71ecc-108e-4df4-9d9c-c809eb2e0d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:46.718588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71ecc-108e-4df4-9d9c-c809eb2e0d36 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:46.719320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b71ecc-108e-4df4-9d9c-c809eb2e0d36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:46.719621 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b71ecc-108e-4df4-9d9c-c809eb2e0d36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:46.721391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b71ecc-108e-4df4-9d9c-c809eb2e0d36 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:46.723755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:46.738165 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 401/799] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:46.738165 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b71ecc-108e-4df4-9d9c-c809eb2e0d36 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:46.740190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 399/800] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Jul 12 03:15:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:46.743199 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb4865-a772-41c0-a290-cca1fc9dfd40 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:46.814377 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:46.861405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb4865-a772-41c0-a290-cca1fc9dfd40 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:46.882734 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b71ecc-108e-4df4-9d9c-c809eb2e0d36 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:46.904105 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2921e-5a10-4b98-a7e2-e92fbc9ebb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:46.904953 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2921e-5a10-4b98-a7e2-e92fbc9ebb49 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:46.905260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2921e-5a10-4b98-a7e2-e92fbc9ebb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:46.905956 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2921e-5a10-4b98-a7e2-e92fbc9ebb49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:46.914969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2921e-5a10-4b98-a7e2-e92fbc9ebb49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:46.916960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2921e-5a10-4b98-a7e2-e92fbc9ebb49 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:46.920416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e7279-34ba-408a-aa6e-57321478ae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:46.921505 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e7279-34ba-408a-aa6e-57321478ae71 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:46.921990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e7279-34ba-408a-aa6e-57321478ae71 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:46.922463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e7279-34ba-408a-aa6e-57321478ae71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:46.932374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-84a2921e-5a10-4b98-a7e2-e92fbc9ebb49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:46.932374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:46.932374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:46.932374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:46.932374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:46.932374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:46.932374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:46.932374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:46.932374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:46.932374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:46.932374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:46.932374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:46.932374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:46.932374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:46.932374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:46.933320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:46.933320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:46.933320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:46.933320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:46.933320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:46.933320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:46.933320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:46.933320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:46.933320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:46.933320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:46.933320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:46.933320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:46.933320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:46.933320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:46.933320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:46.933320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:46.933320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:46.934321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:46.934321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:46.934321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:46.934321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:46.934321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:46.934321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:46.934321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:46.934321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:46.936607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 400/801] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:46.937637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2921e-5a10-4b98-a7e2-e92fbc9ebb49 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:46.940844 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e7279-34ba-408a-aa6e-57321478ae71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:46.950902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-240e7279-34ba-408a-aa6e-57321478ae71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:15:46.950902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:46.950902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:46.950902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:46.950902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:46.950902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:46.950902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:46.950902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:46.950902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:46.950902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:46.950902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:46.950902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:46.950902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:46.950902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:46.950902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:46.950902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:46.951898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:46.951898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:46.951898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:46.951898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:46.951898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:46.951898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:46.951898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:46.951898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:46.951898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:46.951898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:46.951898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:46.951898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:46.951898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:46.951898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:46.951898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:46.951898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:46.952777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:46.952777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:46.952777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:46.952777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:46.952777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:46.952777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:46.952777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:46.952777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:46.952777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:46.952777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:46.952777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:15:46.952777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:46.956600 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 402/802] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:15:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:46.957650 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e7279-34ba-408a-aa6e-57321478ae71 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:47.012955 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:47.063266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2921e-5a10-4b98-a7e2-e92fbc9ebb49 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:47.095618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e7279-34ba-408a-aa6e-57321478ae71 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:47.102658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fe16a-a21e-46e0-984d-8d9f6b163148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:47.103791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fe16a-a21e-46e0-984d-8d9f6b163148 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:47.104294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fe16a-a21e-46e0-984d-8d9f6b163148 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:47.104827 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fe16a-a21e-46e0-984d-8d9f6b163148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:47.106124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:47.118755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fe16a-a21e-46e0-984d-8d9f6b163148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:47.120718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fe16a-a21e-46e0-984d-8d9f6b163148 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:47.135229 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00ceb7-24b9-4398-a707-ab20dff0bcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:47.135887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00ceb7-24b9-4398-a707-ab20dff0bcd8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:47.136169 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00ceb7-24b9-4398-a707-ab20dff0bcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:47.136440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00ceb7-24b9-4398-a707-ab20dff0bcd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:47.137391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00ceb7-24b9-4398-a707-ab20dff0bcd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:47.137696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00ceb7-24b9-4398-a707-ab20dff0bcd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:47.139135 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00ceb7-24b9-4398-a707-ab20dff0bcd8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:47.142712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-954fe16a-a21e-46e0-984d-8d9f6b163148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:47.142712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:47.142712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:47.142712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:47.142712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:47.142712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:47.142712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:47.142712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:47.142712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:47.142712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:47.142712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:47.142712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:47.142712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:47.142712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:47.142712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:47.143565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:47.143565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:47.143565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:47.143565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:47.143565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:47.143565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:47.143565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:47.143565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:47.143565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:47.143565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:47.143565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:47.143565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:47.143565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:47.143565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:47.143565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:47.143565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:47.143565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:47.144452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:47.144452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:47.144452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:47.144452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:47.151261 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 401/803] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:47.152537 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fe16a-a21e-46e0-984d-8d9f6b163148 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:47.156622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 403/804] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:47.158531 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00ceb7-24b9-4398-a707-ab20dff0bcd8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:47.263571 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fe16a-a21e-46e0-984d-8d9f6b163148 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:47.274965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:47.288266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00ceb7-24b9-4398-a707-ab20dff0bcd8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:47.301483 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6b281-285e-4dd1-bb6a-fa30e50b9ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:47.302308 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6b281-285e-4dd1-bb6a-fa30e50b9ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:47.302959 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6b281-285e-4dd1-bb6a-fa30e50b9ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:47.303239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6b281-285e-4dd1-bb6a-fa30e50b9ce3 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:47.303991 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6b281-285e-4dd1-bb6a-fa30e50b9ce3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:47.304295 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6b281-285e-4dd1-bb6a-fa30e50b9ce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:47.305721 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6b281-285e-4dd1-bb6a-fa30e50b9ce3 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:47.318855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 402/805] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:47.318855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6b281-285e-4dd1-bb6a-fa30e50b9ce3 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:47.328199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92c01a-4e45-42c3-a2f5-9e486495a923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:47.329190 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92c01a-4e45-42c3-a2f5-9e486495a923 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:47.329514 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92c01a-4e45-42c3-a2f5-9e486495a923 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:47.329903 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92c01a-4e45-42c3-a2f5-9e486495a923 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:47.330820 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92c01a-4e45-42c3-a2f5-9e486495a923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:47.331129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92c01a-4e45-42c3-a2f5-9e486495a923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:47.332510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92c01a-4e45-42c3-a2f5-9e486495a923 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:47.343707 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 404/806] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:47.345096 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869ae5-f275-4369-a34a-3b99e79a301c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:47.345387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869ae5-f275-4369-a34a-3b99e79a301c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:47.345665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869ae5-f275-4369-a34a-3b99e79a301c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:47.347204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 405/807] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:47.348283 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197cd3a-c13e-4689-9450-2267a07e0f6c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:47.348556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197cd3a-c13e-4689-9450-2267a07e0f6c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:47.348951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197cd3a-c13e-4689-9450-2267a07e0f6c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:47.350023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 406/808] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:47.350702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197cd3a-c13e-4689-9450-2267a07e0f6c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:47.379899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:47.424921 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6b281-285e-4dd1-bb6a-fa30e50b9ce3 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:47.453407 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197cd3a-c13e-4689-9450-2267a07e0f6c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:47.457920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de1e7b-f281-4b23-b52d-b59712d8e5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:47.458803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de1e7b-f281-4b23-b52d-b59712d8e5da None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:47.459079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de1e7b-f281-4b23-b52d-b59712d8e5da None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:47.459343 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de1e7b-f281-4b23-b52d-b59712d8e5da None admin] PATH_INFO: `/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/ffc4cbd87dd249868cfb704535774126/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:47.461332 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de1e7b-f281-4b23-b52d-b59712d8e5da None admin] RBAC: Authorizing `identity:create_grant(project_id=afd5f89a049d40dc8456bd351f01f603, user_id=ffc4cbd87dd249868cfb704535774126, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:47.462746 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de1e7b-f281-4b23-b52d-b59712d8e5da None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:47.476760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 403/809] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:15:47 2022] PUT /identity/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/ffc4cbd87dd249868cfb704535774126/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:15:47.477733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de1e7b-f281-4b23-b52d-b59712d8e5da None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:47.488798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfc40c-9d4d-4128-806b-a4a1ae42464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:47.489639 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc40c-9d4d-4128-806b-a4a1ae42464c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:47.489904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc40c-9d4d-4128-806b-a4a1ae42464c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:47.490178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc40c-9d4d-4128-806b-a4a1ae42464c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:47.502773 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfc40c-9d4d-4128-806b-a4a1ae42464c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:47.504259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfc40c-9d4d-4128-806b-a4a1ae42464c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:47.523992 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:47.526124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-79bfc40c-9d4d-4128-806b-a4a1ae42464c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:47.526124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:47.526124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:47.526124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:47.526124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:47.526124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:47.526124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:47.526124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:47.526124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:47.526124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:47.526124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:47.526124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:47.526124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:47.526124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:47.526124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:47.527293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:47.527293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:47.527293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:47.527293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:47.527293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:47.527293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:47.527293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:47.527293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:47.527293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:47.527293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:47.527293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:47.527293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:47.527293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:47.527293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:47.527293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:47.527293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:47.527293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:47.528496 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:47.528496 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:47.528496 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:47.528496 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:47.532660 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 407/810] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:47.534249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902de1ac-35a0-4928-a98b-bc738e6d3ffe None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:47.534706 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902de1ac-35a0-4928-a98b-bc738e6d3ffe None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:47.534989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902de1ac-35a0-4928-a98b-bc738e6d3ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:47.552420 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-902de1ac-35a0-4928-a98b-bc738e6d3ffe None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:47.553687 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-902de1ac-35a0-4928-a98b-bc738e6d3ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:47.610896 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de1e7b-f281-4b23-b52d-b59712d8e5da None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:47.645038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 408/811] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:15:47.646394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778eeafe-4b8c-424b-895f-f0ea3330835b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:47.646637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778eeafe-4b8c-424b-895f-f0ea3330835b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:47.646914 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778eeafe-4b8c-424b-895f-f0ea3330835b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:47.652820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15f669-18ce-4725-9f6c-cef8d82864bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:47.653625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15f669-18ce-4725-9f6c-cef8d82864bf None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:47.653918 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15f669-18ce-4725-9f6c-cef8d82864bf None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:47.654177 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15f669-18ce-4725-9f6c-cef8d82864bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:47.661100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15f669-18ce-4725-9f6c-cef8d82864bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:47.662538 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15f669-18ce-4725-9f6c-cef8d82864bf None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:47.664527 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-778eeafe-4b8c-424b-895f-f0ea3330835b None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:47.666015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-778eeafe-4b8c-424b-895f-f0ea3330835b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:47.669233 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:47.679733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-fa15f669-18ce-4725-9f6c-cef8d82864bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:47.679733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:47.679733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:47.679733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:47.679733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:47.679733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:47.679733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:47.679733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:47.679733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:47.679733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:47.679733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:47.679733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:47.679733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:47.679733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:47.679733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:47.680705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:47.680705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:47.680705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:47.680705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:47.680705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:47.680705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:47.680705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:47.680705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:47.680705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:47.680705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:47.680705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:47.680705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:47.680705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:47.680705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:47.680705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:47.680705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:47.680705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:47.685535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:47.685535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:47.685535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:47.685535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:47.685535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:47.685535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:47.685535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:47.685535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:47.685535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 404/812] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:47.685535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15f669-18ce-4725-9f6c-cef8d82864bf None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:47.744473 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 409/813] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:15:47.745585 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778eeafe-4b8c-424b-895f-f0ea3330835b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:47.785793 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:47.797493 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15f669-18ce-4725-9f6c-cef8d82864bf None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:47.832178 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e191a-1079-4393-8b12-612243bb4e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:47.832909 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e191a-1079-4393-8b12-612243bb4e05 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:47.833195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e191a-1079-4393-8b12-612243bb4e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:47.833472 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e191a-1079-4393-8b12-612243bb4e05 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:47.834200 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e191a-1079-4393-8b12-612243bb4e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:47.834506 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e191a-1079-4393-8b12-612243bb4e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:47.835886 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e191a-1079-4393-8b12-612243bb4e05 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:47.848775 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 405/814] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:47.849507 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e191a-1079-4393-8b12-612243bb4e05 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:47.867437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778eeafe-4b8c-424b-895f-f0ea3330835b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:47.903683 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b196ac-eacb-4573-90b8-5d6ca976bc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:47.904499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b196ac-eacb-4573-90b8-5d6ca976bc2f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:47.904797 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b196ac-eacb-4573-90b8-5d6ca976bc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:47.905063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b196ac-eacb-4573-90b8-5d6ca976bc2f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:47.905716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b196ac-eacb-4573-90b8-5d6ca976bc2f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:47.907110 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b196ac-eacb-4573-90b8-5d6ca976bc2f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:47.919747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-28b196ac-eacb-4573-90b8-5d6ca976bc2f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 03:15:47.919747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:47.919747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:15:47.919747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:15:47.919747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:15:47.919747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:15:47.919747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:15:47.919747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:47.919747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 03:15:47.919747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:47.919747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:15:47.919747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:47.919747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:47.919747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:47.919747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:47.919747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:47.920712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:47.920712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:47.920712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:47.920712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:47.920712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:47.920712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:47.920712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:47.920712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:15:47.920712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:15:47.920712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:15:47.920712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:15:47.920712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:47.920712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:47.920712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:47.920712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:47.920712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:47.921537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:47.921537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:47.921537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:47.921537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:47.921537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:47.921537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:47.921537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:47.921537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:47.921537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:47.921537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:47.921537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:47.921537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:15:47.921537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:47.921537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 03:15:47.921537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:47.921537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 410/815] 10.222.0.26 () {56 vars in 1129 bytes} [Tue Jul 12 03:15:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:47.922350 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b196ac-eacb-4573-90b8-5d6ca976bc2f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:47.926765 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:47.962819 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e191a-1079-4393-8b12-612243bb4e05 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:47.998090 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23e52e-41f7-46f5-bc97-4a2bde20f45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:47.998754 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23e52e-41f7-46f5-bc97-4a2bde20f45b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:47.999134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23e52e-41f7-46f5-bc97-4a2bde20f45b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:47.999406 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23e52e-41f7-46f5-bc97-4a2bde20f45b None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:48.000349 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23e52e-41f7-46f5-bc97-4a2bde20f45b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:48.000640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23e52e-41f7-46f5-bc97-4a2bde20f45b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:48.002071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23e52e-41f7-46f5-bc97-4a2bde20f45b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:48.016129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 406/816] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:48.021766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23e52e-41f7-46f5-bc97-4a2bde20f45b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:48.033999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b196ac-eacb-4573-90b8-5d6ca976bc2f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:48.034831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:48.071834 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613595d-1237-4e69-a09b-7f860aeaf0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:48.072658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613595d-1237-4e69-a09b-7f860aeaf0dd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:48.072952 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613595d-1237-4e69-a09b-7f860aeaf0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:48.073190 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613595d-1237-4e69-a09b-7f860aeaf0dd None admin] PATH_INFO: `/v3/services/network` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:48.073846 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613595d-1237-4e69-a09b-7f860aeaf0dd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:48.075609 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613595d-1237-4e69-a09b-7f860aeaf0dd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:48.087069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-0613595d-1237-4e69-a09b-7f860aeaf0dd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 03:15:48.087069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:48.087069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:15:48.087069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:15:48.087069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:15:48.087069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:15:48.087069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:15:48.087069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:48.087069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 03:15:48.087069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:48.087069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:15:48.087069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:48.087069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:48.087069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:48.087069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:48.087069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:48.087069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:48.088019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:48.088019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:48.088019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:48.088019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:48.088019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:48.088019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:48.088019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:15:48.088019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:15:48.088019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:15:48.088019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:15:48.088019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:48.088019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:48.088019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:48.088019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:48.088019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:48.088019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:48.089587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:48.089587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:48.089587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:48.089587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:48.089587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:48.089587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:48.089587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:48.089587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:48.089587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:48.089587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:48.089587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:15:48.089587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:48.089587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 03:15:48.089587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:48.089587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 411/817] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:47 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:48.090414 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613595d-1237-4e69-a09b-7f860aeaf0dd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:48.133332 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23e52e-41f7-46f5-bc97-4a2bde20f45b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:48.159230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:48.173126 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e1deb-b2b6-48c8-a689-422973e2aa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:48.173952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e1deb-b2b6-48c8-a689-422973e2aa3b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:48.174223 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e1deb-b2b6-48c8-a689-422973e2aa3b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:48.174487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e1deb-b2b6-48c8-a689-422973e2aa3b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:48.183239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e1deb-b2b6-48c8-a689-422973e2aa3b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:48.185454 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e1deb-b2b6-48c8-a689-422973e2aa3b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:48.194836 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613595d-1237-4e69-a09b-7f860aeaf0dd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:48.205011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-c69e1deb-b2b6-48c8-a689-422973e2aa3b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:15:48.205011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:48.205011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:48.205011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:48.205011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:48.205011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:48.205011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:48.205011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:48.205011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:48.205011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:48.205011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:48.205011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:48.205011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:48.205011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:48.205011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:48.205011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:48.206081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:48.206985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:48.206985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:48.206985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:48.206985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:48.206985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:48.206985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:48.206985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:48.206985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:48.206985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:15:48.206985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:48.208157 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 407/818] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 03:15:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:48.209005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e1deb-b2b6-48c8-a689-422973e2aa3b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:48.235416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b99dd-195b-481f-bba3-cd97ea7f7ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:48.236090 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b99dd-195b-481f-bba3-cd97ea7f7ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:48.236366 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b99dd-195b-481f-bba3-cd97ea7f7ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:48.236669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b99dd-195b-481f-bba3-cd97ea7f7ad0 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:48.237394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b99dd-195b-481f-bba3-cd97ea7f7ad0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:48.237701 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b99dd-195b-481f-bba3-cd97ea7f7ad0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:48.239098 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b99dd-195b-481f-bba3-cd97ea7f7ad0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:48.248745 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 412/819] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Jul 12 03:15:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:48.248745 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b99dd-195b-481f-bba3-cd97ea7f7ad0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:48.285797 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:48.320699 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e1deb-b2b6-48c8-a689-422973e2aa3b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:48.354861 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b99dd-195b-481f-bba3-cd97ea7f7ad0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:48.358784 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5acbc-f198-40a8-9d7f-ae9576719734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:48.359891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5acbc-f198-40a8-9d7f-ae9576719734 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:48.360355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5acbc-f198-40a8-9d7f-ae9576719734 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:48.360816 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5acbc-f198-40a8-9d7f-ae9576719734 None admin] PATH_INFO: `/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/e23aea853cce44698b19d6bc087093c1/roles/8a9636f0fea542a19f6fcaf54b9c1d11` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:48.381111 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5acbc-f198-40a8-9d7f-ae9576719734 None admin] RBAC: Authorizing `identity:create_grant(project_id=afd5f89a049d40dc8456bd351f01f603, user_id=e23aea853cce44698b19d6bc087093c1, role_id=8a9636f0fea542a19f6fcaf54b9c1d11)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:48.383286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5acbc-f198-40a8-9d7f-ae9576719734 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:48.384101 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:48.389812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdb1e7-618e-4e23-911d-6a501c3b1c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:48.390474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdb1e7-618e-4e23-911d-6a501c3b1c9c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:48.390751 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdb1e7-618e-4e23-911d-6a501c3b1c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:48.391024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdb1e7-618e-4e23-911d-6a501c3b1c9c None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:48.391762 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdb1e7-618e-4e23-911d-6a501c3b1c9c None admin] RBAC: Adding query filter params (name=network) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:48.392040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdb1e7-618e-4e23-911d-6a501c3b1c9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:48.393437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdb1e7-618e-4e23-911d-6a501c3b1c9c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:48.402660 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 413/820] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 03:15:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:48.402660 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdb1e7-618e-4e23-911d-6a501c3b1c9c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:48.406002 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 408/821] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:15:48 2022] PUT /identity/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/e23aea853cce44698b19d6bc087093c1/roles/8a9636f0fea542a19f6fcaf54b9c1d11 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:15:48.407032 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5acbc-f198-40a8-9d7f-ae9576719734 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:48.533051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdb1e7-618e-4e23-911d-6a501c3b1c9c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:48.556830 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5acbc-f198-40a8-9d7f-ae9576719734 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:48.581716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8a980-4f6e-4934-b128-3c1db9422258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:48.582550 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8a980-4f6e-4934-b128-3c1db9422258 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:48.582914 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8a980-4f6e-4934-b128-3c1db9422258 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:48.583604 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8a980-4f6e-4934-b128-3c1db9422258 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:48.584011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:48.584146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8a980-4f6e-4934-b128-3c1db9422258 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:48.584571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8a980-4f6e-4934-b128-3c1db9422258 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:48.585912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8a980-4f6e-4934-b128-3c1db9422258 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:48.608385 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 414/822] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 03:15:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:48.611783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8a980-4f6e-4934-b128-3c1db9422258 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:48.611924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715b406-790e-4b62-9dd6-267412075722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:48.611924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715b406-790e-4b62-9dd6-267412075722 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:48.611924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715b406-790e-4b62-9dd6-267412075722 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:48.611924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715b406-790e-4b62-9dd6-267412075722 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:48.612235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715b406-790e-4b62-9dd6-267412075722 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:48.612235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715b406-790e-4b62-9dd6-267412075722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:48.612889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715b406-790e-4b62-9dd6-267412075722 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:48.624603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 409/823] 10.222.0.26 () {56 vars in 1124 bytes} [Tue Jul 12 03:15:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:48.625318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715b406-790e-4b62-9dd6-267412075722 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:48.672663 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:48.721779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8a980-4f6e-4934-b128-3c1db9422258 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:48.730849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715b406-790e-4b62-9dd6-267412075722 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:48.758172 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f229e16-b6ff-4a45-a785-30e657312c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:48.759270 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f229e16-b6ff-4a45-a785-30e657312c96 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:48.759749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f229e16-b6ff-4a45-a785-30e657312c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:48.760219 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f229e16-b6ff-4a45-a785-30e657312c96 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:48.761198 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f229e16-b6ff-4a45-a785-30e657312c96 None admin] RBAC: Adding query filter params (type=network) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:48.761839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f229e16-b6ff-4a45-a785-30e657312c96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:48.764021 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f229e16-b6ff-4a45-a785-30e657312c96 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:48.770037 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 415/824] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 03:15:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:48.771178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f229e16-b6ff-4a45-a785-30e657312c96 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:48.771288 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceaa080-7d13-4d8c-a949-43b18f4baf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:48.771876 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaa080-7d13-4d8c-a949-43b18f4baf5e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:48.772153 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaa080-7d13-4d8c-a949-43b18f4baf5e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:48.772437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaa080-7d13-4d8c-a949-43b18f4baf5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:48.832983 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:48.849094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceaa080-7d13-4d8c-a949-43b18f4baf5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:48.850688 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceaa080-7d13-4d8c-a949-43b18f4baf5e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:48.880970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f229e16-b6ff-4a45-a785-30e657312c96 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:48.908622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:48.932653 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed3161-8b0f-4baa-830b-1d40e211ab83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:48.933486 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed3161-8b0f-4baa-830b-1d40e211ab83 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:48.933946 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed3161-8b0f-4baa-830b-1d40e211ab83 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:48.934460 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed3161-8b0f-4baa-830b-1d40e211ab83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:48.935406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed3161-8b0f-4baa-830b-1d40e211ab83 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:48.937786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed3161-8b0f-4baa-830b-1d40e211ab83 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:48.977043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 416/825] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 03:15:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:15:48.978098 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed3161-8b0f-4baa-830b-1d40e211ab83 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:48.983356 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 410/826] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 03:15:48.989676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceaa080-7d13-4d8c-a949-43b18f4baf5e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:49.157778 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed3161-8b0f-4baa-830b-1d40e211ab83 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:49.161542 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:49.200549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceaa080-7d13-4d8c-a949-43b18f4baf5e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:49.203977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d375352-87bc-4e61-9b0b-ba9ddffdd29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:49.205225 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d375352-87bc-4e61-9b0b-ba9ddffdd29f None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:49.205715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d375352-87bc-4e61-9b0b-ba9ddffdd29f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:49.206178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d375352-87bc-4e61-9b0b-ba9ddffdd29f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:49.207230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d375352-87bc-4e61-9b0b-ba9ddffdd29f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:49.209007 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d375352-87bc-4e61-9b0b-ba9ddffdd29f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:49.239613 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6a5ab-8eac-4a8b-89f2-44b448dcf2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:49.240538 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6a5ab-8eac-4a8b-89f2-44b448dcf2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:49.240763 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6a5ab-8eac-4a8b-89f2-44b448dcf2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:49.241086 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6a5ab-8eac-4a8b-89f2-44b448dcf2f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:49.241283 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 417/827] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 03:15:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:15:49.255406 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6a5ab-8eac-4a8b-89f2-44b448dcf2f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:49.256943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6a5ab-8eac-4a8b-89f2-44b448dcf2f3 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:49.276727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-f3e6a5ab-8eac-4a8b-89f2-44b448dcf2f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:49.276727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:49.276727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:49.276727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:49.276727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:49.276727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:49.276727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:49.276727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:49.276727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:49.276727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:49.276727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:49.276727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:49.276727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:49.276727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:49.276727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:49.277960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:49.277960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:49.277960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:49.277960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:49.277960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:49.277960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:49.277960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:49.277960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:49.277960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:49.277960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:49.277960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:49.277960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:49.277960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:49.277960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:49.277960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:49.277960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:49.277960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:49.278860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:49.278860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:49.278860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:49.278860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:49.278860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 411/828] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:49.283831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d375352-87bc-4e61-9b0b-ba9ddffdd29f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:49.321182 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:49.412858 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d375352-87bc-4e61-9b0b-ba9ddffdd29f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:49.454208 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c5a3f-be65-4684-9a92-345697bb6359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:49.454875 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c5a3f-be65-4684-9a92-345697bb6359 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:49.455157 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c5a3f-be65-4684-9a92-345697bb6359 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:49.455429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c5a3f-be65-4684-9a92-345697bb6359 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:49.456166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c5a3f-be65-4684-9a92-345697bb6359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:49.456470 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c5a3f-be65-4684-9a92-345697bb6359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:49.457934 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c5a3f-be65-4684-9a92-345697bb6359 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:49.472117 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 418/829] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:49.477154 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6a5ab-8eac-4a8b-89f2-44b448dcf2f3 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:49.588407 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2f74e-d17d-4aff-9435-def9b81d018e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:49.588760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2f74e-d17d-4aff-9435-def9b81d018e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:49.589031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2f74e-d17d-4aff-9435-def9b81d018e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:49.590652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 419/830] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:15:49.597814 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b0b24-d15f-4102-96b3-8d77006f16c6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:49.598105 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b0b24-d15f-4102-96b3-8d77006f16c6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:49.598359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b0b24-d15f-4102-96b3-8d77006f16c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:49.599298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6a5ab-8eac-4a8b-89f2-44b448dcf2f3 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:49.626698 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cd5b0b24-d15f-4102-96b3-8d77006f16c6 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:49.627873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cd5b0b24-d15f-4102-96b3-8d77006f16c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:49.638895 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5da71-b897-410a-9011-f11464cec341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:49.639699 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5da71-b897-410a-9011-f11464cec341 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:49.639979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5da71-b897-410a-9011-f11464cec341 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:49.640251 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5da71-b897-410a-9011-f11464cec341 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:49.644056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:49.651063 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5da71-b897-410a-9011-f11464cec341 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:49.653234 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5da71-b897-410a-9011-f11464cec341 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:49.670222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-9ea5da71-b897-410a-9011-f11464cec341 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:49.670222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:49.670222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:49.670222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:49.670222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:49.670222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:49.670222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:49.670222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:49.670222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:49.670222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:49.670222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:49.670222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:49.670222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:49.670222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:49.670222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:49.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:49.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:49.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:49.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:49.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:49.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:49.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:49.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:49.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:49.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:49.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:49.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:49.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:49.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:49.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:49.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:49.671147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:49.672045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:49.672045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:49.672045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:49.672045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:49.672045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:49.672045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:49.672045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:49.672045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:49.674455 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 412/831] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:49.683685 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5da71-b897-410a-9011-f11464cec341 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:49.727348 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 420/832] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:15:49.755763 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b0b24-d15f-4102-96b3-8d77006f16c6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:49.772191 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:49.800497 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5da71-b897-410a-9011-f11464cec341 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:49.836830 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5de53-3e39-45a6-a77e-9029180b7e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:49.837930 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5de53-3e39-45a6-a77e-9029180b7e48 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:49.838447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5de53-3e39-45a6-a77e-9029180b7e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:49.838907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5de53-3e39-45a6-a77e-9029180b7e48 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:49.839958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5de53-3e39-45a6-a77e-9029180b7e48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:49.840459 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5de53-3e39-45a6-a77e-9029180b7e48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:49.842198 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5de53-3e39-45a6-a77e-9029180b7e48 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:49.860659 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 413/833] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:49.861937 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5de53-3e39-45a6-a77e-9029180b7e48 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:49.874460 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b0b24-d15f-4102-96b3-8d77006f16c6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:49.910126 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475488f-c064-45b5-a472-6962c288cba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:49.910969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475488f-c064-45b5-a472-6962c288cba0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:49.911303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475488f-c064-45b5-a472-6962c288cba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:49.911604 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475488f-c064-45b5-a472-6962c288cba0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:49.922810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:49.923931 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475488f-c064-45b5-a472-6962c288cba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:49.931647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a475488f-c064-45b5-a472-6962c288cba0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:15:49.931647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:49.931647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:49.931647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:49.931647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:49.931647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:49.931647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:49.931647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:49.931647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:49.931647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:49.931647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:49.931647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:49.931647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:49.931647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:49.931647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:49.931647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:49.932605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:49.932605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:49.932605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:49.932605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:49.932605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:49.932605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:49.932605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:49.932605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:49.932605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:49.932605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:49.932605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:49.932605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:49.932605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:49.932605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:49.932605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:49.932605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:49.933439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:49.933439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:49.933439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:49.933439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:49.933439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:49.933439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:49.933439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:49.933439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:49.933439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:49.933439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:49.933439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:15:49.933439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:49.938723 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 421/834] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:15:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:49.940774 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475488f-c064-45b5-a472-6962c288cba0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:49.978483 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5de53-3e39-45a6-a77e-9029180b7e48 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:50.014551 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd0f25-582c-4450-9c20-ce9ea461a6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:50.015581 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd0f25-582c-4450-9c20-ce9ea461a6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:50.016058 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd0f25-582c-4450-9c20-ce9ea461a6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:50.016566 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd0f25-582c-4450-9c20-ce9ea461a6b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:50.017682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd0f25-582c-4450-9c20-ce9ea461a6b9 None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=0c43d9d0a6264b19a843077a4669ce70) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:50.018266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:50.019113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd0f25-582c-4450-9c20-ce9ea461a6b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:50.020761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd0f25-582c-4450-9c20-ce9ea461a6b9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:50.027482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 414/835] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:15:49 2022] GET /identity/v3/role_assignments?user.id=0c43d9d0a6264b19a843077a4669ce70&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:50.060632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475488f-c064-45b5-a472-6962c288cba0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:50.098458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59b92b-a6cf-4a95-97b7-6c3afee5a540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:50.099533 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59b92b-a6cf-4a95-97b7-6c3afee5a540 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:50.100010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59b92b-a6cf-4a95-97b7-6c3afee5a540 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:50.100503 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59b92b-a6cf-4a95-97b7-6c3afee5a540 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:50.101556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59b92b-a6cf-4a95-97b7-6c3afee5a540 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:50.102083 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59b92b-a6cf-4a95-97b7-6c3afee5a540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:50.103691 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59b92b-a6cf-4a95-97b7-6c3afee5a540 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:50.113766 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 422/836] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:15:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:50.122396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd0f25-582c-4450-9c20-ce9ea461a6b9 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:50.236260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd0f25-582c-4450-9c20-ce9ea461a6b9 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:50.257935 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:50.272363 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcc218-3477-4cf2-85fa-73179bd55ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:50.273282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcc218-3477-4cf2-85fa-73179bd55ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:50.273560 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcc218-3477-4cf2-85fa-73179bd55ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:50.273884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcc218-3477-4cf2-85fa-73179bd55ff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:50.286298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcc218-3477-4cf2-85fa-73179bd55ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:50.287759 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcc218-3477-4cf2-85fa-73179bd55ff6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:50.305242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d8fcc218-3477-4cf2-85fa-73179bd55ff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:50.305242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:50.305242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:50.305242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:50.305242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:50.305242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:50.305242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:50.305242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:50.305242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:50.305242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:50.305242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:50.305242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:50.305242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:50.305242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:50.305242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:50.306186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:50.306186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:50.306186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:50.306186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:50.306186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:50.306186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:50.306186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:50.306186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:50.306186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:50.306186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:50.306186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:50.306186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:50.306186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:50.306186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:50.306186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:50.306186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:50.306186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:50.307305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:50.307305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:50.307305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:50.307305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:50.307305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 415/837] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:50.314289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59b92b-a6cf-4a95-97b7-6c3afee5a540 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:50.427535 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59b92b-a6cf-4a95-97b7-6c3afee5a540 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:50.464698 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c49d0f-1728-4f1f-88f2-3c95fb82dc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:50.466325 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c49d0f-1728-4f1f-88f2-3c95fb82dc8d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:50.466758 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c49d0f-1728-4f1f-88f2-3c95fb82dc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:50.467224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c49d0f-1728-4f1f-88f2-3c95fb82dc8d None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:50.468114 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c49d0f-1728-4f1f-88f2-3c95fb82dc8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:50.468580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c49d0f-1728-4f1f-88f2-3c95fb82dc8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:50.470122 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c49d0f-1728-4f1f-88f2-3c95fb82dc8d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:50.472132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:50.485552 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 423/838] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:50.496652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcc218-3477-4cf2-85fa-73179bd55ff6 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:50.570109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdf454-736f-4ca4-a265-2d9fce2bedbc None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:50.570753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdf454-736f-4ca4-a265-2d9fce2bedbc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:50.571239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdf454-736f-4ca4-a265-2d9fce2bedbc None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:50.573311 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 424/839] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:50.579907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2ade7-ec06-4050-9599-92a8c866487f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:50.580433 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2ade7-ec06-4050-9599-92a8c866487f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:50.580931 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2ade7-ec06-4050-9599-92a8c866487f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:50.600054 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-83b2ade7-ec06-4050-9599-92a8c866487f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:50.602649 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-83b2ade7-ec06-4050-9599-92a8c866487f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:50.604205 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcc218-3477-4cf2-85fa-73179bd55ff6 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:50.639827 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a9398-7c8c-424b-9487-93eb99aa86a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:50.641021 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a9398-7c8c-424b-9487-93eb99aa86a2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:50.641493 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a9398-7c8c-424b-9487-93eb99aa86a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:50.641952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a9398-7c8c-424b-9487-93eb99aa86a2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:50.650239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a9398-7c8c-424b-9487-93eb99aa86a2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:50.652129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a9398-7c8c-424b-9487-93eb99aa86a2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:50.668305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-e18a9398-7c8c-424b-9487-93eb99aa86a2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 03:15:50.668305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:50.668305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:50.668305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:50.668305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:50.668305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:50.668305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:50.668305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:50.668305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:50.668305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:50.668305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:50.668305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:50.668305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:50.668305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:50.668305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:50.668305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:50.669469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:50.670391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:50.670391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:50.670391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:50.670391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:50.670391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:50.670391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:50.670391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:50.670391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:50.670391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 03:15:50.670391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:50.673593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 416/840] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:15:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:50.679597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a9398-7c8c-424b-9487-93eb99aa86a2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:50.720499 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:50.797276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a9398-7c8c-424b-9487-93eb99aa86a2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:50.840550 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 425/841] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:15:50.850100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3445452-6074-4dc0-b23a-f3b8f07ceb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:50.850785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3445452-6074-4dc0-b23a-f3b8f07ceb3c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:50.851065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3445452-6074-4dc0-b23a-f3b8f07ceb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:50.851339 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3445452-6074-4dc0-b23a-f3b8f07ceb3c None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:50.852179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3445452-6074-4dc0-b23a-f3b8f07ceb3c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:50.852490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3445452-6074-4dc0-b23a-f3b8f07ceb3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:50.853956 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3445452-6074-4dc0-b23a-f3b8f07ceb3c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:50.862220 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2ade7-ec06-4050-9599-92a8c866487f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:50.874234 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 417/842] 10.222.0.26 () {56 vars in 1135 bytes} [Tue Jul 12 03:15:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:50.879764 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3445452-6074-4dc0-b23a-f3b8f07ceb3c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:50.983442 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2ade7-ec06-4050-9599-92a8c866487f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:50.990302 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:51.004278 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3445452-6074-4dc0-b23a-f3b8f07ceb3c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:51.009551 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:51.023147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe5235-5cf2-4f42-b53b-9bb86721984f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:51.024014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe5235-5cf2-4f42-b53b-9bb86721984f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:51.024684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe5235-5cf2-4f42-b53b-9bb86721984f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:51.024797 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe5235-5cf2-4f42-b53b-9bb86721984f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:51.037079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe5235-5cf2-4f42-b53b-9bb86721984f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:51.046285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2efe5235-5cf2-4f42-b53b-9bb86721984f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:51.046285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:51.046285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:51.046285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:51.046285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:51.046285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:51.046285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:51.046285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:51.046285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:51.046285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:51.046285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:51.046285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:51.046285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:51.046285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:51.046285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:51.046285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:51.047373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:51.047373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:51.047373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:51.047373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:51.047373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:51.047373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:51.047373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:51.047373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:51.047373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:51.047373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:51.047373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:51.047373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:51.047373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:51.047373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:51.047373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:51.047373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:51.053260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:51.053260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:51.053260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:51.053260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:51.053260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:51.053260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:51.053260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:51.053260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:51.053260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:51.053260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:51.053260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:15:51.053260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:51.053260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 426/843] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:15:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:51.053260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe5235-5cf2-4f42-b53b-9bb86721984f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:51.054287 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b048a27-084d-40c5-b95b-f82e6bc02f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:51.054963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b048a27-084d-40c5-b95b-f82e6bc02f64 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:51.055239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b048a27-084d-40c5-b95b-f82e6bc02f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:51.055504 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b048a27-084d-40c5-b95b-f82e6bc02f64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:51.128681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b048a27-084d-40c5-b95b-f82e6bc02f64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:51.130177 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b048a27-084d-40c5-b95b-f82e6bc02f64 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:51.160133 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe5235-5cf2-4f42-b53b-9bb86721984f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:51.195052 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df39a5-e18e-43ad-b7f8-3fca10d080e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:51.196102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df39a5-e18e-43ad-b7f8-3fca10d080e9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:51.196606 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df39a5-e18e-43ad-b7f8-3fca10d080e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:51.197070 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df39a5-e18e-43ad-b7f8-3fca10d080e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:51.198032 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df39a5-e18e-43ad-b7f8-3fca10d080e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:51.198542 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df39a5-e18e-43ad-b7f8-3fca10d080e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:51.200232 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df39a5-e18e-43ad-b7f8-3fca10d080e9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:51.213657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 427/844] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:15:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:51.214862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df39a5-e18e-43ad-b7f8-3fca10d080e9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:51.225952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:51.242935 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 418/845] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 03:15:51.244009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b048a27-084d-40c5-b95b-f82e6bc02f64 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:51.265141 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:51.323033 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df39a5-e18e-43ad-b7f8-3fca10d080e9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:51.354768 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b048a27-084d-40c5-b95b-f82e6bc02f64 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:51.359286 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693e4ba-38b8-403c-8d43-247ae6bc3f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:51.360076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693e4ba-38b8-403c-8d43-247ae6bc3f8a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:51.360350 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693e4ba-38b8-403c-8d43-247ae6bc3f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:51.360644 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693e4ba-38b8-403c-8d43-247ae6bc3f8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:51.371616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693e4ba-38b8-403c-8d43-247ae6bc3f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:51.373147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693e4ba-38b8-403c-8d43-247ae6bc3f8a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:51.392429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e693e4ba-38b8-403c-8d43-247ae6bc3f8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:51.392429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:51.392429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:51.392429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:51.392429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:51.392429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:51.392429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:51.392429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:51.392429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:51.392429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:51.392429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:51.392429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:51.392429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:51.392429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:51.392429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:51.393497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:51.393497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:51.393497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:51.393497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:51.393497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:51.393497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:51.393497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:51.393497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:51.393497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:51.393497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:51.393497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:51.393497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:51.393497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:51.393497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:51.393497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:51.393497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:51.393497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:51.394368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:51.394368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:51.394368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:51.394368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:51.394368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 428/846] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:51.395467 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b049715-096e-4df7-a6a0-ae57163e30d4 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:51.395744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b049715-096e-4df7-a6a0-ae57163e30d4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:51.396014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b049715-096e-4df7-a6a0-ae57163e30d4 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:51.400426 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 429/847] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:51.401273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b049715-096e-4df7-a6a0-ae57163e30d4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:51.403331 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b9eff-7de8-488f-bb42-f1a07c4ff9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:51.404126 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b9eff-7de8-488f-bb42-f1a07c4ff9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:51.404400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b9eff-7de8-488f-bb42-f1a07c4ff9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:51.404997 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b9eff-7de8-488f-bb42-f1a07c4ff9a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:51.417203 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b9eff-7de8-488f-bb42-f1a07c4ff9a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:51.418693 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b9eff-7de8-488f-bb42-f1a07c4ff9a4 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:51.513646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:51.519132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b049715-096e-4df7-a6a0-ae57163e30d4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:51.555942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3d4a5-8d34-4ed2-b008-cb6cba095d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:51.556618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3d4a5-8d34-4ed2-b008-cb6cba095d81 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:51.556898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3d4a5-8d34-4ed2-b008-cb6cba095d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:51.557080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7f8b9eff-7de8-488f-bb42-f1a07c4ff9a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:51.557080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:51.557080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:51.557080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:51.557080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:51.557080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:51.557080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:51.557080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:51.557080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:51.557080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:51.557080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:51.557080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:51.557080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:51.557080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:51.557080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:51.557943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:51.557943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:51.557943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:51.557943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:51.557943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:51.557943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:51.557943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:51.557943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:51.557943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:51.557943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:51.557943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:51.557943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:51.557943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:51.557943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:51.557943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:51.557943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:51.557943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:51.564445 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:51.564445 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:51.564445 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:51.564445 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:51.564727 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3d4a5-8d34-4ed2-b008-cb6cba095d81 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:51.564727 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3d4a5-8d34-4ed2-b008-cb6cba095d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:51.564727 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3d4a5-8d34-4ed2-b008-cb6cba095d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:51.564922 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 419/848] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:51.564990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3d4a5-8d34-4ed2-b008-cb6cba095d81 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:51.565056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ee8b2-bcb5-41e5-95e3-9ea45875c94c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:51.565056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ee8b2-bcb5-41e5-95e3-9ea45875c94c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:51.565056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ee8b2-bcb5-41e5-95e3-9ea45875c94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:51.571469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 430/849] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:51.577200 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3d4a5-8d34-4ed2-b008-cb6cba095d81 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:51.582227 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-0d5ee8b2-bcb5-41e5-95e3-9ea45875c94c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:51.583406 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0d5ee8b2-bcb5-41e5-95e3-9ea45875c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:51.620490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:51.655277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 420/850] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:15:51.655855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ee8b2-bcb5-41e5-95e3-9ea45875c94c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:51.696147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3d4a5-8d34-4ed2-b008-cb6cba095d81 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:51.733099 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293b508-777e-4130-bbdf-f77d91511cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:51.733755 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293b508-777e-4130-bbdf-f77d91511cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:51.734028 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293b508-777e-4130-bbdf-f77d91511cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:51.734295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293b508-777e-4130-bbdf-f77d91511cd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:51.735019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293b508-777e-4130-bbdf-f77d91511cd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:51.735321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293b508-777e-4130-bbdf-f77d91511cd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:51.736722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293b508-777e-4130-bbdf-f77d91511cd1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:51.748229 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 431/851] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:51.749056 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293b508-777e-4130-bbdf-f77d91511cd1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:51.769268 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:51.774953 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ee8b2-bcb5-41e5-95e3-9ea45875c94c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:51.817068 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ed7f2-9d33-4908-a122-7ecb49e61bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:51.817881 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ed7f2-9d33-4908-a122-7ecb49e61bdf None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:51.818152 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ed7f2-9d33-4908-a122-7ecb49e61bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:51.818417 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ed7f2-9d33-4908-a122-7ecb49e61bdf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:51.826903 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ed7f2-9d33-4908-a122-7ecb49e61bdf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:51.828398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ed7f2-9d33-4908-a122-7ecb49e61bdf None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:51.844461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d95ed7f2-9d33-4908-a122-7ecb49e61bdf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 03:15:51.844461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:51.844461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:51.844461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:51.844461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:51.844461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:51.844461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:51.844461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:51.844461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:51.844461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:51.844461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:51.844461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:51.844461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:51.844461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:51.844461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:51.844461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:51.850564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:51.851758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:51.851758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:51.851758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:51.851758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:51.851758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:51.851758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:51.851758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:51.851758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:51.851758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 03:15:51.851758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:51.851758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 421/852] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 03:15:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:51.851758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ed7f2-9d33-4908-a122-7ecb49e61bdf None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:51.863885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293b508-777e-4130-bbdf-f77d91511cd1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:51.882341 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:51.902503 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76284e44-7ee5-4187-81d0-54c0b9856d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:51.903300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76284e44-7ee5-4187-81d0-54c0b9856d0d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:51.903573 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76284e44-7ee5-4187-81d0-54c0b9856d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:51.903838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76284e44-7ee5-4187-81d0-54c0b9856d0d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:51.904745 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76284e44-7ee5-4187-81d0-54c0b9856d0d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:51.905962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76284e44-7ee5-4187-81d0-54c0b9856d0d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:51.917474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-76284e44-7ee5-4187-81d0-54c0b9856d0d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 03:15:51.917474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:51.917474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:15:51.917474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:15:51.917474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:15:51.917474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:15:51.917474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:15:51.917474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:51.917474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 03:15:51.917474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:51.917474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:15:51.917474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:51.917474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:51.917474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:51.917474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:51.917474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:51.917474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:51.918710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:51.918710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:51.918710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:51.918710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:51.918710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:51.918710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:51.918710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:15:51.918710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:15:51.918710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:15:51.918710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:15:51.918710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:51.918710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:51.918710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:51.918710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:51.918710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:51.918710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:51.919525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:51.919525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:51.919525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:51.919525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:51.919525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:51.919525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:51.919525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:51.919525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:51.919525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:51.919525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:51.919525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:15:51.919525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:51.919525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 03:15:51.919525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:51.919525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 432/853] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:15:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:51.920295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76284e44-7ee5-4187-81d0-54c0b9856d0d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:51.963697 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ed7f2-9d33-4908-a122-7ecb49e61bdf None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:52.001573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042482e2-3009-4253-ac92-500600e9fa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:52.002371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042482e2-3009-4253-ac92-500600e9fa11 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:52.002646 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042482e2-3009-4253-ac92-500600e9fa11 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:52.002972 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042482e2-3009-4253-ac92-500600e9fa11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:52.005003 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:52.010954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042482e2-3009-4253-ac92-500600e9fa11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:52.012579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042482e2-3009-4253-ac92-500600e9fa11 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:52.024203 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76284e44-7ee5-4187-81d0-54c0b9856d0d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:52.027182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-042482e2-3009-4253-ac92-500600e9fa11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:52.027182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:52.027182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:52.027182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:52.027182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:52.027182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:52.027182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:52.027182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:52.027182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:52.027182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:52.027182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:52.027182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:52.027182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:52.027182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:52.027182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:52.028217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:52.028217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:52.028217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:52.028217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:52.028217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:52.028217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:52.028217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:52.028217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:52.028217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:52.028217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:52.028217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:52.028217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:52.028217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:52.028217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:52.028217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:52.028217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:52.028217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:52.034376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:52.034376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:52.034376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:52.034376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:52.034376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:52.034376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:52.034376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:52.034376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:52.034376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 422/854] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:52.034376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042482e2-3009-4253-ac92-500600e9fa11 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:52.062416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e55f2-c8dd-40f1-ade4-2601bf4d01bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:52.063082 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e55f2-c8dd-40f1-ade4-2601bf4d01bb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:52.063360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e55f2-c8dd-40f1-ade4-2601bf4d01bb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:52.063634 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e55f2-c8dd-40f1-ade4-2601bf4d01bb None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:52.064463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e55f2-c8dd-40f1-ade4-2601bf4d01bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:52.064809 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e55f2-c8dd-40f1-ade4-2601bf4d01bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:52.066238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e55f2-c8dd-40f1-ade4-2601bf4d01bb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:52.084118 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 433/855] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Jul 12 03:15:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:52.084889 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e55f2-c8dd-40f1-ade4-2601bf4d01bb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:52.136965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:52.146586 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042482e2-3009-4253-ac92-500600e9fa11 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:52.181555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d48b81-cc0d-4e3d-8e6a-b15303787029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:52.182216 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d48b81-cc0d-4e3d-8e6a-b15303787029 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:52.182550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d48b81-cc0d-4e3d-8e6a-b15303787029 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:52.182854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d48b81-cc0d-4e3d-8e6a-b15303787029 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:52.183630 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d48b81-cc0d-4e3d-8e6a-b15303787029 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:52.183929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d48b81-cc0d-4e3d-8e6a-b15303787029 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:52.185318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d48b81-cc0d-4e3d-8e6a-b15303787029 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:52.187006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e55f2-c8dd-40f1-ade4-2601bf4d01bb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:52.190169 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 423/856] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:15:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:52.191135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d48b81-cc0d-4e3d-8e6a-b15303787029 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:52.228580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cb1c4-d3ec-495e-8d28-6919f3dd324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:52.229241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cb1c4-d3ec-495e-8d28-6919f3dd324b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:52.229515 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cb1c4-d3ec-495e-8d28-6919f3dd324b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:52.229783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cb1c4-d3ec-495e-8d28-6919f3dd324b None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:52.230594 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cb1c4-d3ec-495e-8d28-6919f3dd324b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:52.230894 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cb1c4-d3ec-495e-8d28-6919f3dd324b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:52.232457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cb1c4-d3ec-495e-8d28-6919f3dd324b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:52.240980 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:52.244971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 434/857] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:52.245770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cb1c4-d3ec-495e-8d28-6919f3dd324b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:52.293048 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d48b81-cc0d-4e3d-8e6a-b15303787029 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:52.326940 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4bc0c-b847-498a-9083-55007c523494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:52.327614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4bc0c-b847-498a-9083-55007c523494 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:52.327912 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4bc0c-b847-498a-9083-55007c523494 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:52.328233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4bc0c-b847-498a-9083-55007c523494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:52.343510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cb1c4-d3ec-495e-8d28-6919f3dd324b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:52.352801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:52.376168 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13d526-4eff-40b3-9ff3-2aba7b6fb8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:52.376861 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13d526-4eff-40b3-9ff3-2aba7b6fb8dd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:52.377136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13d526-4eff-40b3-9ff3-2aba7b6fb8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:52.377407 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13d526-4eff-40b3-9ff3-2aba7b6fb8dd None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:52.378110 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13d526-4eff-40b3-9ff3-2aba7b6fb8dd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:52.378413 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13d526-4eff-40b3-9ff3-2aba7b6fb8dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:52.379810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13d526-4eff-40b3-9ff3-2aba7b6fb8dd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:52.384394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 435/858] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:15:52 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:52.385479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb7a8f-a20e-4069-823e-44848be3deea None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:52.385768 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb7a8f-a20e-4069-823e-44848be3deea None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:52.386036 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb7a8f-a20e-4069-823e-44848be3deea None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:52.387576 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 436/859] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:52.388319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb7a8f-a20e-4069-823e-44848be3deea None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:52.397831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4bc0c-b847-498a-9083-55007c523494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:52.399733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4bc0c-b847-498a-9083-55007c523494 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:52.463393 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:52.507714 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb7a8f-a20e-4069-823e-44848be3deea None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:52.531038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 424/860] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 03:15:52.531038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fa8e2-4ada-41ad-bc65-08c245a286dc None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:52.531038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fa8e2-4ada-41ad-bc65-08c245a286dc None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:52.531038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fa8e2-4ada-41ad-bc65-08c245a286dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:52.546925 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-af1fa8e2-4ada-41ad-bc65-08c245a286dc None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:52.549058 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-af1fa8e2-4ada-41ad-bc65-08c245a286dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:52.556767 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5176819-5d0e-49e9-9c52-aaa76af3e732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:52.557413 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5176819-5d0e-49e9-9c52-aaa76af3e732 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:52.557690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5176819-5d0e-49e9-9c52-aaa76af3e732 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:52.557962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5176819-5d0e-49e9-9c52-aaa76af3e732 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:52.559021 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5176819-5d0e-49e9-9c52-aaa76af3e732 None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=ffc4cbd87dd249868cfb704535774126) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:52.559311 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5176819-5d0e-49e9-9c52-aaa76af3e732 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:52.560793 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5176819-5d0e-49e9-9c52-aaa76af3e732 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:52.573041 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 437/861] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:15:52 2022] GET /identity/v3/role_assignments?user.id=ffc4cbd87dd249868cfb704535774126&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:52.573041 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5176819-5d0e-49e9-9c52-aaa76af3e732 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:52.611453 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:52.630954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 425/862] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:15:52.654528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fa8e2-4ada-41ad-bc65-08c245a286dc None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:52.717905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5176819-5d0e-49e9-9c52-aaa76af3e732 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:52.754826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:52.770918 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55520ce-7a18-4314-b956-5004ed9027cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:52.771719 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55520ce-7a18-4314-b956-5004ed9027cb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:52.771992 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55520ce-7a18-4314-b956-5004ed9027cb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:52.772257 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55520ce-7a18-4314-b956-5004ed9027cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:52.783819 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55520ce-7a18-4314-b956-5004ed9027cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:52.785376 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55520ce-7a18-4314-b956-5004ed9027cb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:52.805732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c55520ce-7a18-4314-b956-5004ed9027cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:52.805732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:52.805732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:52.805732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:52.805732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:52.805732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:52.805732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:52.805732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:52.805732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:52.805732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:52.805732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:52.805732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:52.805732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:52.805732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:52.805732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:52.806810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:52.806810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:52.806810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:52.806810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:52.806810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:52.806810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:52.806810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:52.806810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:52.806810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:52.806810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:52.806810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:52.806810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:52.806810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:52.806810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:52.806810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:52.806810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:52.806810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:52.807739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:52.807739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:52.807739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:52.807739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:52.807739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 438/863] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:52.812910 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55520ce-7a18-4314-b956-5004ed9027cb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:52.814964 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fa8e2-4ada-41ad-bc65-08c245a286dc None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:52.855111 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11322919-1e91-48f4-9f3d-7f98ee5df474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:52.855978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11322919-1e91-48f4-9f3d-7f98ee5df474 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:52.856259 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11322919-1e91-48f4-9f3d-7f98ee5df474 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:52.856554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11322919-1e91-48f4-9f3d-7f98ee5df474 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:52.857464 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11322919-1e91-48f4-9f3d-7f98ee5df474 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:52.859858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11322919-1e91-48f4-9f3d-7f98ee5df474 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:52.876996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-11322919-1e91-48f4-9f3d-7f98ee5df474 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 03:15:52.876996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:52.876996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:15:52.876996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:15:52.876996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:15:52.876996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:15:52.876996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:15:52.876996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:52.876996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 03:15:52.876996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:52.876996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:15:52.876996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:52.876996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:52.876996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:52.876996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:52.876996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:52.877969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:52.877969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:52.877969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:52.877969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:52.877969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:52.877969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:52.877969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:52.877969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:15:52.877969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:15:52.877969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:15:52.877969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:15:52.877969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:52.877969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:52.877969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:52.877969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:52.877969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:52.878811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:52.878811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:52.878811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:52.878811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:52.878811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:52.878811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:52.878811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:52.878811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:52.878811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:52.878811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:52.878811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:52.878811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:15:52.878811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:52.878811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 03:15:52.878811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:52.881889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 426/864] 10.222.0.26 () {56 vars in 1132 bytes} [Tue Jul 12 03:15:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:52.887511 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11322919-1e91-48f4-9f3d-7f98ee5df474 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:52.939722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55520ce-7a18-4314-b956-5004ed9027cb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:52.955673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:52.979402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5a05a-db9a-45c4-b80d-613580df20d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:52.980145 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5a05a-db9a-45c4-b80d-613580df20d7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:52.980373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5a05a-db9a-45c4-b80d-613580df20d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:52.980993 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5a05a-db9a-45c4-b80d-613580df20d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:52.981437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5a05a-db9a-45c4-b80d-613580df20d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:52.981696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5a05a-db9a-45c4-b80d-613580df20d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:52.983158 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5a05a-db9a-45c4-b80d-613580df20d7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:52.996798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 439/865] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:53.001661 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5a05a-db9a-45c4-b80d-613580df20d7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:53.024208 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11322919-1e91-48f4-9f3d-7f98ee5df474 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:53.048890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:53.063219 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e2181-71f6-40af-be5b-6d6445d3372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:53.064375 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e2181-71f6-40af-be5b-6d6445d3372d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:53.064933 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e2181-71f6-40af-be5b-6d6445d3372d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:53.065407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e2181-71f6-40af-be5b-6d6445d3372d None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:53.066318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e2181-71f6-40af-be5b-6d6445d3372d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:53.066911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e2181-71f6-40af-be5b-6d6445d3372d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:53.068623 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e2181-71f6-40af-be5b-6d6445d3372d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:53.078840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 427/866] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 03:15:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:53.080142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e2181-71f6-40af-be5b-6d6445d3372d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:53.111587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5a05a-db9a-45c4-b80d-613580df20d7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:53.148699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db46df-8627-411c-b728-132471c7f844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:53.149416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db46df-8627-411c-b728-132471c7f844 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:53.149693 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db46df-8627-411c-b728-132471c7f844 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:53.149965 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db46df-8627-411c-b728-132471c7f844 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:53.157500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db46df-8627-411c-b728-132471c7f844 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:53.158948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db46df-8627-411c-b728-132471c7f844 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:53.173539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-55db46df-8627-411c-b728-132471c7f844 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:53.173539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:53.173539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:53.173539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:53.173539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:53.173539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:53.173539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:53.173539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:53.173539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:53.173539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:53.173539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:53.173539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:53.173539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:53.173539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:53.173539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:53.174451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:53.174451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:53.174451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:53.174451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:53.174451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:53.174451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:53.174451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:53.174451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:53.174451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:53.174451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:53.174451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:53.174451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:53.174451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:53.174451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:53.174451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:53.174451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:53.174451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:53.175327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:53.175327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:53.175327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:53.175327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:53.175327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:53.175327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:53.175327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:53.175327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:53.175327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 440/867] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:53.180232 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db46df-8627-411c-b728-132471c7f844 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:53.204292 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e2181-71f6-40af-be5b-6d6445d3372d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:53.224230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:53.252301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ce739-16e1-4e98-8265-cbd501dfa931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:53.253004 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ce739-16e1-4e98-8265-cbd501dfa931 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:53.253285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ce739-16e1-4e98-8265-cbd501dfa931 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:53.253567 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ce739-16e1-4e98-8265-cbd501dfa931 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:53.254555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ce739-16e1-4e98-8265-cbd501dfa931 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:53.255243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ce739-16e1-4e98-8265-cbd501dfa931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:53.256923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ce739-16e1-4e98-8265-cbd501dfa931 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:53.264391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 428/868] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 03:15:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:53.299667 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:53.303315 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db46df-8627-411c-b728-132471c7f844 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:53.343203 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a39348-5bbf-4cc1-94ec-87be5cc84a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:53.344137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a39348-5bbf-4cc1-94ec-87be5cc84a6d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:53.345058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a39348-5bbf-4cc1-94ec-87be5cc84a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:53.345484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a39348-5bbf-4cc1-94ec-87be5cc84a6d None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:53.346762 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a39348-5bbf-4cc1-94ec-87be5cc84a6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:53.347225 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a39348-5bbf-4cc1-94ec-87be5cc84a6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:53.348874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a39348-5bbf-4cc1-94ec-87be5cc84a6d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:53.363602 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 441/869] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:53.369784 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ce739-16e1-4e98-8265-cbd501dfa931 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:53.477007 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ce739-16e1-4e98-8265-cbd501dfa931 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:53.511037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fa808-777d-404a-9713-4c2136815ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:53.512018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fa808-777d-404a-9713-4c2136815ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:53.512493 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fa808-777d-404a-9713-4c2136815ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:53.512975 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fa808-777d-404a-9713-4c2136815ea3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:53.513967 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fa808-777d-404a-9713-4c2136815ea3 None admin] RBAC: Adding query filter params (role.id=8a9636f0fea542a19f6fcaf54b9c1d11, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=e23aea853cce44698b19d6bc087093c1) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:53.514453 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fa808-777d-404a-9713-4c2136815ea3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:53.516049 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fa808-777d-404a-9713-4c2136815ea3 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:53.522743 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 429/870] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:15:53 2022] GET /identity/v3/role_assignments?user.id=e23aea853cce44698b19d6bc087093c1&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=8a9636f0fea542a19f6fcaf54b9c1d11 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:54.472071 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858463a-f2af-459d-b336-09d5b74751d5 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:54.472646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858463a-f2af-459d-b336-09d5b74751d5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:54.472646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858463a-f2af-459d-b336-09d5b74751d5 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:54.474472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 442/871] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:54.479756 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd3ca0-2bb4-41b1-b265-1cf722769493 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:54.480136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd3ca0-2bb4-41b1-b265-1cf722769493 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:54.480408 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd3ca0-2bb4-41b1-b265-1cf722769493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:54.498036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-27bd3ca0-2bb4-41b1-b265-1cf722769493 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:54.499268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-27bd3ca0-2bb4-41b1-b265-1cf722769493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:54.533810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:54.572633 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 430/872] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:15:54.589681 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858463a-f2af-459d-b336-09d5b74751d5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:54.693039 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858463a-f2af-459d-b336-09d5b74751d5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:54.696133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbdf45-2f6c-4dd5-8046-021540c0f843 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:54.696422 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbdf45-2f6c-4dd5-8046-021540c0f843 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:54.696836 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbdf45-2f6c-4dd5-8046-021540c0f843 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:54.698482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 431/873] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:15:54.707341 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448202a-0096-4c11-bfc4-05165e88faf7 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:54.707631 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448202a-0096-4c11-bfc4-05165e88faf7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:54.707905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448202a-0096-4c11-bfc4-05165e88faf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:54.727170 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5448202a-0096-4c11-bfc4-05165e88faf7 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:54.728407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5448202a-0096-4c11-bfc4-05165e88faf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:54.734959 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb2cd1-2970-41ba-8581-6141e3fb8ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:54.735925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb2cd1-2970-41ba-8581-6141e3fb8ad1 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:54.736384 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb2cd1-2970-41ba-8581-6141e3fb8ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:54.736856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb2cd1-2970-41ba-8581-6141e3fb8ad1 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:54.737774 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb2cd1-2970-41ba-8581-6141e3fb8ad1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:54.739307 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb2cd1-2970-41ba-8581-6141e3fb8ad1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:54.764678 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 443/874] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 03:15:54 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:15:54.812733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 432/875] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 03:15:54.835734 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb2cd1-2970-41ba-8581-6141e3fb8ad1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:54.862089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:54.957504 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb2cd1-2970-41ba-8581-6141e3fb8ad1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:54.992587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396168c2-5ae1-42b7-98de-420592f8ea9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:54.993333 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396168c2-5ae1-42b7-98de-420592f8ea9a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:54.993614 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396168c2-5ae1-42b7-98de-420592f8ea9a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:54.993887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396168c2-5ae1-42b7-98de-420592f8ea9a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:54.994547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396168c2-5ae1-42b7-98de-420592f8ea9a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:54.996026 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396168c2-5ae1-42b7-98de-420592f8ea9a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:55.008469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-396168c2-5ae1-42b7-98de-420592f8ea9a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 03:15:55.008469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:55.008469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:15:55.008469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:15:55.008469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:15:55.008469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:15:55.008469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:15:55.008469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:55.008469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 03:15:55.008469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:55.008469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:15:55.008469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:55.008469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:55.008469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:55.008469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:55.008469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:55.008469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:55.009546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:55.009546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:55.009546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:55.009546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:55.009546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:55.009546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:55.009546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:15:55.009546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:15:55.009546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:15:55.009546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:15:55.009546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:55.009546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:55.009546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:55.009546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:55.009546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:55.009546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:55.010378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:55.010378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:55.010378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:55.010378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:55.010378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:55.010378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:55.010378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:55.010378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:55.010378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:55.010378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:55.010378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:15:55.010378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:55.010378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 03:15:55.010378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:55.010378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 444/876] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 03:15:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:55.017847 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448202a-0096-4c11-bfc4-05165e88faf7 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:55.113833 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:55.117805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448202a-0096-4c11-bfc4-05165e88faf7 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:55.158807 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be5302-e472-461d-a0e0-7723192f57e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:55.159478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be5302-e472-461d-a0e0-7723192f57e2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:55.159751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be5302-e472-461d-a0e0-7723192f57e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:55.160019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be5302-e472-461d-a0e0-7723192f57e2 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:55.161380 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be5302-e472-461d-a0e0-7723192f57e2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:55.161685 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be5302-e472-461d-a0e0-7723192f57e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:55.163062 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be5302-e472-461d-a0e0-7723192f57e2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:55.168290 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 433/877] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 03:15:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:55.173901 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396168c2-5ae1-42b7-98de-420592f8ea9a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:55.263925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:55.281754 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396168c2-5ae1-42b7-98de-420592f8ea9a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:55.317504 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9d121-7840-450c-84ab-8a10eb3c2e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:55.318195 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9d121-7840-450c-84ab-8a10eb3c2e4a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:55.318477 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9d121-7840-450c-84ab-8a10eb3c2e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:55.318751 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9d121-7840-450c-84ab-8a10eb3c2e4a None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:55.319470 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9d121-7840-450c-84ab-8a10eb3c2e4a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:55.319776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9d121-7840-450c-84ab-8a10eb3c2e4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:55.321378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9d121-7840-450c-84ab-8a10eb3c2e4a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:55.327037 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 445/878] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 03:15:55 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:55.360576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38872705-2f77-427b-a3ba-e34e4603c1e7 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:55.360929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38872705-2f77-427b-a3ba-e34e4603c1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:55.361132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38872705-2f77-427b-a3ba-e34e4603c1e7 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:55.362855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 434/879] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:55.368752 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95d2df-9c7f-47fa-8ef6-23ee291c2285 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:55.369065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95d2df-9c7f-47fa-8ef6-23ee291c2285 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:55.369318 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95d2df-9c7f-47fa-8ef6-23ee291c2285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:55.388261 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-de95d2df-9c7f-47fa-8ef6-23ee291c2285 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:55.389526 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-de95d2df-9c7f-47fa-8ef6-23ee291c2285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:55.466975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 446/880] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:55 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:15:55.489538 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38872705-2f77-427b-a3ba-e34e4603c1e7 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:55.595210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38872705-2f77-427b-a3ba-e34e4603c1e7 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:55.630281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c075966-290e-44a4-9039-0db68e9cbd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:55.630944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c075966-290e-44a4-9039-0db68e9cbd1e None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:55.631209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c075966-290e-44a4-9039-0db68e9cbd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:55.631476 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c075966-290e-44a4-9039-0db68e9cbd1e None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:55.632192 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c075966-290e-44a4-9039-0db68e9cbd1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:55.633587 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c075966-290e-44a4-9039-0db68e9cbd1e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:55.650257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 435/881] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 03:15:55 2022] POST /identity/v3/services => generated 269 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:15:55.726722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4ae76-4cac-4375-9cc9-62262fa4477b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:55.727266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4ae76-4cac-4375-9cc9-62262fa4477b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:55.727515 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4ae76-4cac-4375-9cc9-62262fa4477b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:55.729364 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 447/882] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:55.735415 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2835ac-ed48-4689-9993-18af4818d727 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:55.735729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2835ac-ed48-4689-9993-18af4818d727 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:55.736000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2835ac-ed48-4689-9993-18af4818d727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:55.754871 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2b2835ac-ed48-4689-9993-18af4818d727 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:55.756068 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2b2835ac-ed48-4689-9993-18af4818d727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:55.775091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:55.836351 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 436/883] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:15:55.860397 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4ae76-4cac-4375-9cc9-62262fa4477b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:55.943855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:55.968612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4ae76-4cac-4375-9cc9-62262fa4477b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:56.004345 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205fbc5-80d6-4f53-bb54-db81c6155dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:56.005235 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205fbc5-80d6-4f53-bb54-db81c6155dbd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:56.005515 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205fbc5-80d6-4f53-bb54-db81c6155dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:56.005844 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205fbc5-80d6-4f53-bb54-db81c6155dbd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:56.021182 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205fbc5-80d6-4f53-bb54-db81c6155dbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:15:56.030048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-5205fbc5-80d6-4f53-bb54-db81c6155dbd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 03:15:56.030048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:56.030048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:56.030048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:56.030048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:56.030048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:56.030048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:56.030048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:56.030048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:56.030048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:56.030048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:56.030048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:56.030048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:15:56.030048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:15:56.030048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:15:56.030048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:15:56.030968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:15:56.030968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:15:56.030968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:15:56.030968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:15:56.030968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:56.030968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:56.030968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:56.030968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:56.030968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:56.030968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:56.030968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:56.030968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:56.030968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:56.030968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:56.030968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:56.030968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:56.031788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:56.031788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:56.031788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:56.031788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:56.031788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:15:56.031788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:15:56.031788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:15:56.031788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:15:56.031788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:15:56.031788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:15:56.031788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 03:15:56.031788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:56.034689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 448/884] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Jul 12 03:15:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:56.040966 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2835ac-ed48-4689-9993-18af4818d727 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:56.146262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2835ac-ed48-4689-9993-18af4818d727 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:56.180420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900410a-b9b4-48b8-92a2-7cf88b98dd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:56.181128 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900410a-b9b4-48b8-92a2-7cf88b98dd4f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:56.181409 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900410a-b9b4-48b8-92a2-7cf88b98dd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:56.181687 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900410a-b9b4-48b8-92a2-7cf88b98dd4f None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:56.182441 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900410a-b9b4-48b8-92a2-7cf88b98dd4f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:56.182743 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900410a-b9b4-48b8-92a2-7cf88b98dd4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:56.184146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900410a-b9b4-48b8-92a2-7cf88b98dd4f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:56.192717 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 437/885] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Jul 12 03:15:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:56.198154 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205fbc5-80d6-4f53-bb54-db81c6155dbd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:56.301490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205fbc5-80d6-4f53-bb54-db81c6155dbd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:56.335554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55ddef-35e5-4873-92aa-72d50aa44937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:56.336776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55ddef-35e5-4873-92aa-72d50aa44937 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:56.337250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55ddef-35e5-4873-92aa-72d50aa44937 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:56.337711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55ddef-35e5-4873-92aa-72d50aa44937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:56.347663 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:56.351620 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55ddef-35e5-4873-92aa-72d50aa44937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:56.353419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55ddef-35e5-4873-92aa-72d50aa44937 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:56.371808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-ba55ddef-35e5-4873-92aa-72d50aa44937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:56.371808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:56.371808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:56.371808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:56.371808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:56.371808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:56.371808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:56.371808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:56.371808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:56.371808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:56.371808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:56.371808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:56.371808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:56.371808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:56.371808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:56.372741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:56.372741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:56.372741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:56.372741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:56.372741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:56.372741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:56.372741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:56.372741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:56.372741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:56.372741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:56.372741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:56.372741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:56.372741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:56.372741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:56.372741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:56.372741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:56.372741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:56.373720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:56.373720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:56.373720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:56.373720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:56.375959 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 449/886] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:56.381792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900410a-b9b4-48b8-92a2-7cf88b98dd4f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:56.395519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:56.489348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900410a-b9b4-48b8-92a2-7cf88b98dd4f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:56.524718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbd7fc-5c9b-431f-84d5-995d864a3f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:56.525468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbd7fc-5c9b-431f-84d5-995d864a3f43 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:56.525721 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbd7fc-5c9b-431f-84d5-995d864a3f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:56.526004 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbd7fc-5c9b-431f-84d5-995d864a3f43 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:56.526731 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbd7fc-5c9b-431f-84d5-995d864a3f43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:56.527116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbd7fc-5c9b-431f-84d5-995d864a3f43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:56.528496 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbd7fc-5c9b-431f-84d5-995d864a3f43 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:56.541274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 438/887] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:56.546975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55ddef-35e5-4873-92aa-72d50aa44937 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:56.648746 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55ddef-35e5-4873-92aa-72d50aa44937 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:56.683460 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8d5f2-63ae-4a5f-be4c-21ee4a635028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:56.684713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8d5f2-63ae-4a5f-be4c-21ee4a635028 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:56.685187 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8d5f2-63ae-4a5f-be4c-21ee4a635028 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:56.685672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8d5f2-63ae-4a5f-be4c-21ee4a635028 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:56.693664 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8d5f2-63ae-4a5f-be4c-21ee4a635028 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:56.695320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8d5f2-63ae-4a5f-be4c-21ee4a635028 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:56.710406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a0b8d5f2-63ae-4a5f-be4c-21ee4a635028 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 03:15:56.710406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:56.710406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:56.710406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:56.710406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:56.710406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:56.710406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:56.710406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:56.710406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:56.710406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:56.710406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:56.710406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:56.710406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:15:56.710406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:15:56.710406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:15:56.710406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:56.711347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:56.712299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:56.712299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:56.712299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:15:56.712299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:15:56.712299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:15:56.712299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:15:56.712299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:15:56.712299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:15:56.712299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 03:15:56.712299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:56.712299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 450/888] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 03:15:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:56.717944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbd7fc-5c9b-431f-84d5-995d864a3f43 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:56.788136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:56.822456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbd7fc-5c9b-431f-84d5-995d864a3f43 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:56.858721 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0ade0-894f-40de-b098-cf96893c5c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:56.859401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0ade0-894f-40de-b098-cf96893c5c8a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:56.859671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0ade0-894f-40de-b098-cf96893c5c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:56.859936 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0ade0-894f-40de-b098-cf96893c5c8a None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:56.860795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0ade0-894f-40de-b098-cf96893c5c8a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:56.861099 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0ade0-894f-40de-b098-cf96893c5c8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:56.862540 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0ade0-894f-40de-b098-cf96893c5c8a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:56.880950 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 439/889] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Jul 12 03:15:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:56.887196 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8d5f2-63ae-4a5f-be4c-21ee4a635028 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:56.944892 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:56.962089 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8977ba-08d3-413b-9b55-8942aaf60564 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:56.962411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8977ba-08d3-413b-9b55-8942aaf60564 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:56.962648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8977ba-08d3-413b-9b55-8942aaf60564 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:56.964246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 440/890] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:15:56.969480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2310-778b-4deb-aff9-e0b049bcbfdf None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:56.970000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2310-778b-4deb-aff9-e0b049bcbfdf None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:56.970481 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2310-778b-4deb-aff9-e0b049bcbfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:56.992155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-96bc2310-778b-4deb-aff9-e0b049bcbfdf None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:56.993719 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-96bc2310-778b-4deb-aff9-e0b049bcbfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:56.997304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8d5f2-63ae-4a5f-be4c-21ee4a635028 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:57.033833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b64426-f48d-4652-a032-2b4770fd501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:57.034647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b64426-f48d-4652-a032-2b4770fd501d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:57.035016 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b64426-f48d-4652-a032-2b4770fd501d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:57.035378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b64426-f48d-4652-a032-2b4770fd501d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:57.075164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 441/891] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 03:15:57.097413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc2310-778b-4deb-aff9-e0b049bcbfdf None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:57.112004 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b64426-f48d-4652-a032-2b4770fd501d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:57.113814 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b64426-f48d-4652-a032-2b4770fd501d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:57.161845 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:57.181638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:57.231589 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc2310-778b-4deb-aff9-e0b049bcbfdf None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:57.243791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 451/892] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:15:56 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 03:15:57.245095 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b64426-f48d-4652-a032-2b4770fd501d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:57.274267 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0bb04-9c77-4509-893d-19c49998c347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:57.275232 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0bb04-9c77-4509-893d-19c49998c347 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:57.275608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0bb04-9c77-4509-893d-19c49998c347 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:57.275980 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0bb04-9c77-4509-893d-19c49998c347 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:57.276984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0bb04-9c77-4509-893d-19c49998c347 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:57.278378 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0bb04-9c77-4509-893d-19c49998c347 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:57.291056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-b5b0bb04-9c77-4509-893d-19c49998c347 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 03:15:57.291056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:57.291056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:15:57.291056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:15:57.291056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:15:57.291056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:15:57.291056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:15:57.291056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:57.291056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 03:15:57.291056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:57.291056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:15:57.291056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:57.291056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:57.291056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:57.291056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:57.291056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:57.291056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:57.292079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:57.292079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:57.292079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:57.292079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:57.292079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:57.292079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:57.292079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:15:57.292079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:15:57.292079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:15:57.292079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:15:57.292079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:57.292079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:57.292079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:57.292079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:57.292079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:57.292079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:57.293307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:57.293307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:57.293307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:57.293307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:57.293307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:57.293307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:57.293307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:57.293307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:57.293307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:57.293307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:57.293307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:15:57.293307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:57.293307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 03:15:57.293307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:57.297805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 442/893] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:15:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:57.298827 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0bb04-9c77-4509-893d-19c49998c347 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:57.367075 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b64426-f48d-4652-a032-2b4770fd501d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:57.407708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db531a0-ecee-4b2c-9255-d27e00155986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:57.408878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db531a0-ecee-4b2c-9255-d27e00155986 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:57.409353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0bb04-9c77-4509-893d-19c49998c347 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:57.409540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db531a0-ecee-4b2c-9255-d27e00155986 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:57.409978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db531a0-ecee-4b2c-9255-d27e00155986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:57.425237 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db531a0-ecee-4b2c-9255-d27e00155986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:57.426714 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db531a0-ecee-4b2c-9255-d27e00155986 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:57.440089 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:57.448487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-9db531a0-ecee-4b2c-9255-d27e00155986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:57.448487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:57.448487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:57.448487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:57.448487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:57.448487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:57.448487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:57.448487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:57.448487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:57.448487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:57.448487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:57.448487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:57.448487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:15:57.448487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:15:57.448487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:15:57.450031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:15:57.450031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:57.450031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:57.450031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:57.450031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:57.450031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:57.450031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:57.450031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:57.450031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:57.450031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:57.450031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:57.450031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:57.450031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:57.450031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:57.450031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:57.450031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:57.450031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:57.450905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:15:57.450905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:15:57.450905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:15:57.450905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:57.450905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 452/894] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:15:57.451172 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559daaea-610d-43f9-8d31-85aaf6687023 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:57.451681 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559daaea-610d-43f9-8d31-85aaf6687023 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:57.451681 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559daaea-610d-43f9-8d31-85aaf6687023 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:57.453231 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 453/895] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:57.456993 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0a34a-91f6-40f1-bcfa-a4cd97686ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:57.458180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0a34a-91f6-40f1-bcfa-a4cd97686ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:57.458326 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559daaea-610d-43f9-8d31-85aaf6687023 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:57.458501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0a34a-91f6-40f1-bcfa-a4cd97686ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:57.458718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0a34a-91f6-40f1-bcfa-a4cd97686ce4 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:57.459434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0a34a-91f6-40f1-bcfa-a4cd97686ce4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:57.459734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0a34a-91f6-40f1-bcfa-a4cd97686ce4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:57.461168 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:57.461366 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0a34a-91f6-40f1-bcfa-a4cd97686ce4 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:57.469582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 443/896] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:15:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:57.474696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad3fa9-ec71-4ffc-be99-80530d4eac6b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:57.474696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad3fa9-ec71-4ffc-be99-80530d4eac6b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:57.474696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad3fa9-ec71-4ffc-be99-80530d4eac6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:57.490728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-8cad3fa9-ec71-4ffc-be99-80530d4eac6b None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:57.491915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8cad3fa9-ec71-4ffc-be99-80530d4eac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:57.562851 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 444/897] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:15:57.566592 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559daaea-610d-43f9-8d31-85aaf6687023 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:57.570363 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad3fa9-ec71-4ffc-be99-80530d4eac6b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:57.604024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049327a9-14a5-402c-a9b4-9cb09904af8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:57.604847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049327a9-14a5-402c-a9b4-9cb09904af8d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:57.605434 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049327a9-14a5-402c-a9b4-9cb09904af8d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:57.605877 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049327a9-14a5-402c-a9b4-9cb09904af8d None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:57.607094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049327a9-14a5-402c-a9b4-9cb09904af8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:57.607412 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049327a9-14a5-402c-a9b4-9cb09904af8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:57.608820 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049327a9-14a5-402c-a9b4-9cb09904af8d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:57.627713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 454/898] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:15:57.627713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049327a9-14a5-402c-a9b4-9cb09904af8d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:57.676060 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad3fa9-ec71-4ffc-be99-80530d4eac6b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:57.693462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:57.706394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:57.716661 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6187975-7d42-4420-b526-cd1274aea109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:57.717333 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6187975-7d42-4420-b526-cd1274aea109 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:57.717615 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6187975-7d42-4420-b526-cd1274aea109 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:57.717891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6187975-7d42-4420-b526-cd1274aea109 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:57.718606 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6187975-7d42-4420-b526-cd1274aea109 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:57.718912 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6187975-7d42-4420-b526-cd1274aea109 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:57.720291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6187975-7d42-4420-b526-cd1274aea109 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:57.725795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 445/899] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:15:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:57.726419 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6187975-7d42-4420-b526-cd1274aea109 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:57.754783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049327a9-14a5-402c-a9b4-9cb09904af8d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:57.789341 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffbdb9-45d6-432a-96da-78e9b01c8ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:57.790010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffbdb9-45d6-432a-96da-78e9b01c8ed2 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:57.790286 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffbdb9-45d6-432a-96da-78e9b01c8ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:57.790561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffbdb9-45d6-432a-96da-78e9b01c8ed2 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:57.791271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffbdb9-45d6-432a-96da-78e9b01c8ed2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:57.792734 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffbdb9-45d6-432a-96da-78e9b01c8ed2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:57.807242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 455/900] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 03:15:57 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:15:57.809586 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffbdb9-45d6-432a-96da-78e9b01c8ed2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:57.833963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6187975-7d42-4420-b526-cd1274aea109 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:57.882347 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06940c-dc66-41ab-a826-3a0296b5245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:57.883070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06940c-dc66-41ab-a826-3a0296b5245a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:57.883351 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06940c-dc66-41ab-a826-3a0296b5245a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:57.883827 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06940c-dc66-41ab-a826-3a0296b5245a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:57.891448 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06940c-dc66-41ab-a826-3a0296b5245a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:57.893486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06940c-dc66-41ab-a826-3a0296b5245a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:57.908869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-5e06940c-dc66-41ab-a826-3a0296b5245a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:57.908869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:57.908869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:57.908869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:57.908869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:57.908869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:57.908869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:57.908869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:57.908869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:57.908869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:57.908869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:57.908869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:57.908869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:15:57.908869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:15:57.908869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:15:57.909884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:15:57.909884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:57.909884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:57.909884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:57.909884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:57.909884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:57.909884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:57.909884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:57.909884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:57.909884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:57.909884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:57.909884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:57.909884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:57.909884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:57.909884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:57.909884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:57.909884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:57.910742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:15:57.910742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:15:57.910742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:15:57.910742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:15:57.910742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:15:57.910742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:15:57.910742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:15:57.910742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:15:57.910742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 446/901] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:15:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:57.911726 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b259b3-0c9e-40e5-b308-29337f58a06c None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:57.911726 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b259b3-0c9e-40e5-b308-29337f58a06c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:57.911906 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b259b3-0c9e-40e5-b308-29337f58a06c None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:57.913404 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 447/902] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:57.918362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b259b3-0c9e-40e5-b308-29337f58a06c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:57.933675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffbdb9-45d6-432a-96da-78e9b01c8ed2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:57.959145 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:57.962385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:57.975162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38494147-4aff-441b-8b7c-a3fb010937bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:57.975835 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38494147-4aff-441b-8b7c-a3fb010937bd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:57.976117 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38494147-4aff-441b-8b7c-a3fb010937bd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:57.976384 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38494147-4aff-441b-8b7c-a3fb010937bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:57.977879 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38494147-4aff-441b-8b7c-a3fb010937bd None admin] RBAC: Adding query filter params (interface=public, service_id=603d73db75c94a78aca1fe627ed050c9, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:57.977879 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38494147-4aff-441b-8b7c-a3fb010937bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:57.979574 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38494147-4aff-441b-8b7c-a3fb010937bd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:57.987766 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 456/903] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Jul 12 03:15:57 2022] GET /identity/v3/endpoints?service_id=603d73db75c94a78aca1fe627ed050c9&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:57.989112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175dc59-5cf9-4852-9576-10001f12cce7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:57.989399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175dc59-5cf9-4852-9576-10001f12cce7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:57.989680 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175dc59-5cf9-4852-9576-10001f12cce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:58.006693 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3175dc59-5cf9-4852-9576-10001f12cce7 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:58.007894 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3175dc59-5cf9-4852-9576-10001f12cce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:58.040493 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b259b3-0c9e-40e5-b308-29337f58a06c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:58.075709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d707811-c1d1-4ea2-a980-3c14283c5420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:58.076378 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d707811-c1d1-4ea2-a980-3c14283c5420 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:58.076708 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d707811-c1d1-4ea2-a980-3c14283c5420 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:58.076983 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d707811-c1d1-4ea2-a980-3c14283c5420 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:58.077775 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d707811-c1d1-4ea2-a980-3c14283c5420 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:58.078081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d707811-c1d1-4ea2-a980-3c14283c5420 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:58.084743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 457/904] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:15:58.084743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175dc59-5cf9-4852-9576-10001f12cce7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:58.084968 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d707811-c1d1-4ea2-a980-3c14283c5420 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:58.096552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 448/905] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:15:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:58.102078 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d707811-c1d1-4ea2-a980-3c14283c5420 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:58.196312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175dc59-5cf9-4852-9576-10001f12cce7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:58.199702 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:58.205945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d707811-c1d1-4ea2-a980-3c14283c5420 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:58.213302 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:58.231949 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21c14c-bffc-479c-ae44-08c7a3a4d3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:58.232662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21c14c-bffc-479c-ae44-08c7a3a4d3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:58.232934 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21c14c-bffc-479c-ae44-08c7a3a4d3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:58.233210 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21c14c-bffc-479c-ae44-08c7a3a4d3c2 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:58.233903 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21c14c-bffc-479c-ae44-08c7a3a4d3c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:58.235281 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21c14c-bffc-479c-ae44-08c7a3a4d3c2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:58.249064 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 458/906] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 03:15:58 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:15:58.249064 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21c14c-bffc-479c-ae44-08c7a3a4d3c2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:58.249396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f35e3-ef91-4020-af77-64e6f4b86403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:58.249396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f35e3-ef91-4020-af77-64e6f4b86403 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:58.249396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f35e3-ef91-4020-af77-64e6f4b86403 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:58.249396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f35e3-ef91-4020-af77-64e6f4b86403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:58.249742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f35e3-ef91-4020-af77-64e6f4b86403 None admin] RBAC: Adding query filter params (role.id=e85eb3b871ec47ddaf83b195c9d4e9db, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=e23aea853cce44698b19d6bc087093c1) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:58.249742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f35e3-ef91-4020-af77-64e6f4b86403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:58.249742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f35e3-ef91-4020-af77-64e6f4b86403 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:58.256414 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 449/907] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:15:58 2022] GET /identity/v3/role_assignments?user.id=e23aea853cce44698b19d6bc087093c1&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=e85eb3b871ec47ddaf83b195c9d4e9db => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:58.382419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21c14c-bffc-479c-ae44-08c7a3a4d3c2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:58.423826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dbe3a-c668-4da8-a6d6-d0e5b0727250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:58.424695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dbe3a-c668-4da8-a6d6-d0e5b0727250 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:58.424966 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dbe3a-c668-4da8-a6d6-d0e5b0727250 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:58.425234 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dbe3a-c668-4da8-a6d6-d0e5b0727250 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:58.425891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dbe3a-c668-4da8-a6d6-d0e5b0727250 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:58.427271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dbe3a-c668-4da8-a6d6-d0e5b0727250 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:58.439711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1e6dbe3a-c668-4da8-a6d6-d0e5b0727250 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 03:15:58.439711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:58.439711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:15:58.439711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:15:58.439711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:15:58.439711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:15:58.439711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:15:58.439711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:58.439711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 03:15:58.439711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:58.439711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:15:58.439711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:58.439711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:15:58.439711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:15:58.439711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:15:58.439711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:15:58.440867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:15:58.440867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:15:58.440867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:15:58.440867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:15:58.440867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:15:58.440867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:15:58.440867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:15:58.440867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:15:58.440867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:15:58.440867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:15:58.440867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:15:58.440867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:15:58.440867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:15:58.440867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:15:58.440867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:15:58.440867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:15:58.441849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:15:58.441849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:15:58.441849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:15:58.441849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:15:58.441849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:15:58.441849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:15:58.441849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:15:58.441849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:15:58.441849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:15:58.441849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:15:58.441849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:15:58.441849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:15:58.441849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:15:58.441849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 03:15:58.441849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:15:58.441849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 459/908] 10.222.0.26 () {56 vars in 1132 bytes} [Tue Jul 12 03:15:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:15:58.447077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f35e3-ef91-4020-af77-64e6f4b86403 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:58.553512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f35e3-ef91-4020-af77-64e6f4b86403 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:58.588313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c31b72-315a-4ba3-94b6-1793dea9ec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:58.589916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c31b72-315a-4ba3-94b6-1793dea9ec1a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:58.590400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c31b72-315a-4ba3-94b6-1793dea9ec1a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:58.590870 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c31b72-315a-4ba3-94b6-1793dea9ec1a None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:58.591806 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c31b72-315a-4ba3-94b6-1793dea9ec1a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:58.592311 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c31b72-315a-4ba3-94b6-1793dea9ec1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:58.593899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c31b72-315a-4ba3-94b6-1793dea9ec1a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:58.600053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 450/909] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 03:15:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:58.606033 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dbe3a-c668-4da8-a6d6-d0e5b0727250 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:58.659210 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:58.716768 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dbe3a-c668-4da8-a6d6-d0e5b0727250 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:58.752383 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f4152-2ed8-4581-ad44-783cf7f48ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:58.753082 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f4152-2ed8-4581-ad44-783cf7f48ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:58.753359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f4152-2ed8-4581-ad44-783cf7f48ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:58.753629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f4152-2ed8-4581-ad44-783cf7f48ce4 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:58.754344 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f4152-2ed8-4581-ad44-783cf7f48ce4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:58.754644 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f4152-2ed8-4581-ad44-783cf7f48ce4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:58.756012 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f4152-2ed8-4581-ad44-783cf7f48ce4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:58.761627 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 460/910] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 03:15:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:58.767512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c31b72-315a-4ba3-94b6-1793dea9ec1a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:58.800980 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:58.872754 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c31b72-315a-4ba3-94b6-1793dea9ec1a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:58.909861 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f1a70-a33c-409a-b0df-d1871ae5f455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:58.910540 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f1a70-a33c-409a-b0df-d1871ae5f455 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:58.910819 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f1a70-a33c-409a-b0df-d1871ae5f455 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:58.911093 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f1a70-a33c-409a-b0df-d1871ae5f455 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:58.911885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f1a70-a33c-409a-b0df-d1871ae5f455 None admin] RBAC: Adding query filter params (interface=public, service_id=215eca0a752d4a84a10d620c19ec352e, region_id=RegionOne) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:15:58.912191 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f1a70-a33c-409a-b0df-d1871ae5f455 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:58.913603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f1a70-a33c-409a-b0df-d1871ae5f455 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:58.920057 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 451/911] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Jul 12 03:15:58 2022] GET /identity/v3/endpoints?service_id=215eca0a752d4a84a10d620c19ec352e&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:15:58.925737 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f4152-2ed8-4581-ad44-783cf7f48ce4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:15:59.035395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f4152-2ed8-4581-ad44-783cf7f48ce4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:15:59.044771 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:15:59.072396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1014a-2c98-4e7d-be01-4724514331c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:15:59.073579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1014a-2c98-4e7d-be01-4724514331c4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:59.074111 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1014a-2c98-4e7d-be01-4724514331c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:59.074609 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1014a-2c98-4e7d-be01-4724514331c4 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:59.075484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1014a-2c98-4e7d-be01-4724514331c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:15:59.077092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1014a-2c98-4e7d-be01-4724514331c4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:15:59.083740 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 461/912] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 03:15:58 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:15:59.879950 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ba6db-a4f4-4ea6-8b6f-4e4174036ed7 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:59.880859 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ba6db-a4f4-4ea6-8b6f-4e4174036ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:59.881273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ba6db-a4f4-4ea6-8b6f-4e4174036ed7 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:59.883020 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 452/913] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:15:59.888862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17885243-1082-4c21-a3e9-14f5c919b412 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:15:59.889417 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17885243-1082-4c21-a3e9-14f5c919b412 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:15:59.889903 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17885243-1082-4c21-a3e9-14f5c919b412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:15:59.907246 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-17885243-1082-4c21-a3e9-14f5c919b412 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:15:59.908785 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-17885243-1082-4c21-a3e9-14f5c919b412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:15:59.983166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 462/914] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:15:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:00.005301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ba6db-a4f4-4ea6-8b6f-4e4174036ed7 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:00.099697 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:00.113085 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ba6db-a4f4-4ea6-8b6f-4e4174036ed7 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:00.148253 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77655558-c78c-4e93-a576-0b8c74911cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:00.149100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77655558-c78c-4e93-a576-0b8c74911cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:00.149381 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77655558-c78c-4e93-a576-0b8c74911cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:00.149658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77655558-c78c-4e93-a576-0b8c74911cb8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:00.150315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77655558-c78c-4e93-a576-0b8c74911cb8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:00.151687 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77655558-c78c-4e93-a576-0b8c74911cb8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:00.164065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-77655558-c78c-4e93-a576-0b8c74911cb8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 03:16:00.164065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:00.164065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:16:00.164065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:16:00.164065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:16:00.164065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:16:00.164065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:16:00.164065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:00.164065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 03:16:00.164065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:00.164065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:16:00.164065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:00.164065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:00.164065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:00.164065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:00.164065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:00.164065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:00.165193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:00.165193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:00.165193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:00.165193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:00.165193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:00.165193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:00.165193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:16:00.165193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:16:00.165193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:16:00.165193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:16:00.165193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:00.165193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:00.165193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:00.165193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:00.165193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:00.165193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:00.166095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:00.166095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:00.166095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:00.166095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:00.166095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:00.166095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:00.166095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:00.166095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:00.166095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:00.166095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:00.166095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:16:00.166095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:00.166095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 03:16:00.166095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:00.166095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 453/915] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 03:16:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:00.173657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17885243-1082-4c21-a3e9-14f5c919b412 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:00.284002 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17885243-1082-4c21-a3e9-14f5c919b412 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:00.285582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:00.320390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d2fec-d1f0-49f0-bcc0-f44baab3b523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:00.321086 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2fec-d1f0-49f0-bcc0-f44baab3b523 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:00.321390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2fec-d1f0-49f0-bcc0-f44baab3b523 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:00.321631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2fec-d1f0-49f0-bcc0-f44baab3b523 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:00.322404 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d2fec-d1f0-49f0-bcc0-f44baab3b523 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:00.322700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d2fec-d1f0-49f0-bcc0-f44baab3b523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:00.324107 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d2fec-d1f0-49f0-bcc0-f44baab3b523 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:00.329786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 463/916] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 03:16:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:00.335354 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77655558-c78c-4e93-a576-0b8c74911cb8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:00.338386 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccc0df-872b-44de-8990-e12d0951fcfc None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:00.338669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccc0df-872b-44de-8990-e12d0951fcfc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:00.338948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccc0df-872b-44de-8990-e12d0951fcfc None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:00.340631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 464/917] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:00.346088 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef10bb-7c08-472a-8c39-341409f10a65 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:00.346367 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef10bb-7c08-472a-8c39-341409f10a65 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:00.346637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef10bb-7c08-472a-8c39-341409f10a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:00.363752 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-95ef10bb-7c08-472a-8c39-341409f10a65 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:00.364963 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-95ef10bb-7c08-472a-8c39-341409f10a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:00.439697 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 465/918] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 03:16:00.442933 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77655558-c78c-4e93-a576-0b8c74911cb8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:00.445876 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2da7-9074-4312-a01a-ace308320e73 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:00.446198 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2da7-9074-4312-a01a-ace308320e73 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:00.446419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2da7-9074-4312-a01a-ace308320e73 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:00.451918 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 466/919] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:00.453869 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c212bf0-6b02-405b-bd61-78ab3242332a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:00.454741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c212bf0-6b02-405b-bd61-78ab3242332a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:00.455196 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c212bf0-6b02-405b-bd61-78ab3242332a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:00.475029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3c212bf0-6b02-405b-bd61-78ab3242332a None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:00.476466 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3c212bf0-6b02-405b-bd61-78ab3242332a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:00.479697 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f43ca0-86cc-4d9f-914b-4a27310bb146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:00.480460 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f43ca0-86cc-4d9f-914b-4a27310bb146 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:00.480755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f43ca0-86cc-4d9f-914b-4a27310bb146 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:00.481023 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f43ca0-86cc-4d9f-914b-4a27310bb146 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:00.481723 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f43ca0-86cc-4d9f-914b-4a27310bb146 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:00.482045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f43ca0-86cc-4d9f-914b-4a27310bb146 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:00.483369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f43ca0-86cc-4d9f-914b-4a27310bb146 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:00.492547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 454/920] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 03:16:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:00.492547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f43ca0-86cc-4d9f-914b-4a27310bb146 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:00.510334 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:00.548632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 467/921] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:00.549743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c212bf0-6b02-405b-bd61-78ab3242332a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:00.576509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:00.607767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f43ca0-86cc-4d9f-914b-4a27310bb146 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:00.642978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c569c2d-ff48-42c2-af4c-686f1c4160a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:00.643796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c569c2d-ff48-42c2-af4c-686f1c4160a8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:00.644077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c569c2d-ff48-42c2-af4c-686f1c4160a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:00.644347 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c569c2d-ff48-42c2-af4c-686f1c4160a8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:00.645047 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c569c2d-ff48-42c2-af4c-686f1c4160a8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:00.646429 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c569c2d-ff48-42c2-af4c-686f1c4160a8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:00.653912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c212bf0-6b02-405b-bd61-78ab3242332a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:00.658327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-8c569c2d-ff48-42c2-af4c-686f1c4160a8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 03:16:00.658327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:00.658327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:16:00.658327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:16:00.658327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:16:00.658327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:16:00.658327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:16:00.658327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:00.658327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 03:16:00.658327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:00.658327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:16:00.658327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:00.658327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:00.658327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:00.658327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:00.658327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:00.658327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:00.659280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:00.659280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:00.659280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:00.659280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:00.659280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:00.659280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:00.659280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:16:00.659280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:16:00.659280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:16:00.659280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:16:00.659280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:00.659280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:00.659280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:00.659280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:00.659280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:00.659280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:00.665843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:00.665843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:00.665843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:00.665843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:00.665843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:00.665843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:00.665843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:00.665843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:00.665843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:00.665843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:00.665843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:16:00.665843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:00.665843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 03:16:00.665843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:00.665843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 455/922] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:16:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:00.666631 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c569c2d-ff48-42c2-af4c-686f1c4160a8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:00.693710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05823174-67ba-4273-9381-ab712ef0650d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:00.694370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05823174-67ba-4273-9381-ab712ef0650d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:00.694717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05823174-67ba-4273-9381-ab712ef0650d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:00.694906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05823174-67ba-4273-9381-ab712ef0650d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:00.695700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05823174-67ba-4273-9381-ab712ef0650d None admin] RBAC: Adding query filter params (interface=public, service_id=e00a18dd90574fae84f403191f92b0ad, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:00.696005 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05823174-67ba-4273-9381-ab712ef0650d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:00.697477 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05823174-67ba-4273-9381-ab712ef0650d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:00.707189 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 468/923] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Jul 12 03:16:00 2022] GET /identity/v3/endpoints?service_id=e00a18dd90574fae84f403191f92b0ad&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:00.708074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05823174-67ba-4273-9381-ab712ef0650d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:00.760216 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:00.780224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c569c2d-ff48-42c2-af4c-686f1c4160a8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:00.802323 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:00.813365 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05823174-67ba-4273-9381-ab712ef0650d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:00.818899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c821dd5-8bfe-4c5e-9c8a-499aabcd895b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:00.819965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c821dd5-8bfe-4c5e-9c8a-499aabcd895b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:00.820426 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c821dd5-8bfe-4c5e-9c8a-499aabcd895b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:00.821029 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c821dd5-8bfe-4c5e-9c8a-499aabcd895b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:00.832909 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c821dd5-8bfe-4c5e-9c8a-499aabcd895b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:16:00.844299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-4c821dd5-8bfe-4c5e-9c8a-499aabcd895b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 03:16:00.844299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:00.844299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:00.844299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:00.844299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:00.844299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:00.844299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:00.844299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:00.844299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:00.844299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:00.844299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:00.844299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:00.844299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:16:00.844299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:16:00.844299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:16:00.844299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:16:00.845301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:16:00.845301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:16:00.845301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:16:00.845301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:16:00.845301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:00.845301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:00.845301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:00.845301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:00.845301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:00.845301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:00.845301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:00.845301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:00.845301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:00.845301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:00.845301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:00.845301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:00.846468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:00.846468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:00.846468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:00.846468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:00.846468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:16:00.846468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:16:00.846468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:16:00.846468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:16:00.846468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:16:00.846468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:16:00.846468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 03:16:00.846468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:00.846468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 456/924] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Jul 12 03:16:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:00.847173 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c821dd5-8bfe-4c5e-9c8a-499aabcd895b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:00.853205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed21ad4-1e29-44fd-8441-142d6f29b7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:00.853907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21ad4-1e29-44fd-8441-142d6f29b7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:00.854187 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21ad4-1e29-44fd-8441-142d6f29b7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:00.854470 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21ad4-1e29-44fd-8441-142d6f29b7f0 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:00.855230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed21ad4-1e29-44fd-8441-142d6f29b7f0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:00.855532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed21ad4-1e29-44fd-8441-142d6f29b7f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:00.857388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed21ad4-1e29-44fd-8441-142d6f29b7f0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:00.863176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 469/925] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:16:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:00.865374 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed21ad4-1e29-44fd-8441-142d6f29b7f0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:00.956877 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c821dd5-8bfe-4c5e-9c8a-499aabcd895b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:00.971910 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed21ad4-1e29-44fd-8441-142d6f29b7f0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:00.993112 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24827670-99d0-4cc9-ad16-c4a60bf040d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:00.993427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24827670-99d0-4cc9-ad16-c4a60bf040d8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:00.993725 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24827670-99d0-4cc9-ad16-c4a60bf040d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:00.993999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24827670-99d0-4cc9-ad16-c4a60bf040d8 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:00.994660 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24827670-99d0-4cc9-ad16-c4a60bf040d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:00.996114 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24827670-99d0-4cc9-ad16-c4a60bf040d8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:01.002550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 457/926] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 03:16:00 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:16:01.003330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24827670-99d0-4cc9-ad16-c4a60bf040d8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:01.014403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:01.020379 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232b3dc-4bd7-4726-aab9-4fd45339c667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:01.021480 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232b3dc-4bd7-4726-aab9-4fd45339c667 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:01.022130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232b3dc-4bd7-4726-aab9-4fd45339c667 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:01.022607 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232b3dc-4bd7-4726-aab9-4fd45339c667 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:01.024436 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232b3dc-4bd7-4726-aab9-4fd45339c667 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:01.024943 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232b3dc-4bd7-4726-aab9-4fd45339c667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:01.026646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232b3dc-4bd7-4726-aab9-4fd45339c667 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:01.037383 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 470/927] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Jul 12 03:16:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:01.042907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232b3dc-4bd7-4726-aab9-4fd45339c667 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:01.072237 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:01.140956 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24827670-99d0-4cc9-ad16-c4a60bf040d8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:01.184482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0581aba-0954-417c-af11-150a0744679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:01.185152 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0581aba-0954-417c-af11-150a0744679d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:01.185431 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0581aba-0954-417c-af11-150a0744679d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:01.185731 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0581aba-0954-417c-af11-150a0744679d None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:01.186457 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0581aba-0954-417c-af11-150a0744679d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:01.186756 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0581aba-0954-417c-af11-150a0744679d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:01.188110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0581aba-0954-417c-af11-150a0744679d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:01.194692 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 458/928] 10.222.0.26 () {56 vars in 1114 bytes} [Tue Jul 12 03:16:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:01.195897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33c227-118a-426a-bf40-54e933feeb96 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:01.196204 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33c227-118a-426a-bf40-54e933feeb96 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:01.196348 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232b3dc-4bd7-4726-aab9-4fd45339c667 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:01.196780 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33c227-118a-426a-bf40-54e933feeb96 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:01.198256 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 459/929] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:01.202136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33c227-118a-426a-bf40-54e933feeb96 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:01.234970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99094f-c27f-4fb2-898e-a8a114d10b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:01.235770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99094f-c27f-4fb2-898e-a8a114d10b55 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:01.236046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99094f-c27f-4fb2-898e-a8a114d10b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:01.236309 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99094f-c27f-4fb2-898e-a8a114d10b55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:01.248176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99094f-c27f-4fb2-898e-a8a114d10b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:01.249689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99094f-c27f-4fb2-898e-a8a114d10b55 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:01.267109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4a99094f-c27f-4fb2-898e-a8a114d10b55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:01.267109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:01.267109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:01.267109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:01.267109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:01.267109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:01.267109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:01.267109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:01.267109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:01.267109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:01.267109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:01.267109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:01.267109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:16:01.267109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:16:01.267109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:16:01.268205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:16:01.268205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:01.268205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:01.268205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:01.268205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:01.268205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:01.268205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:01.268205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:01.268205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:01.268205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:01.268205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:01.268205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:01.268205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:01.268205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:01.268205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:01.268205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:01.268205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:01.269332 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:16:01.269332 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:16:01.269332 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:01.269332 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:01.269332 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 471/930] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:01.269832 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59013788-fcb1-46a5-8315-5dc6771f29d8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:01.270110 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59013788-fcb1-46a5-8315-5dc6771f29d8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:01.270376 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59013788-fcb1-46a5-8315-5dc6771f29d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:01.275331 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:01.296733 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-59013788-fcb1-46a5-8315-5dc6771f29d8 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:01.297943 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-59013788-fcb1-46a5-8315-5dc6771f29d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:01.313263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33c227-118a-426a-bf40-54e933feeb96 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:01.349788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad0e03-0528-474f-a195-ea96f5a71236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:01.350366 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0e03-0528-474f-a195-ea96f5a71236 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:01.350628 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0e03-0528-474f-a195-ea96f5a71236 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:01.350897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0e03-0528-474f-a195-ea96f5a71236 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:01.351631 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad0e03-0528-474f-a195-ea96f5a71236 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:01.353040 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad0e03-0528-474f-a195-ea96f5a71236 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:01.366205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:01.373510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 472/931] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:01.374397 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59013788-fcb1-46a5-8315-5dc6771f29d8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:01.388268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 460/932] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 03:16:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:16:01.401428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad0e03-0528-474f-a195-ea96f5a71236 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:01.489404 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59013788-fcb1-46a5-8315-5dc6771f29d8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:01.542970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7331364-224a-4698-a372-c02f7a94fe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:01.544025 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7331364-224a-4698-a372-c02f7a94fe25 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:01.544507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7331364-224a-4698-a372-c02f7a94fe25 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:01.545004 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7331364-224a-4698-a372-c02f7a94fe25 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:01.545384 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad0e03-0528-474f-a195-ea96f5a71236 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:01.546123 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7331364-224a-4698-a372-c02f7a94fe25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:01.546596 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7331364-224a-4698-a372-c02f7a94fe25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:01.549169 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7331364-224a-4698-a372-c02f7a94fe25 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:01.566707 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 473/933] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:01.572898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7331364-224a-4698-a372-c02f7a94fe25 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:01.579447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:01.594944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe65b2c-711f-4077-b00c-23f7844e0b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:01.596122 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe65b2c-711f-4077-b00c-23f7844e0b5e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:01.596403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe65b2c-711f-4077-b00c-23f7844e0b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:01.596712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe65b2c-711f-4077-b00c-23f7844e0b5e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:01.597490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe65b2c-711f-4077-b00c-23f7844e0b5e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:01.598994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe65b2c-711f-4077-b00c-23f7844e0b5e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:01.614231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-dfe65b2c-711f-4077-b00c-23f7844e0b5e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 03:16:01.614231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:01.614231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:16:01.614231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:16:01.614231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:16:01.614231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:16:01.614231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:16:01.614231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:01.614231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 03:16:01.614231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:01.614231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:16:01.614231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:01.614231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:01.614231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:01.614231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:01.614231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:01.615161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:01.615161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:01.615161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:01.615161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:01.615161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:01.615161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:01.615161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:01.615161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:16:01.615161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:16:01.615161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:16:01.615161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:16:01.615161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:01.615161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:01.615161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:01.615161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:01.615161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:01.615988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:01.615988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:01.615988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:01.615988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:01.615988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:01.615988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:01.615988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:01.615988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:01.615988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:01.615988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:01.615988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:01.615988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:16:01.615988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:01.615988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 03:16:01.615988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:01.615988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 461/934] 10.222.0.26 () {56 vars in 1132 bytes} [Tue Jul 12 03:16:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:16:01.623199 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe65b2c-711f-4077-b00c-23f7844e0b5e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:01.651464 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:01.720348 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7331364-224a-4698-a372-c02f7a94fe25 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:01.749858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe65b2c-711f-4077-b00c-23f7844e0b5e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:01.770040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43812f24-1216-403a-81ff-1108e182ae82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:01.771696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43812f24-1216-403a-81ff-1108e182ae82 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:01.772173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43812f24-1216-403a-81ff-1108e182ae82 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:01.772991 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43812f24-1216-403a-81ff-1108e182ae82 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:01.784202 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43812f24-1216-403a-81ff-1108e182ae82 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:01.785721 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c3fb2-8067-48a4-bb49-e90ece2af761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:01.786234 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43812f24-1216-403a-81ff-1108e182ae82 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:01.786526 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c3fb2-8067-48a4-bb49-e90ece2af761 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:01.786880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c3fb2-8067-48a4-bb49-e90ece2af761 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:01.787234 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c3fb2-8067-48a4-bb49-e90ece2af761 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:01.788084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c3fb2-8067-48a4-bb49-e90ece2af761 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:01.788589 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c3fb2-8067-48a4-bb49-e90ece2af761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:01.790430 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c3fb2-8067-48a4-bb49-e90ece2af761 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:01.800550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 462/935] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 03:16:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:01.801585 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c3fb2-8067-48a4-bb49-e90ece2af761 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:01.804849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-43812f24-1216-403a-81ff-1108e182ae82 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 03:16:01.804849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:01.804849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:01.804849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:01.804849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:01.804849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:01.804849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:01.804849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:01.804849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:01.804849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:01.804849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:01.804849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:01.804849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:16:01.804849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:16:01.804849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:16:01.804849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:01.805764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:01.806728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:01.806728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:01.806728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:16:01.806728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:16:01.806728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:16:01.806728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:16:01.806728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:16:01.806728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:16:01.806728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 03:16:01.806728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:01.810124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 474/936] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 03:16:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:16:01.815330 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43812f24-1216-403a-81ff-1108e182ae82 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:01.862021 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:01.917163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c3fb2-8067-48a4-bb49-e90ece2af761 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:01.941825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43812f24-1216-403a-81ff-1108e182ae82 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:01.954578 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff7c43-8ccf-4e89-a5a2-52a6f549bf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:01.955608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff7c43-8ccf-4e89-a5a2-52a6f549bf76 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:01.956118 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff7c43-8ccf-4e89-a5a2-52a6f549bf76 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:01.956615 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff7c43-8ccf-4e89-a5a2-52a6f549bf76 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:01.957588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff7c43-8ccf-4e89-a5a2-52a6f549bf76 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:01.958560 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff7c43-8ccf-4e89-a5a2-52a6f549bf76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:01.958804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:01.960345 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff7c43-8ccf-4e89-a5a2-52a6f549bf76 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:01.971971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 463/937] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 03:16:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:01.973143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff7c43-8ccf-4e89-a5a2-52a6f549bf76 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:01.983629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a733b-2ce2-46dc-bf5f-d09940aa90a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:01.984307 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a733b-2ce2-46dc-bf5f-d09940aa90a5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:01.984622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a733b-2ce2-46dc-bf5f-d09940aa90a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:01.984896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a733b-2ce2-46dc-bf5f-d09940aa90a5 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:01.985741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a733b-2ce2-46dc-bf5f-d09940aa90a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:01.986465 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a733b-2ce2-46dc-bf5f-d09940aa90a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:01.988319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a733b-2ce2-46dc-bf5f-d09940aa90a5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:02.012607 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 475/938] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Jul 12 03:16:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:02.018693 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a733b-2ce2-46dc-bf5f-d09940aa90a5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:02.091751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff7c43-8ccf-4e89-a5a2-52a6f549bf76 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:02.116675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:02.135915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a430d68-4efc-4008-9e4a-3423c5989e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:02.137134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a430d68-4efc-4008-9e4a-3423c5989e54 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:02.137425 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a430d68-4efc-4008-9e4a-3423c5989e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:02.137702 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a430d68-4efc-4008-9e4a-3423c5989e54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:02.138470 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a430d68-4efc-4008-9e4a-3423c5989e54 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:02.139868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a430d68-4efc-4008-9e4a-3423c5989e54 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:02.159752 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a733b-2ce2-46dc-bf5f-d09940aa90a5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:02.171685 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 464/939] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 03:16:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:16:02.205361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72e679-c3bd-4ccf-8743-a4a987bdaaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:02.206207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72e679-c3bd-4ccf-8743-a4a987bdaaab None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:02.206492 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72e679-c3bd-4ccf-8743-a4a987bdaaab None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:02.206808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72e679-c3bd-4ccf-8743-a4a987bdaaab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:02.219337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72e679-c3bd-4ccf-8743-a4a987bdaaab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:02.221226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72e679-c3bd-4ccf-8743-a4a987bdaaab None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:02.241469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-db72e679-c3bd-4ccf-8743-a4a987bdaaab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:02.241469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:02.241469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:02.241469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:02.241469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:02.241469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:02.241469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:02.241469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:02.241469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:02.241469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:02.241469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:02.241469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:02.241469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:16:02.241469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:16:02.241469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:16:02.242479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:16:02.242479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:02.242479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:02.242479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:02.242479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:02.242479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:02.242479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:02.242479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:02.242479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:02.242479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:02.242479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:02.242479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:02.242479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:02.242479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:02.242479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:02.242479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:02.242479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:02.243358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:16:02.243358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:16:02.243358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:02.243358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:02.243358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 476/940] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:02.250149 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a430d68-4efc-4008-9e4a-3423c5989e54 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:02.358638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a430d68-4efc-4008-9e4a-3423c5989e54 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:02.394023 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7fb31-4937-4ec7-a731-9889d8cb82f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:02.394698 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7fb31-4937-4ec7-a731-9889d8cb82f7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:02.394978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7fb31-4937-4ec7-a731-9889d8cb82f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:02.395253 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7fb31-4937-4ec7-a731-9889d8cb82f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:02.395984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7fb31-4937-4ec7-a731-9889d8cb82f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:02.396289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7fb31-4937-4ec7-a731-9889d8cb82f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:02.397715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7fb31-4937-4ec7-a731-9889d8cb82f7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:02.410518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 465/941] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:02.416167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72e679-c3bd-4ccf-8743-a4a987bdaaab None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:02.438625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:02.519019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72e679-c3bd-4ccf-8743-a4a987bdaaab None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:02.554676 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137081bd-fa82-4ceb-9bed-3af721439b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:02.555489 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137081bd-fa82-4ceb-9bed-3af721439b1d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:02.555767 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137081bd-fa82-4ceb-9bed-3af721439b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:02.556042 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137081bd-fa82-4ceb-9bed-3af721439b1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:02.563396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137081bd-fa82-4ceb-9bed-3af721439b1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:02.564895 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137081bd-fa82-4ceb-9bed-3af721439b1d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:02.579137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-137081bd-fa82-4ceb-9bed-3af721439b1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:16:02.579137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:02.579137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:02.579137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:02.579137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:02.579137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:02.579137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:02.579137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:02.579137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:02.579137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:02.579137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:02.579137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:02.579137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:16:02.579137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:16:02.579137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:16:02.580059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:16:02.580059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:02.580059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:02.580059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:02.580059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:02.580059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:02.580059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:02.580059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:02.580059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:02.580059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:02.580059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:02.580059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:02.580059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:02.580059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:02.580059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:02.580059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:02.580059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:02.581010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:16:02.581010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:16:02.581010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:16:02.581010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:16:02.581010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:16:02.581010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:16:02.581010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:16:02.581010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:02.581010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 477/942] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:16:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:02.587836 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7fb31-4937-4ec7-a731-9889d8cb82f7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:02.630594 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:02.691752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7fb31-4937-4ec7-a731-9889d8cb82f7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:02.727481 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892865f-ad7b-4024-878f-f935fc5350a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:02.728154 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892865f-ad7b-4024-878f-f935fc5350a1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:02.728430 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892865f-ad7b-4024-878f-f935fc5350a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:02.728723 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892865f-ad7b-4024-878f-f935fc5350a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:02.729510 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892865f-ad7b-4024-878f-f935fc5350a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:02.729841 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892865f-ad7b-4024-878f-f935fc5350a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:02.731354 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892865f-ad7b-4024-878f-f935fc5350a1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:02.743600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 466/943] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:16:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:02.753609 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137081bd-fa82-4ceb-9bed-3af721439b1d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:02.838018 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:02.857744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137081bd-fa82-4ceb-9bed-3af721439b1d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:02.892605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8f954-5d0c-4bab-961b-4c40aa3ce2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:02.893515 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8f954-5d0c-4bab-961b-4c40aa3ce2f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:02.893795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8f954-5d0c-4bab-961b-4c40aa3ce2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:02.894067 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8f954-5d0c-4bab-961b-4c40aa3ce2f3 None admin] PATH_INFO: `/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/e23aea853cce44698b19d6bc087093c1/roles/e85eb3b871ec47ddaf83b195c9d4e9db` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:02.896303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8f954-5d0c-4bab-961b-4c40aa3ce2f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=afd5f89a049d40dc8456bd351f01f603, user_id=e23aea853cce44698b19d6bc087093c1, role_id=e85eb3b871ec47ddaf83b195c9d4e9db)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:02.897824 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8f954-5d0c-4bab-961b-4c40aa3ce2f3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:02.919068 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 478/944] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:16:02 2022] PUT /identity/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/e23aea853cce44698b19d6bc087093c1/roles/e85eb3b871ec47ddaf83b195c9d4e9db => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:16:03.138256 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7f411-ed38-4e9b-a60a-7f7b4c3cb814 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:03.138829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7f411-ed38-4e9b-a60a-7f7b4c3cb814 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:03.138932 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7f411-ed38-4e9b-a60a-7f7b4c3cb814 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:03.140686 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 467/945] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:03.146164 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3a0e7-0594-4064-bd90-797ed15f49be None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:03.146527 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3a0e7-0594-4064-bd90-797ed15f49be None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:03.146874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3a0e7-0594-4064-bd90-797ed15f49be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:03.163900 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-fae3a0e7-0594-4064-bd90-797ed15f49be None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:03.165135 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fae3a0e7-0594-4064-bd90-797ed15f49be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:03.239356 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 479/946] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:03.262489 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7f411-ed38-4e9b-a60a-7f7b4c3cb814 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:03.364334 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:03.375489 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7f411-ed38-4e9b-a60a-7f7b4c3cb814 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:03.413325 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949773d-4087-4e0c-abc5-0d382fbdf3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:03.414127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949773d-4087-4e0c-abc5-0d382fbdf3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:03.414410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949773d-4087-4e0c-abc5-0d382fbdf3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:03.414686 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949773d-4087-4e0c-abc5-0d382fbdf3b5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:03.415352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949773d-4087-4e0c-abc5-0d382fbdf3b5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:03.416893 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949773d-4087-4e0c-abc5-0d382fbdf3b5 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:03.429862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-4949773d-4087-4e0c-abc5-0d382fbdf3b5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 03:16:03.429862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:03.429862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:16:03.429862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:16:03.429862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:16:03.429862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:16:03.429862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:16:03.429862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:03.429862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 03:16:03.429862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:03.429862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:16:03.429862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:03.429862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:03.429862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:03.429862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:03.429862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:03.429862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:03.431036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:03.431036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:03.431036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:03.431036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:03.431036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:03.431036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:03.431036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:16:03.431036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:16:03.431036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:16:03.431036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:16:03.431036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:03.431036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:03.431036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:03.431036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:03.431036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:03.431036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:03.432035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:03.432035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:03.432035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:03.432035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:03.432035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:03.432035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:03.432035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:03.432035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:03.432035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:03.432035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:03.432035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:16:03.432035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:03.432035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 03:16:03.432035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:03.432035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 468/947] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 03:16:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:03.437692 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3a0e7-0594-4064-bd90-797ed15f49be None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:03.507481 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:03.543720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3a0e7-0594-4064-bd90-797ed15f49be None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:03.554579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f589b7-0d9d-42cc-bb1c-9ce07ed0ffe6 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:03.554871 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f589b7-0d9d-42cc-bb1c-9ce07ed0ffe6 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:03.555150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f589b7-0d9d-42cc-bb1c-9ce07ed0ffe6 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:03.556661 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 469/948] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:16:03.561378 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436469cd-24b1-4227-a948-10bdef90c423 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:03.561668 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436469cd-24b1-4227-a948-10bdef90c423 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:03.563300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436469cd-24b1-4227-a948-10bdef90c423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:03.580739 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-436469cd-24b1-4227-a948-10bdef90c423 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:03.582000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-436469cd-24b1-4227-a948-10bdef90c423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:03.586912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7461472-47d0-47f2-b480-f4bcd8c8239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:03.587588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7461472-47d0-47f2-b480-f4bcd8c8239e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:03.587869 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7461472-47d0-47f2-b480-f4bcd8c8239e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:03.588144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7461472-47d0-47f2-b480-f4bcd8c8239e None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:03.588963 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7461472-47d0-47f2-b480-f4bcd8c8239e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:03.589365 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7461472-47d0-47f2-b480-f4bcd8c8239e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:03.591342 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7461472-47d0-47f2-b480-f4bcd8c8239e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:03.599080 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 480/949] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 03:16:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:03.604155 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7461472-47d0-47f2-b480-f4bcd8c8239e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:03.672385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 470/950] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:03.698802 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436469cd-24b1-4227-a948-10bdef90c423 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:03.726983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7461472-47d0-47f2-b480-f4bcd8c8239e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:03.763730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ec0e5-4566-46ee-bac5-fe406f607887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:03.764956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ec0e5-4566-46ee-bac5-fe406f607887 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:03.765442 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ec0e5-4566-46ee-bac5-fe406f607887 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:03.765914 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ec0e5-4566-46ee-bac5-fe406f607887 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:03.766925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ec0e5-4566-46ee-bac5-fe406f607887 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:03.767431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ec0e5-4566-46ee-bac5-fe406f607887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:03.769133 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ec0e5-4566-46ee-bac5-fe406f607887 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:03.770952 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:03.782400 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 481/951] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 03:16:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:03.783638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ec0e5-4566-46ee-bac5-fe406f607887 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:03.806326 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:03.826411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436469cd-24b1-4227-a948-10bdef90c423 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:03.870448 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7f321-74df-4d78-8295-db69b9626e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:03.871552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7f321-74df-4d78-8295-db69b9626e27 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:03.871835 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7f321-74df-4d78-8295-db69b9626e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:03.872110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7f321-74df-4d78-8295-db69b9626e27 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:03.872964 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7f321-74df-4d78-8295-db69b9626e27 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:03.875194 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7f321-74df-4d78-8295-db69b9626e27 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:03.876879 dv-cinder-847730-4-smb devstack@keystone.service[80397]: WARNING keystone.server.flask.common [None req-c3a7f321-74df-4d78-8295-db69b9626e27 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 03:16:03.897932 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.sql.core [None req-c3a7f321-74df-4d78-8295-db69b9626e27 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 03:16:03.897932 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 03:16:03.897932 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [parameters: {'id': '1a75862d4e9445bd8fa34ea82d5d7006', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 03:16:03.897932 dv-cinder-847730-4-smb devstack@keystone.service[80397]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80397) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 03:16:03.902550 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ec0e5-4566-46ee-bac5-fe406f607887 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:03.908676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-c3a7f321-74df-4d78-8295-db69b9626e27 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1a75862d4e9445bd8fa34ea82d5d7006.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1a75862d4e9445bd8fa34ea82d5d7006. Jul 12 03:16:03.908676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:03.908676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 03:16:03.908676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 03:16:03.908676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 03:16:03.908676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 03:16:03.908676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 03:16:03.908676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 03:16:03.908676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 03:16:03.908676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application conn.query(q) Jul 12 03:16:03.908676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 03:16:03.908676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 03:16:03.908676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application result.read() Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 12 03:16:03.909658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 12 03:16:03.910815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 03:16:03.910815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application next(self.gen) Jul 12 03:16:03.910815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 03:16:03.910815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application yield resource Jul 12 03:16:03.910815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 03:16:03.910815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application next(self.gen) Jul 12 03:16:03.910815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 03:16:03.910815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 03:16:03.910815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 03:16:03.910815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 03:16:03.910815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 03:16:03.910815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise self.value Jul 12 03:16:03.910815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 03:16:03.910815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 03:16:03.910815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 03:16:03.910815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application session.commit() Jul 12 03:16:03.910815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 03:16:03.911929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 03:16:03.911929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 03:16:03.911929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 03:16:03.911929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 03:16:03.911929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.session.flush() Jul 12 03:16:03.911929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 03:16:03.911929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 03:16:03.911929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 03:16:03.911929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 03:16:03.911929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 03:16:03.911929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application compat.raise_( Jul 12 03:16:03.911929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 03:16:03.911929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception Jul 12 03:16:03.911929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 03:16:03.911929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 03:16:03.911929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 03:16:03.911929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 03:16:03.913265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 03:16:03.913265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 03:16:03.913265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 03:16:03.913265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 03:16:03.913265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 03:16:03.913265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 03:16:03.913265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 03:16:03.913265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 03:16:03.913265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 03:16:03.913265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 03:16:03.913265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 03:16:03.913265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 03:16:03.913265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 03:16:03.913265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 03:16:03.913265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 03:16:03.914225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 03:16:03.914225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 03:16:03.914225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception Jul 12 03:16:03.914225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 03:16:03.914225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 03:16:03.914225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 03:16:03.914225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 03:16:03.914225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 03:16:03.914225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 03:16:03.914225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 03:16:03.914225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application conn.query(q) Jul 12 03:16:03.914225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 03:16:03.914225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 03:16:03.914225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 03:16:03.914225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application result.read() Jul 12 03:16:03.914225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 03:16:03.914225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 03:16:03.915285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 03:16:03.915285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 03:16:03.915285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 03:16:03.915285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 03:16:03.915285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 03:16:03.915285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 03:16:03.915285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 03:16:03.915285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 03:16:03.915285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [parameters: {'id': '1a75862d4e9445bd8fa34ea82d5d7006', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 03:16:03.915285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 03:16:03.915285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:03.915285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:16:03.915285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:03.915285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:03.915285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 12 03:16:03.916243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 12 03:16:03.916243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 03:16:03.916243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 03:16:03.916243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 12 03:16:03.916243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:03.916243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:16:03.916243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:03.916243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:03.916243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:03.916243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:03.916243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:03.916243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:03.916243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:03.916243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:03.916243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:03.916243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:03.916243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:03.917619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:03.917619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 12 03:16:03.917619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 12 03:16:03.917619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:03.917619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:03.917619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 12 03:16:03.917619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 12 03:16:03.917619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1a75862d4e9445bd8fa34ea82d5d7006. Jul 12 03:16:03.917619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:03.926913 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 471/952] 10.222.0.26 () {60 vars in 1140 bytes} [Tue Jul 12 03:16:03 2022] POST /identity/v3/projects => generated 262 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:16:03.927767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7f321-74df-4d78-8295-db69b9626e27 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:03.958690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75551331-1615-409c-8bea-9912ede93005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:03.959354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75551331-1615-409c-8bea-9912ede93005 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:03.959635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75551331-1615-409c-8bea-9912ede93005 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:03.959908 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75551331-1615-409c-8bea-9912ede93005 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:03.960730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75551331-1615-409c-8bea-9912ede93005 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:03.962112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75551331-1615-409c-8bea-9912ede93005 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:03.988801 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 482/953] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 03:16:03 2022] POST /identity/v3/endpoints => generated 349 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:16:04.064174 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7f321-74df-4d78-8295-db69b9626e27 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:04.118472 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012bc26-82c7-447d-90fd-d6ef5ad19dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:04.119701 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012bc26-82c7-447d-90fd-d6ef5ad19dbe None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:04.120245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012bc26-82c7-447d-90fd-d6ef5ad19dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:04.120779 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012bc26-82c7-447d-90fd-d6ef5ad19dbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:04.129255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012bc26-82c7-447d-90fd-d6ef5ad19dbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:04.131243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012bc26-82c7-447d-90fd-d6ef5ad19dbe None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:04.133669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:04.148438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-b012bc26-82c7-447d-90fd-d6ef5ad19dbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:16:04.148438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:04.148438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:04.148438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:04.148438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:04.148438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:04.148438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:04.148438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:04.148438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:04.148438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:04.148438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:04.148438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:04.148438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:16:04.148438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:16:04.148438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:16:04.150051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:16:04.150051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:04.150051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:04.150051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:04.150051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:04.150051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:04.150051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:04.150051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:04.150051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:04.150051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:04.150051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:04.150051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:04.150051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:04.150051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:04.150051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:04.150051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:04.150051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:04.151030 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:16:04.151030 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:16:04.151030 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:16:04.151030 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:16:04.151030 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:16:04.151030 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:16:04.151030 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:16:04.151030 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:04.154860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 472/954] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:16:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:04.162867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75551331-1615-409c-8bea-9912ede93005 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:04.222189 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:04.267932 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75551331-1615-409c-8bea-9912ede93005 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:04.303243 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b4259-d0fc-48b6-aafe-73380feca180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:04.303913 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b4259-d0fc-48b6-aafe-73380feca180 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:04.304200 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b4259-d0fc-48b6-aafe-73380feca180 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:04.304472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b4259-d0fc-48b6-aafe-73380feca180 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:04.305264 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b4259-d0fc-48b6-aafe-73380feca180 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:04.305566 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b4259-d0fc-48b6-aafe-73380feca180 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:04.307023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b4259-d0fc-48b6-aafe-73380feca180 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:04.316210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2dc9d-b4c2-4ca7-aa24-baa2fda7f18b None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:04.316491 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2dc9d-b4c2-4ca7-aa24-baa2fda7f18b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:04.316814 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2dc9d-b4c2-4ca7-aa24-baa2fda7f18b None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:04.318454 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 473/955] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:16:04.323274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07664cd0-0d8c-4658-8649-ab8faa524818 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:04.323618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07664cd0-0d8c-4658-8649-ab8faa524818 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:04.323894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07664cd0-0d8c-4658-8649-ab8faa524818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:04.326377 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 483/956] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 03:16:04 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:04.344376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-07664cd0-0d8c-4658-8649-ab8faa524818 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:04.346348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-07664cd0-0d8c-4658-8649-ab8faa524818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:04.423683 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 474/957] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:04.446071 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b4259-d0fc-48b6-aafe-73380feca180 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:04.554099 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b4259-d0fc-48b6-aafe-73380feca180 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:04.569149 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:04.592672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffb3cb-2951-4666-b055-acfc0ad74cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:04.593581 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffb3cb-2951-4666-b055-acfc0ad74cde None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:04.593865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffb3cb-2951-4666-b055-acfc0ad74cde None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:04.594140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffb3cb-2951-4666-b055-acfc0ad74cde None admin] PATH_INFO: `/v3/services/compute` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:04.594807 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffb3cb-2951-4666-b055-acfc0ad74cde None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:04.596570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffb3cb-2951-4666-b055-acfc0ad74cde None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:04.608736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-82ffb3cb-2951-4666-b055-acfc0ad74cde None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 03:16:04.608736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:04.608736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:16:04.608736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:16:04.608736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:16:04.608736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:16:04.608736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:16:04.608736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:04.608736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 03:16:04.608736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:04.608736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:16:04.608736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:04.608736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:04.608736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:04.608736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:04.608736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:04.608736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:04.609887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:04.609887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:04.609887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:04.609887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:04.609887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:04.609887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:04.609887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:16:04.609887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:16:04.609887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:16:04.609887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:16:04.609887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:04.609887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:04.609887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:04.609887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:04.609887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:04.609887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:04.611360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:04.611360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:04.611360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:04.611360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:04.611360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:04.611360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:04.611360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:04.611360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:04.611360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:04.611360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:04.611360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:16:04.611360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:04.611360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 03:16:04.611360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:04.611360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 484/958] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:16:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:04.616021 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07664cd0-0d8c-4658-8649-ab8faa524818 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:04.716752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07664cd0-0d8c-4658-8649-ab8faa524818 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:04.744151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:04.752536 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0819228-2681-44b4-8b91-268b917399e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:04.753217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0819228-2681-44b4-8b91-268b917399e0 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:04.753497 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0819228-2681-44b4-8b91-268b917399e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:04.753768 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0819228-2681-44b4-8b91-268b917399e0 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:04.754491 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0819228-2681-44b4-8b91-268b917399e0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:04.754795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0819228-2681-44b4-8b91-268b917399e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:04.756224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0819228-2681-44b4-8b91-268b917399e0 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:04.766438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 475/959] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 03:16:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:04.767435 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffb3cb-2951-4666-b055-acfc0ad74cde None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:04.872807 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffb3cb-2951-4666-b055-acfc0ad74cde None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:04.908348 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4a3f8-3873-4df1-94da-ac17b40de875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:04.909291 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4a3f8-3873-4df1-94da-ac17b40de875 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:04.909754 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4a3f8-3873-4df1-94da-ac17b40de875 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:04.910173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4a3f8-3873-4df1-94da-ac17b40de875 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:04.911036 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4a3f8-3873-4df1-94da-ac17b40de875 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:04.911487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4a3f8-3873-4df1-94da-ac17b40de875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:04.913038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4a3f8-3873-4df1-94da-ac17b40de875 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:04.926486 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 485/960] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 03:16:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:05.022772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fbb49-5b86-43fc-ad2c-eeda4897e728 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:05.023083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fbb49-5b86-43fc-ad2c-eeda4897e728 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:05.023489 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fbb49-5b86-43fc-ad2c-eeda4897e728 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:05.025275 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 476/961] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:05.034383 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a30aa-9472-4339-bf63-ecdaf89cb02a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:05.034828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a30aa-9472-4339-bf63-ecdaf89cb02a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:05.035201 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a30aa-9472-4339-bf63-ecdaf89cb02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:05.053446 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1b0a30aa-9472-4339-bf63-ecdaf89cb02a None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:05.054661 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1b0a30aa-9472-4339-bf63-ecdaf89cb02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:05.093815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:05.129154 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 486/962] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:05.152819 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fbb49-5b86-43fc-ad2c-eeda4897e728 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:05.265163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fbb49-5b86-43fc-ad2c-eeda4897e728 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:05.301040 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f07b2f-26fc-4501-b282-d0b11552ed6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:05.301857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f07b2f-26fc-4501-b282-d0b11552ed6a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:05.302130 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f07b2f-26fc-4501-b282-d0b11552ed6a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:05.302399 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f07b2f-26fc-4501-b282-d0b11552ed6a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:05.313156 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f07b2f-26fc-4501-b282-d0b11552ed6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:16:05.321274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-40f07b2f-26fc-4501-b282-d0b11552ed6a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 03:16:05.321274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:05.321274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:05.321274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:05.321274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:05.321274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:05.321274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:05.321274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:05.321274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:05.321274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:05.321274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:05.321274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:05.321274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:16:05.321274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:16:05.321274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:16:05.321274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:16:05.322231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:16:05.322231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:16:05.322231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:16:05.322231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:16:05.322231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:05.322231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:05.322231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:05.322231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:05.322231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:05.322231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:05.322231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:05.322231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:05.322231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:05.322231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:05.322231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:05.322231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:05.323553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:05.323553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:05.323553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:05.323553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:05.323553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:16:05.323553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:16:05.323553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:16:05.323553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:16:05.323553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:16:05.323553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:16:05.323553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 03:16:05.323553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:05.323553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 477/963] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Jul 12 03:16:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:16:05.329080 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a30aa-9472-4339-bf63-ecdaf89cb02a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:05.435001 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a30aa-9472-4339-bf63-ecdaf89cb02a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:05.471885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6bc3c-8ee4-4e60-a3e6-8c2d0829ceea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:05.472894 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6bc3c-8ee4-4e60-a3e6-8c2d0829ceea None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:05.473389 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6bc3c-8ee4-4e60-a3e6-8c2d0829ceea None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:05.473855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6bc3c-8ee4-4e60-a3e6-8c2d0829ceea None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:05.474787 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6bc3c-8ee4-4e60-a3e6-8c2d0829ceea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:05.475270 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6bc3c-8ee4-4e60-a3e6-8c2d0829ceea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:05.476902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6bc3c-8ee4-4e60-a3e6-8c2d0829ceea None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:05.486037 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 487/964] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Jul 12 03:16:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:05.491476 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f07b2f-26fc-4501-b282-d0b11552ed6a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:05.545619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:05.596656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f07b2f-26fc-4501-b282-d0b11552ed6a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:05.630921 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b2e57-6130-4938-97b7-c96756c5cf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:05.631727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b2e57-6130-4938-97b7-c96756c5cf75 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:05.632005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b2e57-6130-4938-97b7-c96756c5cf75 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:05.632276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b2e57-6130-4938-97b7-c96756c5cf75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:05.643241 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b2e57-6130-4938-97b7-c96756c5cf75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:05.644715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b2e57-6130-4938-97b7-c96756c5cf75 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:05.662038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-da6b2e57-6130-4938-97b7-c96756c5cf75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:05.662038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:05.662038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:05.662038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:05.662038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:05.662038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:05.662038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:05.662038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:05.662038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:05.662038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:05.662038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:05.662038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:05.662038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:16:05.662038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:16:05.662038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:16:05.662999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:16:05.662999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:05.662999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:05.662999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:05.662999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:05.662999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:05.662999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:05.662999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:05.662999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:05.662999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:05.662999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:05.662999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:05.662999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:05.662999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:05.662999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:05.662999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:05.662999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:05.664139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:16:05.664139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:16:05.664139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:05.664139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:05.664139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 478/965] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:05.669298 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6bc3c-8ee4-4e60-a3e6-8c2d0829ceea None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:05.713364 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:05.785508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6bc3c-8ee4-4e60-a3e6-8c2d0829ceea None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:05.820004 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0d968-45bb-48e8-8003-d6aee65c58aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:05.820699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0d968-45bb-48e8-8003-d6aee65c58aa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:05.820977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0d968-45bb-48e8-8003-d6aee65c58aa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:05.821247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0d968-45bb-48e8-8003-d6aee65c58aa None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:05.821973 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0d968-45bb-48e8-8003-d6aee65c58aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:05.822272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0d968-45bb-48e8-8003-d6aee65c58aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:05.823819 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0d968-45bb-48e8-8003-d6aee65c58aa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:05.836244 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 488/966] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:05.842173 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b2e57-6130-4938-97b7-c96756c5cf75 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:05.942930 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b2e57-6130-4938-97b7-c96756c5cf75 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:05.953519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:05.977679 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ae806-9d26-474c-a633-347c4ff344c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:05.978418 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ae806-9d26-474c-a633-347c4ff344c1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:05.978697 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ae806-9d26-474c-a633-347c4ff344c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:05.978965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ae806-9d26-474c-a633-347c4ff344c1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:05.986875 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ae806-9d26-474c-a633-347c4ff344c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:05.988374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ae806-9d26-474c-a633-347c4ff344c1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:06.002988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-291ae806-9d26-474c-a633-347c4ff344c1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 03:16:06.002988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:06.002988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:06.002988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:06.002988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:06.002988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:06.002988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:06.002988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:06.002988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:06.002988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:06.002988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:06.002988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:06.002988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:16:06.002988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:16:06.002988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:16:06.002988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:06.003977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:06.005410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:06.005410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:06.005410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:16:06.005410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:16:06.005410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:16:06.005410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:16:06.005410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:16:06.005410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:16:06.005410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 03:16:06.005410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:06.008715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 479/967] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 03:16:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:06.010482 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0d968-45bb-48e8-8003-d6aee65c58aa None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:06.106844 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:06.113900 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0d968-45bb-48e8-8003-d6aee65c58aa None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:06.156009 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1502b-fe21-4759-88f8-c72925f83448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:06.156859 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1502b-fe21-4759-88f8-c72925f83448 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:06.157196 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1502b-fe21-4759-88f8-c72925f83448 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:06.157528 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1502b-fe21-4759-88f8-c72925f83448 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:06.158489 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1502b-fe21-4759-88f8-c72925f83448 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:06.158854 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1502b-fe21-4759-88f8-c72925f83448 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:06.160355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1502b-fe21-4759-88f8-c72925f83448 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:06.181441 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 489/968] 10.222.0.26 () {56 vars in 1149 bytes} [Tue Jul 12 03:16:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:06.184196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d32566-0705-43cf-ae9b-7457a09f3082 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:06.184694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d32566-0705-43cf-ae9b-7457a09f3082 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:06.184772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d32566-0705-43cf-ae9b-7457a09f3082 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:06.186349 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 480/969] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:16:06.187294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1502b-fe21-4759-88f8-c72925f83448 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:06.191748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95315680-a9d8-4bf7-bb3a-7384fbbd7e6f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:06.192045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95315680-a9d8-4bf7-bb3a-7384fbbd7e6f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:06.192310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95315680-a9d8-4bf7-bb3a-7384fbbd7e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:06.211122 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-95315680-a9d8-4bf7-bb3a-7384fbbd7e6f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:06.212331 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-95315680-a9d8-4bf7-bb3a-7384fbbd7e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:06.283669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 481/970] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 03:16:06.305971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95315680-a9d8-4bf7-bb3a-7384fbbd7e6f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:06.313959 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1502b-fe21-4759-88f8-c72925f83448 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:06.354841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7a857-04f8-4208-ac7b-768b8078e7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:06.355522 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7a857-04f8-4208-ac7b-768b8078e7ce None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:06.355778 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7a857-04f8-4208-ac7b-768b8078e7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:06.356058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7a857-04f8-4208-ac7b-768b8078e7ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:06.379588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:06.404398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:06.411759 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95315680-a9d8-4bf7-bb3a-7384fbbd7e6f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:06.432417 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7a857-04f8-4208-ac7b-768b8078e7ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:06.434704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7a857-04f8-4208-ac7b-768b8078e7ce None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:06.448172 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d8b2c-67ef-45ef-b7cf-f0879e67de0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:06.449349 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d8b2c-67ef-45ef-b7cf-f0879e67de0f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:06.449699 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d8b2c-67ef-45ef-b7cf-f0879e67de0f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:06.450025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d8b2c-67ef-45ef-b7cf-f0879e67de0f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:06.450752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d8b2c-67ef-45ef-b7cf-f0879e67de0f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:06.452302 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d8b2c-67ef-45ef-b7cf-f0879e67de0f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:06.465022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-108d8b2c-67ef-45ef-b7cf-f0879e67de0f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 03:16:06.465022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:06.465022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:16:06.465022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:16:06.465022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:16:06.465022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:16:06.465022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:16:06.465022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:06.465022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 03:16:06.465022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:06.465022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:16:06.465022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:06.465022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:06.465022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:06.465022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:06.465022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:06.465022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:06.466042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:06.466042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:06.466042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:06.466042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:06.466042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:06.466042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:06.466042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:16:06.466042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:16:06.466042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:16:06.466042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:16:06.466042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:06.466042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:06.466042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:06.466042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:06.466042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:06.466042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:06.466963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:06.466963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:06.466963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:06.466963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:06.466963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:06.466963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:06.466963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:06.466963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:06.466963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:06.466963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:06.466963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:16:06.466963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:06.466963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 03:16:06.466963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:06.466963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 482/971] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 03:16:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:06.474244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d8b2c-67ef-45ef-b7cf-f0879e67de0f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:06.561593 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 490/972] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:16:06 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 03:16:06.562975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb682856-2f3d-4b57-91e1-e88a78b67608 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:06.563256 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb682856-2f3d-4b57-91e1-e88a78b67608 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:06.563528 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb682856-2f3d-4b57-91e1-e88a78b67608 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:06.564990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 491/973] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:06.567165 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb682856-2f3d-4b57-91e1-e88a78b67608 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:06.595500 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d8b2c-67ef-45ef-b7cf-f0879e67de0f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:06.627241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:06.630009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b2d05-7583-44a7-a7c0-5f62049dbec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:06.630684 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b2d05-7583-44a7-a7c0-5f62049dbec9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:06.630947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b2d05-7583-44a7-a7c0-5f62049dbec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:06.631219 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b2d05-7583-44a7-a7c0-5f62049dbec9 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:06.631938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b2d05-7583-44a7-a7c0-5f62049dbec9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:06.632219 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b2d05-7583-44a7-a7c0-5f62049dbec9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:06.633620 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b2d05-7583-44a7-a7c0-5f62049dbec9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:06.638657 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 483/974] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 03:16:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:06.638657 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee0c48-e3a6-455a-b109-5dcd90f39110 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:06.638657 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee0c48-e3a6-455a-b109-5dcd90f39110 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:06.638657 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee0c48-e3a6-455a-b109-5dcd90f39110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:06.656679 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-68ee0c48-e3a6-455a-b109-5dcd90f39110 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:06.657848 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-68ee0c48-e3a6-455a-b109-5dcd90f39110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:06.676247 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:06.689116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb682856-2f3d-4b57-91e1-e88a78b67608 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:06.728498 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60231802-5b3f-4f5b-a44d-8ad7dd58e367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:06.729322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60231802-5b3f-4f5b-a44d-8ad7dd58e367 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:06.729673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60231802-5b3f-4f5b-a44d-8ad7dd58e367 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:06.729945 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60231802-5b3f-4f5b-a44d-8ad7dd58e367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:06.732569 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 484/975] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:06.732569 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee0c48-e3a6-455a-b109-5dcd90f39110 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:06.746124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60231802-5b3f-4f5b-a44d-8ad7dd58e367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:06.747836 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60231802-5b3f-4f5b-a44d-8ad7dd58e367 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:06.766999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-60231802-5b3f-4f5b-a44d-8ad7dd58e367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:06.766999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:06.766999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:06.766999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:06.766999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:06.766999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:06.766999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:06.766999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:06.766999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:06.766999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:06.766999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:06.766999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:06.766999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:16:06.766999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:16:06.766999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:16:06.767924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:16:06.767924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:06.767924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:06.767924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:06.767924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:06.767924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:06.767924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:06.767924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:06.767924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:06.767924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:06.767924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:06.767924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:06.767924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:06.767924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:06.767924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:06.767924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:06.767924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:06.768872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:16:06.768872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:16:06.768872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:06.768872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:06.768872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 492/976] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:16:06.769140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60231802-5b3f-4f5b-a44d-8ad7dd58e367 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:06.848363 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee0c48-e3a6-455a-b109-5dcd90f39110 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:06.874981 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60231802-5b3f-4f5b-a44d-8ad7dd58e367 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:06.877281 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:06.887217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d4ca9-2306-4ebc-98c2-a98a25613c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:06.888172 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d4ca9-2306-4ebc-98c2-a98a25613c57 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:06.888455 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d4ca9-2306-4ebc-98c2-a98a25613c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:06.888749 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d4ca9-2306-4ebc-98c2-a98a25613c57 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:06.889630 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d4ca9-2306-4ebc-98c2-a98a25613c57 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:06.889923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d4ca9-2306-4ebc-98c2-a98a25613c57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:06.891963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d4ca9-2306-4ebc-98c2-a98a25613c57 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:06.902985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 485/977] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 03:16:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:06.902985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d4ca9-2306-4ebc-98c2-a98a25613c57 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:06.909834 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51127a-6d90-4fed-aed0-412ac1d98565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:06.910505 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51127a-6d90-4fed-aed0-412ac1d98565 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:06.910785 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51127a-6d90-4fed-aed0-412ac1d98565 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:06.911049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51127a-6d90-4fed-aed0-412ac1d98565 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:06.911739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51127a-6d90-4fed-aed0-412ac1d98565 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:06.913266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51127a-6d90-4fed-aed0-412ac1d98565 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:06.914581 dv-cinder-847730-4-smb devstack@keystone.service[80398]: WARNING keystone.server.flask.common [None req-6a51127a-6d90-4fed-aed0-412ac1d98565 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 03:16:06.921910 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:06.928904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.sql.core [None req-6a51127a-6d90-4fed-aed0-412ac1d98565 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 03:16:06.928904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 03:16:06.928904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [parameters: {'user_id': '671e4f5ce0a1453db7d450bc973ec567', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 03:16:06.928904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80398) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 03:16:06.945238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-6a51127a-6d90-4fed-aed0-412ac1d98565 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 03:16:06.945238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:06.945238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 03:16:06.945238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 03:16:06.945238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 03:16:06.945238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 03:16:06.945238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 03:16:06.945238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 03:16:06.945238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 03:16:06.945238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application conn.query(q) Jul 12 03:16:06.945238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 03:16:06.945238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 03:16:06.945238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 03:16:06.945238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result.read() Jul 12 03:16:06.945238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 03:16:06.946554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application next(self.gen) Jul 12 03:16:06.947786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 03:16:06.947786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application yield resource Jul 12 03:16:06.947786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 03:16:06.947786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application next(self.gen) Jul 12 03:16:06.947786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 03:16:06.947786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 03:16:06.947786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 03:16:06.947786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 03:16:06.947786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 03:16:06.947786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise self.value Jul 12 03:16:06.947786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 03:16:06.947786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 03:16:06.947786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 03:16:06.947786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application session.commit() Jul 12 03:16:06.947786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 03:16:06.947786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 03:16:06.947786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 03:16:06.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 03:16:06.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 03:16:06.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.session.flush() Jul 12 03:16:06.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 03:16:06.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 03:16:06.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 03:16:06.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 03:16:06.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 03:16:06.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application compat.raise_( Jul 12 03:16:06.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 03:16:06.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception Jul 12 03:16:06.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 03:16:06.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 03:16:06.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 03:16:06.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 03:16:06.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 03:16:06.948972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 03:16:06.949878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 03:16:06.949878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 03:16:06.949878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 12 03:16:06.949878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 12 03:16:06.949878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 03:16:06.949878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 03:16:06.949878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 03:16:06.949878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 03:16:06.949878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 03:16:06.949878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 03:16:06.949878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 03:16:06.949878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 03:16:06.949878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 03:16:06.949878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 03:16:06.949878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 03:16:06.949878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception Jul 12 03:16:06.950738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 03:16:06.950738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 03:16:06.950738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 03:16:06.950738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 03:16:06.950738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 03:16:06.950738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 03:16:06.950738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 03:16:06.950738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application conn.query(q) Jul 12 03:16:06.950738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 03:16:06.950738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 03:16:06.950738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 03:16:06.950738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result.read() Jul 12 03:16:06.950738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 03:16:06.950738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 03:16:06.950738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 03:16:06.950738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 03:16:06.955031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 03:16:06.955031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 03:16:06.955031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 03:16:06.955031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 03:16:06.955031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 03:16:06.955031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 03:16:06.955031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [parameters: {'user_id': '671e4f5ce0a1453db7d450bc973ec567', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 03:16:06.955031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 03:16:06.955031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:06.955031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:16:06.955031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:06.955031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:06.955031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:06.955031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:06.955031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:06.957156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:06.957156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:06.957156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:06.957156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:06.957156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:06.957156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:06.957156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:06.957156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 12 03:16:06.957156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 12 03:16:06.957156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:06.957156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:06.957156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:16:06.957156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:16:06.957156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:16:06.957156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:16:06.957156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 12 03:16:06.957156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 12 03:16:06.959462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 12 03:16:06.959462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 12 03:16:06.959462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 03:16:06.959462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 03:16:06.959462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 03:16:06.959462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:06.959462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 493/978] 10.222.0.26 () {60 vars in 1131 bytes} [Tue Jul 12 03:16:06 2022] POST /identity/v3/users => generated 160 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:06.959462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51127a-6d90-4fed-aed0-412ac1d98565 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:07.018161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d4ca9-2306-4ebc-98c2-a98a25613c57 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:07.054729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60dacef-655b-42b2-8a3d-b9cc6e4ee2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:07.055399 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60dacef-655b-42b2-8a3d-b9cc6e4ee2fa None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:07.055669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60dacef-655b-42b2-8a3d-b9cc6e4ee2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:07.055935 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60dacef-655b-42b2-8a3d-b9cc6e4ee2fa None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:07.056680 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60dacef-655b-42b2-8a3d-b9cc6e4ee2fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:07.056978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60dacef-655b-42b2-8a3d-b9cc6e4ee2fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:07.058559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51127a-6d90-4fed-aed0-412ac1d98565 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:07.058671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60dacef-655b-42b2-8a3d-b9cc6e4ee2fa None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:07.076351 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 486/979] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:07.076351 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60dacef-655b-42b2-8a3d-b9cc6e4ee2fa None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:07.103874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5bd80-740a-4eda-b982-1bd11cf6d4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:07.104777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5bd80-740a-4eda-b982-1bd11cf6d4eb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:07.105063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5bd80-740a-4eda-b982-1bd11cf6d4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:07.105497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5bd80-740a-4eda-b982-1bd11cf6d4eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:07.106638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5bd80-740a-4eda-b982-1bd11cf6d4eb None admin] RBAC: Adding query filter params (interface=admin, service_id=e00a18dd90574fae84f403191f92b0ad, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:07.107218 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5bd80-740a-4eda-b982-1bd11cf6d4eb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:07.109181 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5bd80-740a-4eda-b982-1bd11cf6d4eb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:07.124159 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 494/980] 10.222.0.26 () {56 vars in 1249 bytes} [Tue Jul 12 03:16:06 2022] GET /identity/v3/endpoints?service_id=e00a18dd90574fae84f403191f92b0ad&interface=admin®ion_id=RegionOne => generated 193 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:07.124159 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5bd80-740a-4eda-b982-1bd11cf6d4eb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:07.152836 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:07.160558 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:07.176983 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60dacef-655b-42b2-8a3d-b9cc6e4ee2fa None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:07.211103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f63ed7-03a2-4303-b0d7-09bd065c7310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:07.211911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f63ed7-03a2-4303-b0d7-09bd065c7310 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:07.212182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f63ed7-03a2-4303-b0d7-09bd065c7310 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:07.212440 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f63ed7-03a2-4303-b0d7-09bd065c7310 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:07.220732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f63ed7-03a2-4303-b0d7-09bd065c7310 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:07.222184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f63ed7-03a2-4303-b0d7-09bd065c7310 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:07.230266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5bd80-740a-4eda-b982-1bd11cf6d4eb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:07.236313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-05f63ed7-03a2-4303-b0d7-09bd065c7310 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 03:16:07.236313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:07.236313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:07.236313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:07.236313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:07.236313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:07.236313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:07.236313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:07.236313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:07.236313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:07.236313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:07.236313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:07.236313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:16:07.236313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:16:07.236313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:16:07.236313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:07.237303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:07.238233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:07.238233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:07.238233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:16:07.238233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:16:07.238233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:16:07.238233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:16:07.238233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:16:07.238233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:16:07.238233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 03:16:07.238233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:07.238233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 487/981] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:16:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:07.238844 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f63ed7-03a2-4303-b0d7-09bd065c7310 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:07.268911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbe702-15e7-4a1d-975d-0ba740d31064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:07.269765 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbe702-15e7-4a1d-975d-0ba740d31064 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:07.270049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbe702-15e7-4a1d-975d-0ba740d31064 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:07.270328 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbe702-15e7-4a1d-975d-0ba740d31064 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:07.277874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbe702-15e7-4a1d-975d-0ba740d31064 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:07.279339 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbe702-15e7-4a1d-975d-0ba740d31064 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:07.294022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3bfbe702-15e7-4a1d-975d-0ba740d31064 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:16:07.294022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:07.294022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:07.294022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:07.294022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:07.294022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:07.294022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:07.294022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:07.294022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:07.294022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:07.294022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:07.294022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:07.294022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:16:07.294022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:16:07.294022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:16:07.294962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:16:07.294962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:07.294962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:07.294962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:07.294962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:07.294962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:07.294962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:07.294962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:07.294962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:07.294962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:07.294962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:07.294962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:07.294962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:07.294962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:07.294962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:07.294962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:07.294962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:07.295828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:16:07.295828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:16:07.295828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:16:07.295828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:16:07.295828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:16:07.295828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:16:07.295828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:16:07.295828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:07.295828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 495/982] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:16:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:07.296590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf42cb-3111-47c4-9dcc-4469c9f96574 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:07.296829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf42cb-3111-47c4-9dcc-4469c9f96574 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:07.297116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf42cb-3111-47c4-9dcc-4469c9f96574 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:07.298387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 496/983] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:07.299068 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf42cb-3111-47c4-9dcc-4469c9f96574 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:07.348863 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f63ed7-03a2-4303-b0d7-09bd065c7310 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:07.384579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5c765-86e3-4321-b8af-2ea95b87fa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:07.385209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5c765-86e3-4321-b8af-2ea95b87fa1c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:07.385469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5c765-86e3-4321-b8af-2ea95b87fa1c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:07.385993 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5c765-86e3-4321-b8af-2ea95b87fa1c None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:07.386671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5c765-86e3-4321-b8af-2ea95b87fa1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:07.388041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5c765-86e3-4321-b8af-2ea95b87fa1c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:07.389818 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:07.391651 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:07.394908 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 488/984] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 03:16:07 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:16:07.396346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5c765-86e3-4321-b8af-2ea95b87fa1c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:07.403331 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf42cb-3111-47c4-9dcc-4469c9f96574 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:07.445258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0ea33-02f6-452b-a5f1-796fdc6c85cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:07.446049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0ea33-02f6-452b-a5f1-796fdc6c85cf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:07.446411 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0ea33-02f6-452b-a5f1-796fdc6c85cf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:07.446704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0ea33-02f6-452b-a5f1-796fdc6c85cf None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:07.447547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0ea33-02f6-452b-a5f1-796fdc6c85cf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:07.447862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0ea33-02f6-452b-a5f1-796fdc6c85cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:07.449552 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0ea33-02f6-452b-a5f1-796fdc6c85cf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:07.489848 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 497/985] 10.222.0.26 () {56 vars in 1101 bytes} [Tue Jul 12 03:16:07 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:07.491199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43d741-6dab-4718-9058-c8e51be40d9d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:07.491490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43d741-6dab-4718-9058-c8e51be40d9d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:07.491766 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43d741-6dab-4718-9058-c8e51be40d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:07.511054 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7d43d741-6dab-4718-9058-c8e51be40d9d None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:07.513087 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7d43d741-6dab-4718-9058-c8e51be40d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:07.544082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5c765-86e3-4321-b8af-2ea95b87fa1c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:07.600544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849573c-f89c-43a0-807d-dcb37426f956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:07.600544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849573c-f89c-43a0-807d-dcb37426f956 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:07.600544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849573c-f89c-43a0-807d-dcb37426f956 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:07.600544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849573c-f89c-43a0-807d-dcb37426f956 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:07.601021 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849573c-f89c-43a0-807d-dcb37426f956 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:07.601021 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849573c-f89c-43a0-807d-dcb37426f956 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:07.601778 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849573c-f89c-43a0-807d-dcb37426f956 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:07.608929 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 498/986] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:07.620246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 489/987] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:16:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:07.626480 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43d741-6dab-4718-9058-c8e51be40d9d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:07.633750 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849573c-f89c-43a0-807d-dcb37426f956 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:07.697540 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:07.724842 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:07.750997 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849573c-f89c-43a0-807d-dcb37426f956 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:07.753421 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43d741-6dab-4718-9058-c8e51be40d9d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:07.795342 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e96b8-2a4d-4f36-bdc1-d2d6dad0b997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:07.796010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e96b8-2a4d-4f36-bdc1-d2d6dad0b997 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:07.796285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e96b8-2a4d-4f36-bdc1-d2d6dad0b997 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:07.796669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e96b8-2a4d-4f36-bdc1-d2d6dad0b997 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:07.797521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e96b8-2a4d-4f36-bdc1-d2d6dad0b997 None admin] RBAC: Adding query filter params (role.id=e85eb3b871ec47ddaf83b195c9d4e9db, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=e23aea853cce44698b19d6bc087093c1) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:07.797829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e96b8-2a4d-4f36-bdc1-d2d6dad0b997 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:07.798476 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63666134-8a78-4b6b-827f-86a962c3fb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:07.799403 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e96b8-2a4d-4f36-bdc1-d2d6dad0b997 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:07.799513 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63666134-8a78-4b6b-827f-86a962c3fb6e None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:07.799997 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63666134-8a78-4b6b-827f-86a962c3fb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:07.800479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63666134-8a78-4b6b-827f-86a962c3fb6e None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:07.801684 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63666134-8a78-4b6b-827f-86a962c3fb6e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:07.804136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63666134-8a78-4b6b-827f-86a962c3fb6e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:07.806123 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 499/988] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:16:07 2022] GET /identity/v3/role_assignments?user.id=e23aea853cce44698b19d6bc087093c1&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=e85eb3b871ec47ddaf83b195c9d4e9db => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:07.823324 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 490/989] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 03:16:07 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:16:09.510667 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1845ce-eb74-4724-885e-7dac1d46e978 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:09.511218 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1845ce-eb74-4724-885e-7dac1d46e978 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:09.511327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1845ce-eb74-4724-885e-7dac1d46e978 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:09.512730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 500/990] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:09.518281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2cc3f-e964-46ff-82d6-91051f050020 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:09.518731 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2cc3f-e964-46ff-82d6-91051f050020 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:09.518823 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2cc3f-e964-46ff-82d6-91051f050020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:09.536709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-1ba2cc3f-e964-46ff-82d6-91051f050020 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:09.537933 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1ba2cc3f-e964-46ff-82d6-91051f050020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:09.617152 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 491/991] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:09.640635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1845ce-eb74-4724-885e-7dac1d46e978 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:09.751178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1845ce-eb74-4724-885e-7dac1d46e978 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:09.787242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76cfac-63c5-4356-9c16-cf8771ae5335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:09.787969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76cfac-63c5-4356-9c16-cf8771ae5335 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:09.788243 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76cfac-63c5-4356-9c16-cf8771ae5335 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:09.788504 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76cfac-63c5-4356-9c16-cf8771ae5335 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:09.789183 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76cfac-63c5-4356-9c16-cf8771ae5335 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:09.790577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76cfac-63c5-4356-9c16-cf8771ae5335 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:09.802878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-db76cfac-63c5-4356-9c16-cf8771ae5335 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 03:16:09.802878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:09.802878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:16:09.802878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:16:09.802878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:16:09.802878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:16:09.802878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:16:09.802878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:09.802878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 03:16:09.802878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:09.802878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:16:09.802878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:09.802878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:09.802878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:09.802878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:09.802878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:09.802878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:09.804038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:09.804038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:09.804038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:09.804038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:09.804038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:09.804038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:09.804038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:16:09.804038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:16:09.804038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:16:09.804038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:16:09.804038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:09.804038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:09.804038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:09.804038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:09.804038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:09.804038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:09.810058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:09.810058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:09.810058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:09.810058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:09.810058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:09.810058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:09.810058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:09.810058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:09.810058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:09.810058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:09.810058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:16:09.810058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:09.810058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 03:16:09.810058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:09.810058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 501/992] 10.222.0.26 () {56 vars in 1126 bytes} [Tue Jul 12 03:16:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:09.812331 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2cc3f-e964-46ff-82d6-91051f050020 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:09.853915 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec6ea9-8c20-4886-abb4-65ac929159b1 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:09.854301 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec6ea9-8c20-4886-abb4-65ac929159b1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:09.854541 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec6ea9-8c20-4886-abb4-65ac929159b1 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:09.856307 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 502/993] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:09.861401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c601d7-7cf6-494d-9678-ed67ab51cf3f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:09.861686 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c601d7-7cf6-494d-9678-ed67ab51cf3f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:09.861993 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c601d7-7cf6-494d-9678-ed67ab51cf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:09.863873 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:09.874217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:09.880583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-93c601d7-7cf6-494d-9678-ed67ab51cf3f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:09.881775 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-93c601d7-7cf6-494d-9678-ed67ab51cf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:09.922000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2cc3f-e964-46ff-82d6-91051f050020 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:09.951641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 503/994] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:09.952872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288343c6-656d-4d1e-88a3-7e3ee8904ef9 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:09.953153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288343c6-656d-4d1e-88a3-7e3ee8904ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:09.953421 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288343c6-656d-4d1e-88a3-7e3ee8904ef9 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:09.954679 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 504/995] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:09.959904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43fc47-0ff4-4d43-802a-5116a239a2d4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:09.960044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6364a-eda7-4612-87f7-b7735d699889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:09.960242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43fc47-0ff4-4d43-802a-5116a239a2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:09.960467 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43fc47-0ff4-4d43-802a-5116a239a2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:09.960718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6364a-eda7-4612-87f7-b7735d699889 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:09.960997 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6364a-eda7-4612-87f7-b7735d699889 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:09.961266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6364a-eda7-4612-87f7-b7735d699889 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:09.961989 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6364a-eda7-4612-87f7-b7735d699889 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:09.962289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6364a-eda7-4612-87f7-b7735d699889 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:09.963691 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6364a-eda7-4612-87f7-b7735d699889 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:09.972310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 492/996] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 03:16:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:09.974698 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6364a-eda7-4612-87f7-b7735d699889 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:09.978337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5b43fc47-0ff4-4d43-802a-5116a239a2d4 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:09.979618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5b43fc47-0ff4-4d43-802a-5116a239a2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:10.046872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 505/997] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 03:16:10.047530 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43fc47-0ff4-4d43-802a-5116a239a2d4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:10.073990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6364a-eda7-4612-87f7-b7735d699889 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:10.084817 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:10.109825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45f3bf-d5f1-4434-9935-0036cc7acde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:10.110493 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45f3bf-d5f1-4434-9935-0036cc7acde5 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:10.110773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45f3bf-d5f1-4434-9935-0036cc7acde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:10.111048 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45f3bf-d5f1-4434-9935-0036cc7acde5 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:10.111755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45f3bf-d5f1-4434-9935-0036cc7acde5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:10.112058 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45f3bf-d5f1-4434-9935-0036cc7acde5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:10.113463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45f3bf-d5f1-4434-9935-0036cc7acde5 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:10.116600 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:10.118223 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 493/998] 10.222.0.26 () {56 vars in 1122 bytes} [Tue Jul 12 03:16:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:10.119010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45f3bf-d5f1-4434-9935-0036cc7acde5 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:10.155282 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43fc47-0ff4-4d43-802a-5116a239a2d4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:10.190580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63a0f8-aea6-4335-a246-2dd750e6e102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:10.191385 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63a0f8-aea6-4335-a246-2dd750e6e102 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:10.191673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63a0f8-aea6-4335-a246-2dd750e6e102 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:10.191948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63a0f8-aea6-4335-a246-2dd750e6e102 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:10.192733 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63a0f8-aea6-4335-a246-2dd750e6e102 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:10.194129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63a0f8-aea6-4335-a246-2dd750e6e102 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:10.206129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-bb63a0f8-aea6-4335-a246-2dd750e6e102 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 03:16:10.206129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:10.206129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:16:10.206129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:16:10.206129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:16:10.206129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:16:10.206129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:16:10.206129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:10.206129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 03:16:10.206129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:10.206129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:16:10.206129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:10.206129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:10.206129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:10.206129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:10.206129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:10.206129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:10.207153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:10.207153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:10.207153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:10.207153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:10.207153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:10.207153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:10.207153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:16:10.207153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:16:10.207153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:16:10.207153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:16:10.207153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:10.207153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:10.207153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:10.207153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:10.207153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:10.207153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:10.207978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:10.207978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:10.207978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:10.207978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:10.207978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:10.207978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:10.207978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:10.207978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:10.207978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:10.207978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:10.207978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:16:10.207978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:10.207978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 03:16:10.207978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:10.207978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 506/999] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:16:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:10.208789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63a0f8-aea6-4335-a246-2dd750e6e102 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:10.220796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45f3bf-d5f1-4434-9935-0036cc7acde5 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:10.257648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0eaae0-2072-48bb-8cf9-3b1f1b45e67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:10.258457 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eaae0-2072-48bb-8cf9-3b1f1b45e67b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:10.258736 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eaae0-2072-48bb-8cf9-3b1f1b45e67b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:10.259001 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eaae0-2072-48bb-8cf9-3b1f1b45e67b None admin] PATH_INFO: `/v3/services/image` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:10.259644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0eaae0-2072-48bb-8cf9-3b1f1b45e67b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:10.261127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0eaae0-2072-48bb-8cf9-3b1f1b45e67b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:10.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-ca0eaae0-2072-48bb-8cf9-3b1f1b45e67b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 03:16:10.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:10.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:16:10.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:16:10.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:16:10.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:16:10.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:16:10.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:10.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 03:16:10.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:10.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:16:10.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:10.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:10.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:10.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:10.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:10.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:10.273872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:10.273872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:10.273872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:10.273872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:10.273872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:10.273872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:10.273872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:16:10.273872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:16:10.273872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:16:10.273872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:16:10.273872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:10.273872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:10.273872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:10.273872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:10.273872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:10.273872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:10.274703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:10.274703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:10.274703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:10.274703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:10.274703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:10.274703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:10.274703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:10.274703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:10.274703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:10.274703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:10.274703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:16:10.274703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:10.274703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 03:16:10.274703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:10.274703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 494/1000] 10.222.0.26 () {56 vars in 1105 bytes} [Tue Jul 12 03:16:10 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:10.275486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0eaae0-2072-48bb-8cf9-3b1f1b45e67b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:10.315144 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:10.315842 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63a0f8-aea6-4335-a246-2dd750e6e102 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:10.344316 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:10.350953 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fcac7-b679-4d15-8f78-0e90549f5e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:10.351609 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fcac7-b679-4d15-8f78-0e90549f5e83 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:10.351885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fcac7-b679-4d15-8f78-0e90549f5e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:10.352154 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fcac7-b679-4d15-8f78-0e90549f5e83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:10.352934 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5fcac7-b679-4d15-8f78-0e90549f5e83 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:10.354346 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5fcac7-b679-4d15-8f78-0e90549f5e83 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:10.370131 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 507/1001] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 03:16:10 2022] POST /identity/v3/endpoints => generated 325 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:16:10.380567 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fcac7-b679-4d15-8f78-0e90549f5e83 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:10.393043 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0eaae0-2072-48bb-8cf9-3b1f1b45e67b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:10.442322 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae144cbd-cd61-4144-a7a3-e771f0d556aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:10.443007 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae144cbd-cd61-4144-a7a3-e771f0d556aa None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:10.443281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae144cbd-cd61-4144-a7a3-e771f0d556aa None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:10.443552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae144cbd-cd61-4144-a7a3-e771f0d556aa None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:10.444375 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae144cbd-cd61-4144-a7a3-e771f0d556aa None admin] RBAC: Adding query filter params (name=compute) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:10.444823 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae144cbd-cd61-4144-a7a3-e771f0d556aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:10.446372 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae144cbd-cd61-4144-a7a3-e771f0d556aa None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:10.457279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 495/1002] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 03:16:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:10.458569 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae144cbd-cd61-4144-a7a3-e771f0d556aa None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:10.493966 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fcac7-b679-4d15-8f78-0e90549f5e83 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:10.537929 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bea6f-7619-4996-af70-062f914b92bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:10.538593 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bea6f-7619-4996-af70-062f914b92bb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:10.538905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bea6f-7619-4996-af70-062f914b92bb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:10.539181 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bea6f-7619-4996-af70-062f914b92bb None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:10.539906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bea6f-7619-4996-af70-062f914b92bb None admin] RBAC: Adding query filter params (name=image) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:10.540209 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bea6f-7619-4996-af70-062f914b92bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:10.542297 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bea6f-7619-4996-af70-062f914b92bb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:10.547066 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 508/1003] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:10.553525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bea6f-7619-4996-af70-062f914b92bb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:10.569891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:10.576620 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae144cbd-cd61-4144-a7a3-e771f0d556aa None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:10.609943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb83253-e6b9-4ce2-9723-ec605f31e0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:10.610604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb83253-e6b9-4ce2-9723-ec605f31e0ef None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:10.610886 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb83253-e6b9-4ce2-9723-ec605f31e0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:10.611153 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb83253-e6b9-4ce2-9723-ec605f31e0ef None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:10.612262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb83253-e6b9-4ce2-9723-ec605f31e0ef None admin] RBAC: Adding query filter params (type=compute) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:10.612594 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb83253-e6b9-4ce2-9723-ec605f31e0ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:10.613961 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb83253-e6b9-4ce2-9723-ec605f31e0ef None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:10.614629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:10.620127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 496/1004] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 03:16:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:10.628564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb83253-e6b9-4ce2-9723-ec605f31e0ef None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:10.662513 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bea6f-7619-4996-af70-062f914b92bb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:10.700236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f6cd8-3325-4a2d-98df-8103bf2bb7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:10.700931 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f6cd8-3325-4a2d-98df-8103bf2bb7ff None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:10.701208 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f6cd8-3325-4a2d-98df-8103bf2bb7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:10.701474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f6cd8-3325-4a2d-98df-8103bf2bb7ff None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:10.702188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f6cd8-3325-4a2d-98df-8103bf2bb7ff None admin] RBAC: Adding query filter params (type=image) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:10.702487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f6cd8-3325-4a2d-98df-8103bf2bb7ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:10.703852 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f6cd8-3325-4a2d-98df-8103bf2bb7ff None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:10.716551 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 509/1005] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:10 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:10.747355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb83253-e6b9-4ce2-9723-ec605f31e0ef None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:10.788376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9052281-af83-476f-9115-4c028c89c5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:10.789094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9052281-af83-476f-9115-4c028c89c5ed None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:10.789488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9052281-af83-476f-9115-4c028c89c5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:10.789766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9052281-af83-476f-9115-4c028c89c5ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:10.790575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9052281-af83-476f-9115-4c028c89c5ed None admin] RBAC: Adding query filter params (interface=public, service_id=e2f98db3bcbc475cac022c0ad46c8eab, region_id=RegionOne) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:10.790882 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9052281-af83-476f-9115-4c028c89c5ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:10.793026 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9052281-af83-476f-9115-4c028c89c5ed None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:10.799272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 497/1006] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Jul 12 03:16:10 2022] GET /identity/v3/endpoints?service_id=e2f98db3bcbc475cac022c0ad46c8eab&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:10.805049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f6cd8-3325-4a2d-98df-8103bf2bb7ff None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:10.917768 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f6cd8-3325-4a2d-98df-8103bf2bb7ff None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:10.935609 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:10.953025 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe758a3-34ac-4a69-ac29-64eb8c8a9248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:10.953690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe758a3-34ac-4a69-ac29-64eb8c8a9248 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:10.953965 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe758a3-34ac-4a69-ac29-64eb8c8a9248 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:10.954232 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe758a3-34ac-4a69-ac29-64eb8c8a9248 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:10.954913 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe758a3-34ac-4a69-ac29-64eb8c8a9248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:10.956280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe758a3-34ac-4a69-ac29-64eb8c8a9248 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:10.968557 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 510/1007] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 03:16:10 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:16:12.423221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6af6c-66e5-4398-93e1-705a3bba0dbe None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:12.423777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6af6c-66e5-4398-93e1-705a3bba0dbe None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:12.423777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6af6c-66e5-4398-93e1-705a3bba0dbe None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:12.425493 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 498/1008] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:12.430884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c61ae0-240e-4e9e-a730-f2871b4fcb27 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:12.431324 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c61ae0-240e-4e9e-a730-f2871b4fcb27 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:12.431511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c61ae0-240e-4e9e-a730-f2871b4fcb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:12.449340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-25c61ae0-240e-4e9e-a730-f2871b4fcb27 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:12.450529 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-25c61ae0-240e-4e9e-a730-f2871b4fcb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:12.519112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 511/1009] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:12.542200 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6af6c-66e5-4398-93e1-705a3bba0dbe None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:12.571169 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:12.657142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6af6c-66e5-4398-93e1-705a3bba0dbe None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:12.697171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad8024-a65c-4635-80d9-1765e7fcca33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:12.698478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad8024-a65c-4635-80d9-1765e7fcca33 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:12.699017 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad8024-a65c-4635-80d9-1765e7fcca33 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:12.699503 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad8024-a65c-4635-80d9-1765e7fcca33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:12.702820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad8024-a65c-4635-80d9-1765e7fcca33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:12.704570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad8024-a65c-4635-80d9-1765e7fcca33 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:12.706483 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 499/1010] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:12.712259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c61ae0-240e-4e9e-a730-f2871b4fcb27 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:12.746896 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d5cbd-ea31-4a91-b662-6c37227b1ef9 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:12.747249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d5cbd-ea31-4a91-b662-6c37227b1ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:12.747451 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d5cbd-ea31-4a91-b662-6c37227b1ef9 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:12.748878 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 500/1011] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:12.753767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cfa6b-5711-4444-894c-cef538f4e1b1 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:12.754056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cfa6b-5711-4444-894c-cef538f4e1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:12.754331 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cfa6b-5711-4444-894c-cef538f4e1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:12.771552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a84cfa6b-5711-4444-894c-cef538f4e1b1 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:12.772889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a84cfa6b-5711-4444-894c-cef538f4e1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:12.818465 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c61ae0-240e-4e9e-a730-f2871b4fcb27 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:12.831801 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:12.846171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 501/1012] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:12.857879 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526f57e-5c27-4773-9735-e9ba9a8e6f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:12.858552 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526f57e-5c27-4773-9735-e9ba9a8e6f80 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:12.858835 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526f57e-5c27-4773-9735-e9ba9a8e6f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:12.859108 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526f57e-5c27-4773-9735-e9ba9a8e6f80 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:12.859818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526f57e-5c27-4773-9735-e9ba9a8e6f80 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:12.861291 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526f57e-5c27-4773-9735-e9ba9a8e6f80 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:12.868696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cfa6b-5711-4444-894c-cef538f4e1b1 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:12.890497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 512/1013] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 03:16:12 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:16:12.898178 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:12.992875 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cfa6b-5711-4444-894c-cef538f4e1b1 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:13.033133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d90fd0-e7d9-40fd-96cf-57b2ca1f8747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:13.033648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d90fd0-e7d9-40fd-96cf-57b2ca1f8747 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:13.033922 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d90fd0-e7d9-40fd-96cf-57b2ca1f8747 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:13.034274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d90fd0-e7d9-40fd-96cf-57b2ca1f8747 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:13.034792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce83b5-5293-41e1-baf0-7e92acb04a0e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:13.035109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce83b5-5293-41e1-baf0-7e92acb04a0e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:13.035202 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d90fd0-e7d9-40fd-96cf-57b2ca1f8747 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:13.035410 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce83b5-5293-41e1-baf0-7e92acb04a0e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:13.036726 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d90fd0-e7d9-40fd-96cf-57b2ca1f8747 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:13.037114 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 513/1014] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:16:13.043090 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c377ee-afda-418e-9205-ecb08c83a73c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:13.043367 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c377ee-afda-418e-9205-ecb08c83a73c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:13.043631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c377ee-afda-418e-9205-ecb08c83a73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:13.055235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 502/1015] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 03:16:12 2022] POST /identity/v3/services => generated 242 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:16:13.064441 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-16c377ee-afda-418e-9205-ecb08c83a73c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:13.066285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-16c377ee-afda-418e-9205-ecb08c83a73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:13.157148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 514/1016] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:13 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:13.180631 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d90fd0-e7d9-40fd-96cf-57b2ca1f8747 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:13.283473 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:13.309258 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d90fd0-e7d9-40fd-96cf-57b2ca1f8747 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:13.352508 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65235f-0dfc-4a66-95fd-6608af574ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:13.353695 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65235f-0dfc-4a66-95fd-6608af574ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:13.354629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65235f-0dfc-4a66-95fd-6608af574ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:13.355175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65235f-0dfc-4a66-95fd-6608af574ba0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:13.356023 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65235f-0dfc-4a66-95fd-6608af574ba0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:13.357612 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65235f-0dfc-4a66-95fd-6608af574ba0 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:13.371555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-3b65235f-0dfc-4a66-95fd-6608af574ba0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 03:16:13.371555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:13.371555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:16:13.371555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:16:13.371555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:16:13.371555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:16:13.371555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:16:13.371555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:13.371555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 03:16:13.371555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:13.371555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:16:13.371555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:13.371555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:13.371555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:13.371555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:13.371555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:13.371555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:13.372673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:13.372673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:13.372673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:13.372673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:13.372673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:13.372673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:13.372673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:16:13.372673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:16:13.372673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:16:13.372673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:16:13.372673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:13.372673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:13.372673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:13.372673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:13.372673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:13.372673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:13.373525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:13.373525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:13.373525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:13.373525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:13.373525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:13.373525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:13.373525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:13.373525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:13.373525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:13.373525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:13.373525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:16:13.373525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:13.373525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 03:16:13.373525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:13.376597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 503/1017] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:16:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:13.380812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c377ee-afda-418e-9205-ecb08c83a73c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:13.487925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:13.504445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c377ee-afda-418e-9205-ecb08c83a73c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:13.549471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a63f9-535a-45af-9a1a-8f794f61cab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:13.550061 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a63f9-535a-45af-9a1a-8f794f61cab5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:13.550342 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a63f9-535a-45af-9a1a-8f794f61cab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:13.550615 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a63f9-535a-45af-9a1a-8f794f61cab5 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:13.551335 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a63f9-535a-45af-9a1a-8f794f61cab5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:13.551638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a63f9-535a-45af-9a1a-8f794f61cab5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:13.553072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a63f9-535a-45af-9a1a-8f794f61cab5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:13.559459 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 515/1018] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 03:16:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:13.568001 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65235f-0dfc-4a66-95fd-6608af574ba0 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:13.699229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65235f-0dfc-4a66-95fd-6608af574ba0 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:13.738558 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e1c13-1e1c-4bb5-b96e-57cde059d7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:13.739284 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e1c13-1e1c-4bb5-b96e-57cde059d7be None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:13.739588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e1c13-1e1c-4bb5-b96e-57cde059d7be None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:13.739882 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e1c13-1e1c-4bb5-b96e-57cde059d7be None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:13.740663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e1c13-1e1c-4bb5-b96e-57cde059d7be None admin] RBAC: Adding query filter params (type=compute) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:13.740972 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e1c13-1e1c-4bb5-b96e-57cde059d7be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:13.742358 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e1c13-1e1c-4bb5-b96e-57cde059d7be None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:13.752585 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 504/1019] 10.222.0.26 () {56 vars in 1112 bytes} [Tue Jul 12 03:16:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:13.754268 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a63f9-535a-45af-9a1a-8f794f61cab5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:13.882636 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a63f9-535a-45af-9a1a-8f794f61cab5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:13.923321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc2dd2-fd94-46d9-ac61-bac9bbc7c643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:13.924394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc2dd2-fd94-46d9-ac61-bac9bbc7c643 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:13.925013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc2dd2-fd94-46d9-ac61-bac9bbc7c643 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:13.925488 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc2dd2-fd94-46d9-ac61-bac9bbc7c643 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:13.926481 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc2dd2-fd94-46d9-ac61-bac9bbc7c643 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:13.928157 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc2dd2-fd94-46d9-ac61-bac9bbc7c643 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:13.952207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 516/1020] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 03:16:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:16:15.069204 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761e163-72e3-46a5-97db-a0a455d1d847 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:15.069756 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761e163-72e3-46a5-97db-a0a455d1d847 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:15.069756 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761e163-72e3-46a5-97db-a0a455d1d847 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:15.071088 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 505/1021] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:15.076846 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0fceb-f5b0-4b88-92c9-e11d68886426 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:15.077303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0fceb-f5b0-4b88-92c9-e11d68886426 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:15.077382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0fceb-f5b0-4b88-92c9-e11d68886426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:15.095577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bbb0fceb-f5b0-4b88-92c9-e11d68886426 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:15.096877 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bbb0fceb-f5b0-4b88-92c9-e11d68886426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:15.099738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:15.178144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 517/1022] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:15.204311 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761e163-72e3-46a5-97db-a0a455d1d847 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:15.206778 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96eeff7-769c-4405-be42-677c3c714277 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:15.207072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96eeff7-769c-4405-be42-677c3c714277 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:15.207352 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96eeff7-769c-4405-be42-677c3c714277 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:15.209665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 518/1023] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:15.213576 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb929e-f7ec-4f92-9b52-9f6c15484e24 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:15.214008 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb929e-f7ec-4f92-9b52-9f6c15484e24 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:15.214475 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb929e-f7ec-4f92-9b52-9f6c15484e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:15.228683 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:15.232007 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-88fb929e-f7ec-4f92-9b52-9f6c15484e24 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:15.233363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-88fb929e-f7ec-4f92-9b52-9f6c15484e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:15.309397 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 519/1024] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 03:16:15.333117 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb929e-f7ec-4f92-9b52-9f6c15484e24 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:15.333283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761e163-72e3-46a5-97db-a0a455d1d847 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:15.371142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773f349-d0ae-46bd-b755-a2b2f3fbdb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:15.371940 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773f349-d0ae-46bd-b755-a2b2f3fbdb70 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:15.372214 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773f349-d0ae-46bd-b755-a2b2f3fbdb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:15.372485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773f349-d0ae-46bd-b755-a2b2f3fbdb70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:15.373671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773f349-d0ae-46bd-b755-a2b2f3fbdb70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:15.375449 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773f349-d0ae-46bd-b755-a2b2f3fbdb70 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:15.380968 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 506/1025] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:15.383583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773f349-d0ae-46bd-b755-a2b2f3fbdb70 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:15.408674 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:15.443931 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb929e-f7ec-4f92-9b52-9f6c15484e24 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:15.470310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:15.483744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dcf7f-a883-4bd3-a137-9901e89137c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:15.484673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dcf7f-a883-4bd3-a137-9901e89137c4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:15.484802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dcf7f-a883-4bd3-a137-9901e89137c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:15.485076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dcf7f-a883-4bd3-a137-9901e89137c4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:15.485727 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715dcf7f-a883-4bd3-a137-9901e89137c4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:15.487110 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715dcf7f-a883-4bd3-a137-9901e89137c4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:15.493338 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773f349-d0ae-46bd-b755-a2b2f3fbdb70 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:15.499454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-715dcf7f-a883-4bd3-a137-9901e89137c4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 03:16:15.499454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:15.499454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:16:15.499454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:16:15.499454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:16:15.499454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:16:15.499454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:16:15.499454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:15.499454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 03:16:15.499454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:15.499454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:16:15.499454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:15.499454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:15.499454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:15.499454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:15.499454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:15.499454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:15.500416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:15.500416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:15.500416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:15.500416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:15.500416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:15.500416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:15.500416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:16:15.500416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:16:15.500416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:16:15.500416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:16:15.500416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:15.500416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:15.500416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:15.500416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:15.500416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:15.500416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:15.505439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:15.505439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:15.505439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:15.505439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:15.505439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:15.505439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:15.505439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:15.505439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:15.505439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:15.505439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:15.505439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:16:15.505439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:15.505439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 03:16:15.505439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:15.505439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 520/1026] 10.222.0.26 () {56 vars in 1105 bytes} [Tue Jul 12 03:16:15 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:16:15.507185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dcf7f-a883-4bd3-a137-9901e89137c4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:15.532428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a91ae-88ff-4944-9f63-095ee34dd186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:15.533129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a91ae-88ff-4944-9f63-095ee34dd186 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:15.533403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a91ae-88ff-4944-9f63-095ee34dd186 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:15.533739 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a91ae-88ff-4944-9f63-095ee34dd186 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:15.534372 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a91ae-88ff-4944-9f63-095ee34dd186 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:15.535863 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a91ae-88ff-4944-9f63-095ee34dd186 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:15.568559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 507/1027] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:16:15 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:16:15.631621 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dcf7f-a883-4bd3-a137-9901e89137c4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:15.665508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:15.673034 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb713c48-d830-4a67-bc0c-a19ba72f444a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:15.673714 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb713c48-d830-4a67-bc0c-a19ba72f444a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:15.674017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb713c48-d830-4a67-bc0c-a19ba72f444a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:15.674289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb713c48-d830-4a67-bc0c-a19ba72f444a None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:15.675010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb713c48-d830-4a67-bc0c-a19ba72f444a None admin] RBAC: Adding query filter params (name=image) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:15.675312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb713c48-d830-4a67-bc0c-a19ba72f444a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:15.679101 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb713c48-d830-4a67-bc0c-a19ba72f444a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:15.684784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 521/1028] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:15.690534 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a91ae-88ff-4944-9f63-095ee34dd186 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:15.799945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a91ae-88ff-4944-9f63-095ee34dd186 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:15.835387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c0383-2c18-4aba-868c-cf6e37473345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:15.836310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c0383-2c18-4aba-868c-cf6e37473345 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:15.836755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c0383-2c18-4aba-868c-cf6e37473345 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:15.837165 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c0383-2c18-4aba-868c-cf6e37473345 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:15.838035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c0383-2c18-4aba-868c-cf6e37473345 None admin] RBAC: Adding query filter params (type=image) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:15.838507 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c0383-2c18-4aba-868c-cf6e37473345 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:15.840017 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c0383-2c18-4aba-868c-cf6e37473345 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:15.842622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:15.848565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 508/1029] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:15.852621 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb713c48-d830-4a67-bc0c-a19ba72f444a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:15.957835 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb713c48-d830-4a67-bc0c-a19ba72f444a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:15.993312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0326ab-8203-45ad-a6bd-eb1ace0f7a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:15.993964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0326ab-8203-45ad-a6bd-eb1ace0f7a5c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:15.994242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0326ab-8203-45ad-a6bd-eb1ace0f7a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:15.994471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0326ab-8203-45ad-a6bd-eb1ace0f7a5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:15.995772 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0326ab-8203-45ad-a6bd-eb1ace0f7a5c None admin] RBAC: Adding query filter params (interface=public, service_id=721a7e5ff1c4434b8596e3a06735e50f, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:15.996082 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0326ab-8203-45ad-a6bd-eb1ace0f7a5c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:15.997485 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0326ab-8203-45ad-a6bd-eb1ace0f7a5c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:16.003304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 522/1030] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Jul 12 03:16:15 2022] GET /identity/v3/endpoints?service_id=721a7e5ff1c4434b8596e3a06735e50f&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:16.008857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c0383-2c18-4aba-868c-cf6e37473345 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:16.116697 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c0383-2c18-4aba-868c-cf6e37473345 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:16.120554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b973bd3-74e5-49da-a8ba-83b65ac31583 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:16.120981 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b973bd3-74e5-49da-a8ba-83b65ac31583 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:16.121092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b973bd3-74e5-49da-a8ba-83b65ac31583 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:16.122665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 523/1031] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:16:16.127396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d8977-1255-4c03-b8f7-396d5d6421f6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:16.127656 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d8977-1255-4c03-b8f7-396d5d6421f6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:16.127908 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d8977-1255-4c03-b8f7-396d5d6421f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:16.145374 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0c2d8977-1255-4c03-b8f7-396d5d6421f6 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:16.146569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0c2d8977-1255-4c03-b8f7-396d5d6421f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:16.154810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd24c7a-cc92-4a64-b92f-ac5230cb80ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:16.155742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd24c7a-cc92-4a64-b92f-ac5230cb80ba None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:16.156310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd24c7a-cc92-4a64-b92f-ac5230cb80ba None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:16.156748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd24c7a-cc92-4a64-b92f-ac5230cb80ba None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:16.157603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd24c7a-cc92-4a64-b92f-ac5230cb80ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:16.159158 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd24c7a-cc92-4a64-b92f-ac5230cb80ba None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:16.166617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 509/1032] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 03:16:16 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:16:16.205305 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:16.223330 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 524/1033] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 03:16:16.247141 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd24c7a-cc92-4a64-b92f-ac5230cb80ba None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:16.316915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:16.360051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd24c7a-cc92-4a64-b92f-ac5230cb80ba None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:16.393792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc3bf2-2c82-45b9-ba0c-9f933161bff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:16.394614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3bf2-2c82-45b9-ba0c-9f933161bff4 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:16.394883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3bf2-2c82-45b9-ba0c-9f933161bff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:16.395153 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3bf2-2c82-45b9-ba0c-9f933161bff4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:16.405364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc3bf2-2c82-45b9-ba0c-9f933161bff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:16:16.413439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-85cc3bf2-2c82-45b9-ba0c-9f933161bff4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 03:16:16.413439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:16.413439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:16.413439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:16.413439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:16.413439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:16.413439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:16.413439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:16.413439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:16.413439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:16.413439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:16.413439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:16.413439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:16:16.413439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:16:16.413439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:16:16.413439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:16:16.414337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:16:16.414337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:16:16.414337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:16:16.414337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:16:16.414337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:16.414337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:16.414337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:16.414337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:16.414337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:16.414337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:16.414337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:16.414337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:16.414337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:16.414337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:16.414337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:16.414337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:16.415175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:16.415175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:16.415175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:16.415175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:16.415175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:16:16.415175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:16:16.415175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:16:16.415175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:16:16.415175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:16:16.415175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:16:16.415175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 03:16:16.415175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:16.415175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 510/1034] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Jul 12 03:16:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:16.420899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d8977-1255-4c03-b8f7-396d5d6421f6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:16.522594 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d8977-1255-4c03-b8f7-396d5d6421f6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:16.557014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb8d54-defc-4db6-8f1c-a8f48d33ac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:16.557708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8d54-defc-4db6-8f1c-a8f48d33ac06 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:16.557989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8d54-defc-4db6-8f1c-a8f48d33ac06 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:16.558257 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8d54-defc-4db6-8f1c-a8f48d33ac06 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:16.559012 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb8d54-defc-4db6-8f1c-a8f48d33ac06 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:16.559310 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb8d54-defc-4db6-8f1c-a8f48d33ac06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:16.560698 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb8d54-defc-4db6-8f1c-a8f48d33ac06 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:16.568875 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 525/1035] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Jul 12 03:16:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:16.574576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc3bf2-2c82-45b9-ba0c-9f933161bff4 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:16.674785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc3bf2-2c82-45b9-ba0c-9f933161bff4 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:16.707836 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:16.719532 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc4341-92b7-462e-bbe8-7573ac9f5704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:16.720761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc4341-92b7-462e-bbe8-7573ac9f5704 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:16.721044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc4341-92b7-462e-bbe8-7573ac9f5704 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:16.721318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc4341-92b7-462e-bbe8-7573ac9f5704 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:16.732624 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc4341-92b7-462e-bbe8-7573ac9f5704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:16.734091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc4341-92b7-462e-bbe8-7573ac9f5704 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:16.752286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-badc4341-92b7-462e-bbe8-7573ac9f5704 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:16.752286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:16.752286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:16.752286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:16.752286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:16.752286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:16.752286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:16.752286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:16.752286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:16.752286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:16.752286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:16.752286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:16.752286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:16:16.752286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:16:16.752286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:16:16.753300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:16:16.753300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:16.753300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:16.753300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:16.753300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:16.753300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:16.753300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:16.753300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:16.753300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:16.753300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:16.753300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:16.753300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:16.753300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:16.753300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:16.753300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:16.753300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:16.753300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:16.754185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:16:16.754185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:16:16.754185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:16.754185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:16.754185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 511/1036] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:16.760489 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb8d54-defc-4db6-8f1c-a8f48d33ac06 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:16.814769 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:16.866747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb8d54-defc-4db6-8f1c-a8f48d33ac06 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:16.901494 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55f371-26ed-42d4-9586-ccb2dde580d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:16.902166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55f371-26ed-42d4-9586-ccb2dde580d6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:16.902448 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55f371-26ed-42d4-9586-ccb2dde580d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:16.902722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55f371-26ed-42d4-9586-ccb2dde580d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:16.903456 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55f371-26ed-42d4-9586-ccb2dde580d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:16.903759 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55f371-26ed-42d4-9586-ccb2dde580d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:16.905185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55f371-26ed-42d4-9586-ccb2dde580d6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:16.917412 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 526/1037] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:16.923154 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc4341-92b7-462e-bbe8-7573ac9f5704 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:17.033072 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc4341-92b7-462e-bbe8-7573ac9f5704 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:17.066618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349186a-8a59-4b09-8403-6a7fe527c272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:17.067347 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349186a-8a59-4b09-8403-6a7fe527c272 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:17.067627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349186a-8a59-4b09-8403-6a7fe527c272 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:17.067899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349186a-8a59-4b09-8403-6a7fe527c272 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:17.075862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349186a-8a59-4b09-8403-6a7fe527c272 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:17.077350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349186a-8a59-4b09-8403-6a7fe527c272 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:17.091761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d349186a-8a59-4b09-8403-6a7fe527c272 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:16:17.091761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:17.091761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:17.091761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:17.091761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:17.091761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:17.091761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:17.091761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:17.091761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:17.091761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:17.091761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:17.091761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:17.091761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:16:17.091761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:16:17.091761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:16:17.091761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:17.092751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:17.098994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:17.098994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:17.098994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:16:17.098994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:16:17.098994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:16:17.098994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:16:17.098994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:16:17.098994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:16:17.098994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:16:17.098994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:17.098994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 512/1038] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 03:16:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:17.101386 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55f371-26ed-42d4-9586-ccb2dde580d6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:17.207690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55f371-26ed-42d4-9586-ccb2dde580d6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:17.219410 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:17.246161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7a890-c17b-4ee8-8146-5112c0a81952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:17.246847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7a890-c17b-4ee8-8146-5112c0a81952 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:17.247136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7a890-c17b-4ee8-8146-5112c0a81952 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:17.247378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7a890-c17b-4ee8-8146-5112c0a81952 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:17.248245 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7a890-c17b-4ee8-8146-5112c0a81952 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:17.248572 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7a890-c17b-4ee8-8146-5112c0a81952 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:17.250035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7a890-c17b-4ee8-8146-5112c0a81952 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:17.273971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 527/1039] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 03:16:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:17.275541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349186a-8a59-4b09-8403-6a7fe527c272 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:17.315324 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:17.381356 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349186a-8a59-4b09-8403-6a7fe527c272 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:17.421479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a933c-a1d7-458f-9f08-d752bd3aa802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:17.422127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a933c-a1d7-458f-9f08-d752bd3aa802 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:17.422403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a933c-a1d7-458f-9f08-d752bd3aa802 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:17.422667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a933c-a1d7-458f-9f08-d752bd3aa802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:17.489447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a933c-a1d7-458f-9f08-d752bd3aa802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:17.490892 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a933c-a1d7-458f-9f08-d752bd3aa802 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:17.523554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:17.595800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 513/1040] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:16:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 03:16:17.603195 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7a890-c17b-4ee8-8146-5112c0a81952 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:17.665977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d707209-f1e9-408e-b077-981bf4987763 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:17.666166 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d707209-f1e9-408e-b077-981bf4987763 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:17.666487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d707209-f1e9-408e-b077-981bf4987763 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:17.668079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 514/1041] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:17.673169 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed9d75-5c12-4a10-af86-c2b542a81741 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:17.673470 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed9d75-5c12-4a10-af86-c2b542a81741 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:17.673744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed9d75-5c12-4a10-af86-c2b542a81741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:17.693080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-feed9d75-5c12-4a10-af86-c2b542a81741 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:17.694248 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-feed9d75-5c12-4a10-af86-c2b542a81741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:17.715312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7a890-c17b-4ee8-8146-5112c0a81952 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:17.752532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dc2ac-061c-4fff-a88d-7e4396068f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:17.753424 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc2ac-061c-4fff-a88d-7e4396068f9b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:17.753694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc2ac-061c-4fff-a88d-7e4396068f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:17.753995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc2ac-061c-4fff-a88d-7e4396068f9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:17.764431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dc2ac-061c-4fff-a88d-7e4396068f9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:17.765924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dc2ac-061c-4fff-a88d-7e4396068f9b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:17.767280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 515/1042] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:17.783864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1d3dc2ac-061c-4fff-a88d-7e4396068f9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:17.783864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:17.783864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:17.783864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:17.783864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:17.783864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:17.783864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:17.783864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:17.783864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:17.783864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:17.783864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:17.783864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:17.783864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:16:17.783864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:16:17.783864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:16:17.784907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:16:17.784907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:17.784907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:17.784907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:17.784907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:17.784907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:17.784907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:17.784907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:17.784907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:17.784907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:17.784907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:17.784907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:17.784907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:17.784907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:17.784907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:17.784907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:17.784907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:17.785808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:16:17.785808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:16:17.785808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:17.785808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:17.788814 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 528/1043] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:17.790592 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dc2ac-061c-4fff-a88d-7e4396068f9b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:17.790696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed9d75-5c12-4a10-af86-c2b542a81741 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:17.814619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:17.862166 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:17.899371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed9d75-5c12-4a10-af86-c2b542a81741 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:17.903886 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dc2ac-061c-4fff-a88d-7e4396068f9b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:17.935443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aba01a-b0ca-492b-9eef-6354f713a9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:17.936031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aba01a-b0ca-492b-9eef-6354f713a9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:17.936314 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aba01a-b0ca-492b-9eef-6354f713a9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:17.936616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aba01a-b0ca-492b-9eef-6354f713a9b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:17.937338 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aba01a-b0ca-492b-9eef-6354f713a9b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:17.937642 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aba01a-b0ca-492b-9eef-6354f713a9b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:17.939015 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aba01a-b0ca-492b-9eef-6354f713a9b1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:17.940420 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47424b-0ad2-498f-b2b2-a18b1e59da47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:17.941554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47424b-0ad2-498f-b2b2-a18b1e59da47 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:17.941554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47424b-0ad2-498f-b2b2-a18b1e59da47 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:17.941825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47424b-0ad2-498f-b2b2-a18b1e59da47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:17.955360 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 516/1044] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:17.955541 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47424b-0ad2-498f-b2b2-a18b1e59da47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:16:17.956469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aba01a-b0ca-492b-9eef-6354f713a9b1 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:17.959630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3b47424b-0ad2-498f-b2b2-a18b1e59da47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:16:17.959630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:17.959630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:17.959630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:17.959630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:17.959630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:17.959630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:17.959630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:17.959630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:17.959630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:17.959630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:17.959630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:17.959630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:16:17.959630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:16:17.959630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:16:17.959630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:16:17.960665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:16:17.960665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:16:17.960665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:16:17.960665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:16:17.960665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:17.960665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:17.960665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:17.960665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:17.960665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:17.960665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:17.960665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:17.960665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:17.960665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:17.960665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:17.960665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:17.960665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:17.961507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:17.961507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:17.961507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:17.961507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:17.961507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:16:17.961507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:16:17.961507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:16:17.961507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:16:17.961507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:16:17.961507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:16:17.961507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:16:17.961507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:17.961507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 529/1045] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:16:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:16:17.966952 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47424b-0ad2-498f-b2b2-a18b1e59da47 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:18.050526 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:18.061990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aba01a-b0ca-492b-9eef-6354f713a9b1 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:18.071954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47424b-0ad2-498f-b2b2-a18b1e59da47 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:18.090134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:18.100346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e7c5b-57f0-45ea-b72c-5f3a6d62c9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:18.101182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e7c5b-57f0-45ea-b72c-5f3a6d62c9ff None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:18.101462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e7c5b-57f0-45ea-b72c-5f3a6d62c9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:18.101732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e7c5b-57f0-45ea-b72c-5f3a6d62c9ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:18.108954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e7c5b-57f0-45ea-b72c-5f3a6d62c9ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:18.110399 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e7c5b-57f0-45ea-b72c-5f3a6d62c9ff None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:18.114160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb0a2c-14e3-418e-9999-904b625efb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:18.115014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb0a2c-14e3-418e-9999-904b625efb04 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:18.115443 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb0a2c-14e3-418e-9999-904b625efb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:18.115860 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb0a2c-14e3-418e-9999-904b625efb04 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:18.117067 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb0a2c-14e3-418e-9999-904b625efb04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:18.117520 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb0a2c-14e3-418e-9999-904b625efb04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:18.119038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb0a2c-14e3-418e-9999-904b625efb04 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:18.124607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-427e7c5b-57f0-45ea-b72c-5f3a6d62c9ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:16:18.124607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:18.124607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:18.124607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:18.124607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:18.124607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:18.124607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:18.124607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:18.124607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:18.124607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:18.124607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:18.124607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:18.124607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:16:18.124607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:16:18.124607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:16:18.125528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:16:18.125528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:18.125528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:18.125528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:18.125528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:18.125528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:18.125528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:18.125528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:18.125528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:18.125528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:18.125528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:18.125528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:18.125528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:18.125528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:18.125528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:18.125528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:18.125528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:18.126420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:16:18.126420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:16:18.126420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:16:18.126420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:16:18.126420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:16:18.126420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:16:18.126420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:16:18.126420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:18.133328 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 530/1046] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:16:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:18.133452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 517/1047] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:16:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:18.134037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e7c5b-57f0-45ea-b72c-5f3a6d62c9ff None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:18.134161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb0a2c-14e3-418e-9999-904b625efb04 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:18.235690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb0a2c-14e3-418e-9999-904b625efb04 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:18.237076 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e7c5b-57f0-45ea-b72c-5f3a6d62c9ff None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:18.271658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a25a0-b307-4190-9e7d-d32d7df45160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:18.272000 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed65455-b7e2-4dc0-86f3-9da456816cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:18.272619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a25a0-b307-4190-9e7d-d32d7df45160 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:18.272804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed65455-b7e2-4dc0-86f3-9da456816cbf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:18.272962 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a25a0-b307-4190-9e7d-d32d7df45160 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:18.273139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed65455-b7e2-4dc0-86f3-9da456816cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:18.273264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a25a0-b307-4190-9e7d-d32d7df45160 None admin] PATH_INFO: `/v3/users/899d41dc15cb4d95ab8f3a3fac427213` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:18.273490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed65455-b7e2-4dc0-86f3-9da456816cbf None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:18.274289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed65455-b7e2-4dc0-86f3-9da456816cbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:18.274601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed65455-b7e2-4dc0-86f3-9da456816cbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:18.276287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed65455-b7e2-4dc0-86f3-9da456816cbf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:18.287243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a25a0-b307-4190-9e7d-d32d7df45160 None admin] RBAC: Authorizing `identity:get_user(user_id=899d41dc15cb4d95ab8f3a3fac427213)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:18.288728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a25a0-b307-4190-9e7d-d32d7df45160 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:18.289146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 531/1048] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:16:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:18.290287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c36cfa-4ca7-4e5a-bc90-78c4d46ca4c5 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:18.290575 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c36cfa-4ca7-4e5a-bc90-78c4d46ca4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:18.290852 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c36cfa-4ca7-4e5a-bc90-78c4d46ca4c5 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:18.292254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 532/1049] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:18.294961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c36cfa-4ca7-4e5a-bc90-78c4d46ca4c5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:18.295696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 518/1050] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:16:18 2022] GET /identity/v3/users/899d41dc15cb4d95ab8f3a3fac427213 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:18.296659 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a25a0-b307-4190-9e7d-d32d7df45160 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:18.298086 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:18.343636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:18.397184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a25a0-b307-4190-9e7d-d32d7df45160 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:18.398874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c36cfa-4ca7-4e5a-bc90-78c4d46ca4c5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:18.430803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926268e4-374a-4b6f-96d7-b50f1d096f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:18.431468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926268e4-374a-4b6f-96d7-b50f1d096f86 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:18.431751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926268e4-374a-4b6f-96d7-b50f1d096f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:18.432019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f04d45-6663-4e23-868e-ed04f2f6c85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:18.432131 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926268e4-374a-4b6f-96d7-b50f1d096f86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:18.432730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f04d45-6663-4e23-868e-ed04f2f6c85e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:18.433016 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f04d45-6663-4e23-868e-ed04f2f6c85e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:18.433290 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f04d45-6663-4e23-868e-ed04f2f6c85e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:18.434124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f04d45-6663-4e23-868e-ed04f2f6c85e None admin] RBAC: Adding query filter params (role.id=e85eb3b871ec47ddaf83b195c9d4e9db, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=0c43d9d0a6264b19a843077a4669ce70) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:18.434490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f04d45-6663-4e23-868e-ed04f2f6c85e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:18.435872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f04d45-6663-4e23-868e-ed04f2f6c85e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:18.441709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 533/1051] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:16:18 2022] GET /identity/v3/role_assignments?user.id=0c43d9d0a6264b19a843077a4669ce70&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=e85eb3b871ec47ddaf83b195c9d4e9db => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:18.442880 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018188fb-342b-4983-b283-aac4fed40285 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:18.443153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018188fb-342b-4983-b283-aac4fed40285 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:18.443430 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018188fb-342b-4983-b283-aac4fed40285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:18.461810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-018188fb-342b-4983-b283-aac4fed40285 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:18.463045 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-018188fb-342b-4983-b283-aac4fed40285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:18.523095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926268e4-374a-4b6f-96d7-b50f1d096f86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:18.524550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926268e4-374a-4b6f-96d7-b50f1d096f86 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:18.541622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:18.550405 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 534/1052] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:18.574651 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018188fb-342b-4983-b283-aac4fed40285 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:18.576825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:18.642979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 519/1053] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:16:18 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 03:16:18.649027 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926268e4-374a-4b6f-96d7-b50f1d096f86 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:18.686715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018188fb-342b-4983-b283-aac4fed40285 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:18.728657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10075faa-0012-42ba-8e26-1d52cbd1cb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:18.729514 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10075faa-0012-42ba-8e26-1d52cbd1cb63 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:18.729784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10075faa-0012-42ba-8e26-1d52cbd1cb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:18.730048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10075faa-0012-42ba-8e26-1d52cbd1cb63 None admin] PATH_INFO: `/v3/services/image` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:18.730702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10075faa-0012-42ba-8e26-1d52cbd1cb63 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:18.732128 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10075faa-0012-42ba-8e26-1d52cbd1cb63 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:18.743790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-10075faa-0012-42ba-8e26-1d52cbd1cb63 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 03:16:18.743790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:18.743790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:16:18.743790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:16:18.743790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:16:18.743790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:16:18.743790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:16:18.743790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:18.743790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 03:16:18.743790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:18.743790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:16:18.743790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:18.743790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:18.743790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:18.743790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:18.743790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:18.743790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:18.744868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:18.744868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:18.744868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:18.744868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:18.744868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:18.744868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:18.744868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:16:18.744868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:16:18.744868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:16:18.744868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:16:18.744868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:18.744868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:18.744868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:18.744868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:18.744868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:18.744868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:18.745868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:18.745868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:18.745868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:18.745868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:18.745868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:18.745868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:18.745868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:18.745868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:18.745868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:18.745868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:18.745868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:16:18.745868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:16:18.745868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 03:16:18.745868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:18.745868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 535/1054] 10.222.0.26 () {56 vars in 1105 bytes} [Tue Jul 12 03:16:18 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:16:18.750894 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10075faa-0012-42ba-8e26-1d52cbd1cb63 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:18.760464 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926268e4-374a-4b6f-96d7-b50f1d096f86 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:18.798329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569553a1-1a91-40cc-a231-7c4d469d62b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:18.799105 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569553a1-1a91-40cc-a231-7c4d469d62b7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:18.799378 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569553a1-1a91-40cc-a231-7c4d469d62b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:18.799644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569553a1-1a91-40cc-a231-7c4d469d62b7 None admin] PATH_INFO: `/v3/projects/e1064512a02e40c68c05da7a55e2ebe4` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:18.801434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569553a1-1a91-40cc-a231-7c4d469d62b7 None admin] RBAC: Authorizing `identity:get_project(project_id=e1064512a02e40c68c05da7a55e2ebe4)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:18.802856 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569553a1-1a91-40cc-a231-7c4d469d62b7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:18.804703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 520/1055] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:16:18 2022] GET /identity/v3/projects/e1064512a02e40c68c05da7a55e2ebe4 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:18.810604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569553a1-1a91-40cc-a231-7c4d469d62b7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:18.817755 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:18.826228 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:18.862859 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10075faa-0012-42ba-8e26-1d52cbd1cb63 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:18.900031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff38ebc-37a2-46e6-b9c0-78c9b9cfb8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:18.900760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff38ebc-37a2-46e6-b9c0-78c9b9cfb8db None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:18.901094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff38ebc-37a2-46e6-b9c0-78c9b9cfb8db None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:18.901588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff38ebc-37a2-46e6-b9c0-78c9b9cfb8db None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:18.902425 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff38ebc-37a2-46e6-b9c0-78c9b9cfb8db None admin] RBAC: Adding query filter params (name=image) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:18.902732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff38ebc-37a2-46e6-b9c0-78c9b9cfb8db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:18.904124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff38ebc-37a2-46e6-b9c0-78c9b9cfb8db None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:18.914644 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 536/1056] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:18.915633 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff38ebc-37a2-46e6-b9c0-78c9b9cfb8db None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:18.917368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569553a1-1a91-40cc-a231-7c4d469d62b7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:18.954814 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03deaf-740d-4f9b-9d21-2799be6fa716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:18.955471 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03deaf-740d-4f9b-9d21-2799be6fa716 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:18.955749 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03deaf-740d-4f9b-9d21-2799be6fa716 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:18.956019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03deaf-740d-4f9b-9d21-2799be6fa716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:18.956877 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03deaf-740d-4f9b-9d21-2799be6fa716 None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=e1064512a02e40c68c05da7a55e2ebe4, user.id=899d41dc15cb4d95ab8f3a3fac427213) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:18.957188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03deaf-740d-4f9b-9d21-2799be6fa716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:18.958628 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03deaf-740d-4f9b-9d21-2799be6fa716 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:18.964640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 521/1057] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:16:18 2022] GET /identity/v3/role_assignments?user.id=899d41dc15cb4d95ab8f3a3fac427213&scope.project.id=e1064512a02e40c68c05da7a55e2ebe4&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:19.029073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff38ebc-37a2-46e6-b9c0-78c9b9cfb8db None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:19.059410 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:19.072163 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db503a-7ce4-45c2-bc7c-057a8eb97e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:19.072961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db503a-7ce4-45c2-bc7c-057a8eb97e4a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:19.073429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db503a-7ce4-45c2-bc7c-057a8eb97e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:19.073798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db503a-7ce4-45c2-bc7c-057a8eb97e4a None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:19.074534 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db503a-7ce4-45c2-bc7c-057a8eb97e4a None admin] RBAC: Adding query filter params (type=image) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:19.074840 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db503a-7ce4-45c2-bc7c-057a8eb97e4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:19.076255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db503a-7ce4-45c2-bc7c-057a8eb97e4a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:19.087043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 537/1058] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:19.088555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03deaf-740d-4f9b-9d21-2799be6fa716 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:19.170365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:19.193112 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03deaf-740d-4f9b-9d21-2799be6fa716 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:19.225750 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180f7c2-6be0-4013-9d93-b17da9923898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:19.226411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180f7c2-6be0-4013-9d93-b17da9923898 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:19.226691 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180f7c2-6be0-4013-9d93-b17da9923898 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:19.226955 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180f7c2-6be0-4013-9d93-b17da9923898 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:19.227695 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180f7c2-6be0-4013-9d93-b17da9923898 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:19.229128 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180f7c2-6be0-4013-9d93-b17da9923898 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:19.249606 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 522/1059] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 03:16:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:16:20.472961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdd86a-5587-4871-ba99-e0d5e9037dc7 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:20.473530 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdd86a-5587-4871-ba99-e0d5e9037dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:20.473530 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdd86a-5587-4871-ba99-e0d5e9037dc7 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:20.475056 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 538/1060] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:20.480445 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b736-4964-4f70-92fa-77f6330e7644 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:20.480868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b736-4964-4f70-92fa-77f6330e7644 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:20.481121 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b736-4964-4f70-92fa-77f6330e7644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:20.498671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-bf66b736-4964-4f70-92fa-77f6330e7644 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:20.499864 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bf66b736-4964-4f70-92fa-77f6330e7644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:20.580561 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 523/1061] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:20.600807 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdd86a-5587-4871-ba99-e0d5e9037dc7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:20.717738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdd86a-5587-4871-ba99-e0d5e9037dc7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:20.753065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc10f2-1b06-4f59-ab66-4c0600b2098d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:20.753804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc10f2-1b06-4f59-ab66-4c0600b2098d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:20.754080 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc10f2-1b06-4f59-ab66-4c0600b2098d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:20.754351 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc10f2-1b06-4f59-ab66-4c0600b2098d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:20.765489 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc10f2-1b06-4f59-ab66-4c0600b2098d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:16:20.773699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e5dc10f2-1b06-4f59-ab66-4c0600b2098d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 03:16:20.773699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:20.773699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:20.773699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:20.773699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:20.773699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:20.773699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:20.773699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:20.773699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:20.773699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:20.773699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:20.773699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:20.773699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:16:20.773699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:16:20.773699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:16:20.773699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:16:20.774612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:16:20.774612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:16:20.774612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:16:20.774612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:16:20.774612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:20.774612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:20.774612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:20.774612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:20.774612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:20.774612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:20.774612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:20.774612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:20.774612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:20.774612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:20.774612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:20.774612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:20.775422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:20.775422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:20.775422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:20.775422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:20.775422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:16:20.775422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:16:20.775422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:16:20.775422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:16:20.775422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:16:20.775422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:16:20.775422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 03:16:20.775422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:20.780442 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 539/1062] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Jul 12 03:16:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:20.781736 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66b736-4964-4f70-92fa-77f6330e7644 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:20.843191 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:20.887236 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66b736-4964-4f70-92fa-77f6330e7644 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:20.921309 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbb782-9342-4a15-a262-629d0884bbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:20.921986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbb782-9342-4a15-a262-629d0884bbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:20.922260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbb782-9342-4a15-a262-629d0884bbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:20.922524 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbb782-9342-4a15-a262-629d0884bbc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:20.923269 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dbb782-9342-4a15-a262-629d0884bbc9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:20.923564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dbb782-9342-4a15-a262-629d0884bbc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:20.924952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dbb782-9342-4a15-a262-629d0884bbc9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:20.938056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 524/1063] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Jul 12 03:16:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:20.939550 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc10f2-1b06-4f59-ab66-4c0600b2098d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:20.991900 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:21.020541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a97a7-d689-486a-adf8-f0f7100a44d4 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:21.020840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a97a7-d689-486a-adf8-f0f7100a44d4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:21.021034 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a97a7-d689-486a-adf8-f0f7100a44d4 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:21.022909 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 525/1064] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:21.028686 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0289-c71f-48c5-9264-c238a9eaed73 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:21.029037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0289-c71f-48c5-9264-c238a9eaed73 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:21.029234 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0289-c71f-48c5-9264-c238a9eaed73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:21.046280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc10f2-1b06-4f59-ab66-4c0600b2098d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:21.047168 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3abb0289-c71f-48c5-9264-c238a9eaed73 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:21.048327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3abb0289-c71f-48c5-9264-c238a9eaed73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:21.089515 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30773e3-202e-4993-8bf1-798dbb196515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:21.090318 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30773e3-202e-4993-8bf1-798dbb196515 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:21.090599 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30773e3-202e-4993-8bf1-798dbb196515 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:21.090871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30773e3-202e-4993-8bf1-798dbb196515 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:21.101981 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30773e3-202e-4993-8bf1-798dbb196515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:21.103448 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30773e3-202e-4993-8bf1-798dbb196515 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:21.121423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 526/1065] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 03:16:21.121590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c30773e3-202e-4993-8bf1-798dbb196515 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:21.121590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:21.121590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:21.121590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:21.121590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:21.121590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:21.121590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:21.121590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:21.121590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:21.121590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:21.121590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:21.121590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:21.121590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:16:21.121590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:16:21.121590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:16:21.122652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:16:21.122652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:21.122652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:21.122652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:21.122652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:21.122652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:21.122652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:21.122652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:21.122652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:21.122652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:21.122652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:21.122652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:21.122652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:21.122652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:21.122652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:21.122652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:21.122652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:21.123544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:16:21.123544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:16:21.123544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:21.123544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:21.127961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 540/1066] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:21.128794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb0289-c71f-48c5-9264-c238a9eaed73 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:21.143986 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30773e3-202e-4993-8bf1-798dbb196515 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:21.181134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:21.234231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb0289-c71f-48c5-9264-c238a9eaed73 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:21.257601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:21.262132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30773e3-202e-4993-8bf1-798dbb196515 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:21.272473 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629e1d2-e9ac-43a9-bfab-5b1ad08f2113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:21.273236 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629e1d2-e9ac-43a9-bfab-5b1ad08f2113 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:21.273513 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629e1d2-e9ac-43a9-bfab-5b1ad08f2113 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:21.273786 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629e1d2-e9ac-43a9-bfab-5b1ad08f2113 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:21.274507 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629e1d2-e9ac-43a9-bfab-5b1ad08f2113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:21.274806 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629e1d2-e9ac-43a9-bfab-5b1ad08f2113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:21.276308 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629e1d2-e9ac-43a9-bfab-5b1ad08f2113 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:21.292670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 527/1067] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:21.293748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629e1d2-e9ac-43a9-bfab-5b1ad08f2113 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:21.303675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789b693-92f5-4fa5-9030-77b713477adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:21.304484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789b693-92f5-4fa5-9030-77b713477adb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:21.304791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789b693-92f5-4fa5-9030-77b713477adb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:21.305061 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789b693-92f5-4fa5-9030-77b713477adb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:21.315721 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789b693-92f5-4fa5-9030-77b713477adb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:16:21.323779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c789b693-92f5-4fa5-9030-77b713477adb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:16:21.323779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:21.323779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:21.323779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:21.323779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:21.323779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:21.323779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:21.323779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:21.323779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:21.323779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:21.323779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:21.323779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:21.323779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:16:21.323779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:16:21.323779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:16:21.323779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:16:21.324796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:16:21.324796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:16:21.324796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:16:21.324796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:16:21.324796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:21.324796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:21.324796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:21.324796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:21.324796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:21.324796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:21.324796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:21.324796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:21.324796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:21.324796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:21.324796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:21.324796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:21.325637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:21.325637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:21.325637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:21.325637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:21.325637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:16:21.325637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:16:21.325637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:16:21.325637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:16:21.325637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:16:21.325637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:16:21.325637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:16:21.325637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:21.325637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 541/1068] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:16:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:16:21.329892 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cce95a-bd16-4e25-b832-f0b2a19cce53 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:21.330416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cce95a-bd16-4e25-b832-f0b2a19cce53 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:21.330695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cce95a-bd16-4e25-b832-f0b2a19cce53 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:21.332357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 542/1069] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:21.333076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cce95a-bd16-4e25-b832-f0b2a19cce53 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:21.397788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629e1d2-e9ac-43a9-bfab-5b1ad08f2113 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:21.409053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:21.432907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe1ca1-fc78-4014-bc41-071148163627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:21.433708 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe1ca1-fc78-4014-bc41-071148163627 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:21.433992 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe1ca1-fc78-4014-bc41-071148163627 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:21.434326 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe1ca1-fc78-4014-bc41-071148163627 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:21.435493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cce95a-bd16-4e25-b832-f0b2a19cce53 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:21.441763 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe1ca1-fc78-4014-bc41-071148163627 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:21.443352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe1ca1-fc78-4014-bc41-071148163627 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:21.457452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-05fe1ca1-fc78-4014-bc41-071148163627 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:16:21.457452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:21.457452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:21.457452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:21.457452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:21.457452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:21.457452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:21.457452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:21.457452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:21.457452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:21.457452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:21.457452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:21.457452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:16:21.457452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:16:21.457452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:16:21.457452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:21.458427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:21.459350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:21.459350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:21.459350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:16:21.459350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:16:21.459350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:16:21.459350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:16:21.459350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:16:21.459350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:16:21.459350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:16:21.459350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:21.459350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 528/1070] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 03:16:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:21.459935 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0432f46-0dc1-4c66-9522-1e7af756465c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:21.460166 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0432f46-0dc1-4c66-9522-1e7af756465c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:21.460370 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0432f46-0dc1-4c66-9522-1e7af756465c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:21.478066 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f0432f46-0dc1-4c66-9522-1e7af756465c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:21.478279 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb48e10-4e08-4681-9942-ec597be2d61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:21.478989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48e10-4e08-4681-9942-ec597be2d61f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:21.479321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f0432f46-0dc1-4c66-9522-1e7af756465c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:21.479458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48e10-4e08-4681-9942-ec597be2d61f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:21.479665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48e10-4e08-4681-9942-ec597be2d61f None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:21.480424 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb48e10-4e08-4681-9942-ec597be2d61f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:21.480772 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb48e10-4e08-4681-9942-ec597be2d61f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:21.482150 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb48e10-4e08-4681-9942-ec597be2d61f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:21.491287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 543/1071] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:16:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:21.491848 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb48e10-4e08-4681-9942-ec597be2d61f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:21.519808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:21.547676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 529/1072] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:21.548895 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0432f46-0dc1-4c66-9522-1e7af756465c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:21.603396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb48e10-4e08-4681-9942-ec597be2d61f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:21.638323 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959137b-9c4f-4499-ac75-9f5d75a41f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:21.639011 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959137b-9c4f-4499-ac75-9f5d75a41f6d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:21.639283 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959137b-9c4f-4499-ac75-9f5d75a41f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:21.639542 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959137b-9c4f-4499-ac75-9f5d75a41f6d None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:21.640380 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959137b-9c4f-4499-ac75-9f5d75a41f6d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:21.640706 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959137b-9c4f-4499-ac75-9f5d75a41f6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:21.642159 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959137b-9c4f-4499-ac75-9f5d75a41f6d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:21.645374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:21.648593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0432f46-0dc1-4c66-9522-1e7af756465c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:21.660439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 544/1073] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 03:16:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:21.661316 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959137b-9c4f-4499-ac75-9f5d75a41f6d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:21.691975 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f794073-33da-49b5-9fb4-7a6f6723a678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:21.692896 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f794073-33da-49b5-9fb4-7a6f6723a678 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:21.693175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f794073-33da-49b5-9fb4-7a6f6723a678 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:21.693501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f794073-33da-49b5-9fb4-7a6f6723a678 None admin] PATH_INFO: `/v3/users/899d41dc15cb4d95ab8f3a3fac427213` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:21.694763 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f794073-33da-49b5-9fb4-7a6f6723a678 None admin] RBAC: Authorizing `identity:get_user(user_id=899d41dc15cb4d95ab8f3a3fac427213)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:21.696254 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f794073-33da-49b5-9fb4-7a6f6723a678 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:21.698564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 530/1074] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:16:21 2022] GET /identity/v3/users/899d41dc15cb4d95ab8f3a3fac427213 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:21.699432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f794073-33da-49b5-9fb4-7a6f6723a678 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:21.747487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:21.766446 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959137b-9c4f-4499-ac75-9f5d75a41f6d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:21.798058 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f794073-33da-49b5-9fb4-7a6f6723a678 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:21.801680 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f90a09-a75a-40b7-837d-5f42d294592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:21.802335 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f90a09-a75a-40b7-837d-5f42d294592c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:21.802615 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f90a09-a75a-40b7-837d-5f42d294592c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:21.802887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f90a09-a75a-40b7-837d-5f42d294592c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:21.832078 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfbfe3-4112-407a-b526-ba34459dbf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:21.832909 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfbfe3-4112-407a-b526-ba34459dbf50 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:21.833184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfbfe3-4112-407a-b526-ba34459dbf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:21.833456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfbfe3-4112-407a-b526-ba34459dbf50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:21.843346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfbfe3-4112-407a-b526-ba34459dbf50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:21.845174 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfbfe3-4112-407a-b526-ba34459dbf50 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:21.862541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-98cfbfe3-4112-407a-b526-ba34459dbf50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:21.862541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:21.862541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:21.862541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:21.862541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:21.862541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:21.862541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:21.862541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:21.862541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:21.862541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:21.862541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:21.862541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:21.862541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:16:21.862541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:16:21.862541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:16:21.863484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:16:21.863484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:21.863484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:21.863484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:21.863484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:21.863484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:21.863484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:21.863484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:21.863484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:21.863484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:21.863484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:21.863484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:21.863484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:21.863484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:21.863484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:21.863484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:21.863484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:21.864365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:16:21.864365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:16:21.864365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:21.864365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:21.864365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 531/1075] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:21.864682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfbfe3-4112-407a-b526-ba34459dbf50 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:21.873130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f90a09-a75a-40b7-837d-5f42d294592c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:21.874584 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f90a09-a75a-40b7-837d-5f42d294592c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:21.889445 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:21.955921 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:21.980509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 545/1076] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:16:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 03:16:21.981358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f90a09-a75a-40b7-837d-5f42d294592c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:21.994673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfbfe3-4112-407a-b526-ba34459dbf50 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:22.030671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97bd83-c9de-437b-9c5a-ad498a27dbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:22.031547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97bd83-c9de-437b-9c5a-ad498a27dbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:22.031829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97bd83-c9de-437b-9c5a-ad498a27dbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:22.032103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97bd83-c9de-437b-9c5a-ad498a27dbf8 None admin] PATH_INFO: `/v3/projects/e1064512a02e40c68c05da7a55e2ebe4` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:22.033341 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97bd83-c9de-437b-9c5a-ad498a27dbf8 None admin] RBAC: Authorizing `identity:get_project(project_id=e1064512a02e40c68c05da7a55e2ebe4)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:22.034787 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97bd83-c9de-437b-9c5a-ad498a27dbf8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:22.036506 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 532/1077] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:16:21 2022] GET /identity/v3/projects/e1064512a02e40c68c05da7a55e2ebe4 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:22.037285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97bd83-c9de-437b-9c5a-ad498a27dbf8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:22.090338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f90a09-a75a-40b7-837d-5f42d294592c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:22.123930 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:22.127341 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19429269-38f1-40d5-a810-c3eaac04154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:22.128004 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19429269-38f1-40d5-a810-c3eaac04154a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:22.128281 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19429269-38f1-40d5-a810-c3eaac04154a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:22.128580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19429269-38f1-40d5-a810-c3eaac04154a None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:22.129325 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19429269-38f1-40d5-a810-c3eaac04154a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:22.129616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19429269-38f1-40d5-a810-c3eaac04154a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:22.130995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19429269-38f1-40d5-a810-c3eaac04154a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:22.136451 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97bd83-c9de-437b-9c5a-ad498a27dbf8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:22.142465 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 546/1078] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:22.143226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19429269-38f1-40d5-a810-c3eaac04154a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:22.171008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c19514-f485-4e2d-8892-57d03ffd4d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:22.171806 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c19514-f485-4e2d-8892-57d03ffd4d5f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:22.172088 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c19514-f485-4e2d-8892-57d03ffd4d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:22.172355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c19514-f485-4e2d-8892-57d03ffd4d5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:22.182270 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c19514-f485-4e2d-8892-57d03ffd4d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:22.183734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c19514-f485-4e2d-8892-57d03ffd4d5f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:22.188473 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:22.201732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d3c19514-f485-4e2d-8892-57d03ffd4d5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:22.201732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:22.201732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:22.201732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:22.201732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:22.201732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:22.201732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:22.201732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:22.201732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:22.201732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:22.201732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:22.201732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:22.201732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:16:22.201732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:16:22.201732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:16:22.202664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:16:22.202664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:22.202664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:22.202664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:22.202664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:22.202664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:22.202664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:22.202664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:22.202664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:22.202664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:22.202664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:22.202664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:22.202664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:22.202664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:22.202664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:22.202664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:22.202664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:22.203555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:16:22.203555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:16:22.203555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:22.203555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:22.203555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 533/1079] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:22.203838 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c19514-f485-4e2d-8892-57d03ffd4d5f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:22.254598 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19429269-38f1-40d5-a810-c3eaac04154a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:22.287760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58a57f-db0f-40ab-a107-0c7a8f2ee3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:22.288683 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58a57f-db0f-40ab-a107-0c7a8f2ee3c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:22.288960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58a57f-db0f-40ab-a107-0c7a8f2ee3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:22.289225 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58a57f-db0f-40ab-a107-0c7a8f2ee3c3 None admin] PATH_INFO: `/v3/projects/e1064512a02e40c68c05da7a55e2ebe4/users/899d41dc15cb4d95ab8f3a3fac427213/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:22.291701 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58a57f-db0f-40ab-a107-0c7a8f2ee3c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1064512a02e40c68c05da7a55e2ebe4, user_id=899d41dc15cb4d95ab8f3a3fac427213, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:22.293201 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58a57f-db0f-40ab-a107-0c7a8f2ee3c3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:22.307273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 547/1080] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:16:22 2022] PUT /identity/v3/projects/e1064512a02e40c68c05da7a55e2ebe4/users/899d41dc15cb4d95ab8f3a3fac427213/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:16:22.308078 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58a57f-db0f-40ab-a107-0c7a8f2ee3c3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:22.309774 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c19514-f485-4e2d-8892-57d03ffd4d5f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:22.350227 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94322587-fcff-40c6-aaec-0feb7656c3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:22.350949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94322587-fcff-40c6-aaec-0feb7656c3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:22.351226 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94322587-fcff-40c6-aaec-0feb7656c3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:22.351502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94322587-fcff-40c6-aaec-0feb7656c3a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:22.360460 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94322587-fcff-40c6-aaec-0feb7656c3a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:22.362174 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94322587-fcff-40c6-aaec-0feb7656c3a4 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:22.365199 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:22.378760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-94322587-fcff-40c6-aaec-0feb7656c3a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:16:22.378760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:22.378760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:22.378760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:22.378760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:22.378760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:22.378760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:22.378760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:22.378760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:22.378760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:22.378760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:22.378760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:22.378760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:16:22.378760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:16:22.378760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:16:22.379747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:16:22.379747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:22.379747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:22.379747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:22.379747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:22.379747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:22.379747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:22.379747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:22.379747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:22.379747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:22.379747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:22.379747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:22.379747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:22.379747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:22.379747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:22.379747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:22.379747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:22.380677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:16:22.380677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:16:22.380677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:16:22.380677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:16:22.380677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:16:22.380677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:16:22.380677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:16:22.380677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:22.380677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 534/1081] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:16:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:22.386797 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94322587-fcff-40c6-aaec-0feb7656c3a4 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:22.441322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:22.444560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58a57f-db0f-40ab-a107-0c7a8f2ee3c3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:22.489798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf284ef-045f-4954-94fd-bf3948f0212b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:22.490456 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf284ef-045f-4954-94fd-bf3948f0212b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:22.490733 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf284ef-045f-4954-94fd-bf3948f0212b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:22.491002 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf284ef-045f-4954-94fd-bf3948f0212b None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:22.491738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf284ef-045f-4954-94fd-bf3948f0212b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:22.492040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf284ef-045f-4954-94fd-bf3948f0212b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:22.493540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf284ef-045f-4954-94fd-bf3948f0212b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:22.508555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 548/1082] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:22.520081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94322587-fcff-40c6-aaec-0feb7656c3a4 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:22.562233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24069d-761f-4af2-a96f-644eaf31340a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:22.562917 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24069d-761f-4af2-a96f-644eaf31340a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:22.563190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24069d-761f-4af2-a96f-644eaf31340a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:22.563467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24069d-761f-4af2-a96f-644eaf31340a None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:22.564285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24069d-761f-4af2-a96f-644eaf31340a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:22.564636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24069d-761f-4af2-a96f-644eaf31340a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:22.566161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24069d-761f-4af2-a96f-644eaf31340a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:22.580213 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 535/1083] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:16:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:22.586403 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf284ef-045f-4954-94fd-bf3948f0212b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:22.694953 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf284ef-045f-4954-94fd-bf3948f0212b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:22.734180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a7d6d-1355-46b4-8e65-151a86301f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:22.735496 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a7d6d-1355-46b4-8e65-151a86301f85 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:22.735983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a7d6d-1355-46b4-8e65-151a86301f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:22.736471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a7d6d-1355-46b4-8e65-151a86301f85 None admin] PATH_INFO: `/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/0c43d9d0a6264b19a843077a4669ce70/roles/e85eb3b871ec47ddaf83b195c9d4e9db` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:22.738722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a7d6d-1355-46b4-8e65-151a86301f85 None admin] RBAC: Authorizing `identity:create_grant(project_id=afd5f89a049d40dc8456bd351f01f603, user_id=0c43d9d0a6264b19a843077a4669ce70, role_id=e85eb3b871ec47ddaf83b195c9d4e9db)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:22.740185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a7d6d-1355-46b4-8e65-151a86301f85 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:22.756018 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 549/1084] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:16:22 2022] PUT /identity/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/0c43d9d0a6264b19a843077a4669ce70/roles/e85eb3b871ec47ddaf83b195c9d4e9db => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:16:24.309660 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b13c1d-9daa-49a5-95d2-0590b96af6a3 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:24.310232 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b13c1d-9daa-49a5-95d2-0590b96af6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:24.310232 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b13c1d-9daa-49a5-95d2-0590b96af6a3 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:24.311588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 536/1085] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:24.316877 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18609b4a-5fa1-449c-bd67-c13093b0612a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:24.317319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18609b4a-5fa1-449c-bd67-c13093b0612a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:24.317407 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18609b4a-5fa1-449c-bd67-c13093b0612a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:24.335968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-18609b4a-5fa1-449c-bd67-c13093b0612a None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:24.337201 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-18609b4a-5fa1-449c-bd67-c13093b0612a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:24.352424 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:24.407308 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 550/1086] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:24.436088 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b13c1d-9daa-49a5-95d2-0590b96af6a3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:24.501416 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:24.545485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b13c1d-9daa-49a5-95d2-0590b96af6a3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:24.579573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e8594-bd61-456e-8795-174a0b66539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:24.580806 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e8594-bd61-456e-8795-174a0b66539b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:24.581303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e8594-bd61-456e-8795-174a0b66539b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:24.581800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e8594-bd61-456e-8795-174a0b66539b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:24.592318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e8594-bd61-456e-8795-174a0b66539b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:16:24.600583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d73e8594-bd61-456e-8795-174a0b66539b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:16:24.600583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:24.600583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:24.600583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:24.600583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:24.600583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:24.600583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:24.600583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:24.600583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:24.600583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:24.600583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:24.600583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:24.600583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:16:24.600583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:16:24.600583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:16:24.600583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:16:24.601512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:16:24.601512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:16:24.601512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:16:24.601512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:16:24.601512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:24.601512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:24.601512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:24.601512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:24.601512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:24.601512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:24.601512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:24.601512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:24.601512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:24.601512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:24.601512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:24.601512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:24.602355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:24.602355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:24.602355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:24.602355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:24.602355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:16:24.602355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:16:24.602355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:16:24.602355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:16:24.602355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:16:24.602355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:16:24.602355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:16:24.602355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:24.608683 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 537/1087] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:16:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:24.611001 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18609b4a-5fa1-449c-bd67-c13093b0612a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:24.717424 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18609b4a-5fa1-449c-bd67-c13093b0612a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:24.743689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50c10e-d0b8-43c2-99fa-f19193d776f3 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:24.744003 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50c10e-d0b8-43c2-99fa-f19193d776f3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:24.744435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50c10e-d0b8-43c2-99fa-f19193d776f3 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:24.746157 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 538/1088] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:16:24.751386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2536b7-6c80-43d6-b634-448c691fec19 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:24.751674 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2536b7-6c80-43d6-b634-448c691fec19 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:24.751952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2536b7-6c80-43d6-b634-448c691fec19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:24.755168 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762a3db-05e6-4983-8411-0bc3519f52a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:24.755831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762a3db-05e6-4983-8411-0bc3519f52a4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:24.756109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762a3db-05e6-4983-8411-0bc3519f52a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:24.756371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762a3db-05e6-4983-8411-0bc3519f52a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:24.757152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762a3db-05e6-4983-8411-0bc3519f52a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:24.757450 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762a3db-05e6-4983-8411-0bc3519f52a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:24.759238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762a3db-05e6-4983-8411-0bc3519f52a4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:24.767880 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 551/1089] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:16:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:24.769595 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-7f2536b7-6c80-43d6-b634-448c691fec19 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:24.770854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7f2536b7-6c80-43d6-b634-448c691fec19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:24.773809 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762a3db-05e6-4983-8411-0bc3519f52a4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:24.788829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:24.837388 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 539/1090] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:24.861810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2536b7-6c80-43d6-b634-448c691fec19 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:24.871860 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762a3db-05e6-4983-8411-0bc3519f52a4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:24.904133 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df28b34-8642-4389-ae64-5cca773cf8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:24.905041 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df28b34-8642-4389-ae64-5cca773cf8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:24.905320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df28b34-8642-4389-ae64-5cca773cf8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:24.905588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df28b34-8642-4389-ae64-5cca773cf8f4 None admin] PATH_INFO: `/v3/users/899d41dc15cb4d95ab8f3a3fac427213` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:24.906799 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df28b34-8642-4389-ae64-5cca773cf8f4 None admin] RBAC: Authorizing `identity:get_user(user_id=899d41dc15cb4d95ab8f3a3fac427213)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:24.908233 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df28b34-8642-4389-ae64-5cca773cf8f4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:24.909865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 552/1091] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:16:24 2022] GET /identity/v3/users/899d41dc15cb4d95ab8f3a3fac427213 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:24.912506 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:24.916026 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df28b34-8642-4389-ae64-5cca773cf8f4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:24.964025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2536b7-6c80-43d6-b634-448c691fec19 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:25.001664 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:25.001888 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3e4af-fdcc-48d5-ba9e-74cf5333cf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:25.002960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3e4af-fdcc-48d5-ba9e-74cf5333cf1c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:25.002960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3e4af-fdcc-48d5-ba9e-74cf5333cf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:25.003179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3e4af-fdcc-48d5-ba9e-74cf5333cf1c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:25.014065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3e4af-fdcc-48d5-ba9e-74cf5333cf1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:16:25.021913 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df28b34-8642-4389-ae64-5cca773cf8f4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:25.022310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-29f3e4af-fdcc-48d5-ba9e-74cf5333cf1c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 03:16:25.022310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:25.022310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:25.022310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:25.022310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:25.022310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:25.022310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:25.022310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:25.022310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:25.022310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:25.022310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:25.022310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:25.022310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:16:25.022310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:16:25.022310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:16:25.022310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:16:25.023371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:16:25.023371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:16:25.023371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:16:25.023371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:16:25.023371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:25.023371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:25.023371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:25.023371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:25.023371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:25.023371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:25.023371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:25.023371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:25.023371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:25.023371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:25.023371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:25.023371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:25.024279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:25.024279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:25.024279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:25.024279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:25.024279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:16:25.024279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:16:25.024279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:16:25.024279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:16:25.024279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:16:25.024279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:16:25.024279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 03:16:25.024279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:25.024279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 540/1092] 10.222.0.26 () {56 vars in 1120 bytes} [Tue Jul 12 03:16:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:16:25.029674 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3e4af-fdcc-48d5-ba9e-74cf5333cf1c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:25.058457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845de3c0-add2-47c3-acfe-18ac7d7753c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:25.059077 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de3c0-add2-47c3-acfe-18ac7d7753c7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:25.059350 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de3c0-add2-47c3-acfe-18ac7d7753c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:25.059618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de3c0-add2-47c3-acfe-18ac7d7753c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:25.130254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845de3c0-add2-47c3-acfe-18ac7d7753c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:25.131629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845de3c0-add2-47c3-acfe-18ac7d7753c7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:25.136081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3e4af-fdcc-48d5-ba9e-74cf5333cf1c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:25.146403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:25.171086 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99741246-cd57-436c-b35f-2565648bc9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:25.171750 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99741246-cd57-436c-b35f-2565648bc9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:25.172024 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99741246-cd57-436c-b35f-2565648bc9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:25.172293 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99741246-cd57-436c-b35f-2565648bc9e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:25.173058 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99741246-cd57-436c-b35f-2565648bc9e6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:25.173358 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99741246-cd57-436c-b35f-2565648bc9e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:25.174727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99741246-cd57-436c-b35f-2565648bc9e6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:25.182522 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 541/1093] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Jul 12 03:16:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:25.188208 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99741246-cd57-436c-b35f-2565648bc9e6 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:25.216483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:25.237156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 553/1094] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:16:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 03:16:25.243049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845de3c0-add2-47c3-acfe-18ac7d7753c7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:25.291867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99741246-cd57-436c-b35f-2565648bc9e6 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:25.326577 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3616e-c718-4c8e-8983-cc12b357ce50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:25.328453 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3616e-c718-4c8e-8983-cc12b357ce50 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:25.328453 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3616e-c718-4c8e-8983-cc12b357ce50 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:25.328453 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3616e-c718-4c8e-8983-cc12b357ce50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:25.338383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3616e-c718-4c8e-8983-cc12b357ce50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:25.339817 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3616e-c718-4c8e-8983-cc12b357ce50 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:25.344929 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845de3c0-add2-47c3-acfe-18ac7d7753c7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:25.358071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-43a3616e-c718-4c8e-8983-cc12b357ce50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:25.358071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:25.358071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:25.358071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:25.358071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:25.358071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:25.358071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:25.358071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:25.358071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:25.358071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:25.358071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:25.358071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:25.358071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:16:25.358071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:16:25.358071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:16:25.359037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:16:25.359037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:25.359037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:25.359037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:25.359037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:25.359037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:25.359037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:25.359037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:25.359037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:25.359037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:25.359037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:25.359037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:25.359037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:25.359037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:25.359037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:25.359037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:25.359037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:25.360100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:16:25.360100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:16:25.360100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:25.360100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:25.360100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 542/1095] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:16:25.364997 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3616e-c718-4c8e-8983-cc12b357ce50 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:25.383317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b87bb-c2a2-4e7d-8894-86a6d1a69f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:25.384125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b87bb-c2a2-4e7d-8894-86a6d1a69f8e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:25.384401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b87bb-c2a2-4e7d-8894-86a6d1a69f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:25.384855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b87bb-c2a2-4e7d-8894-86a6d1a69f8e None admin] PATH_INFO: `/v3/projects/e1064512a02e40c68c05da7a55e2ebe4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:25.386172 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b87bb-c2a2-4e7d-8894-86a6d1a69f8e None admin] RBAC: Authorizing `identity:get_project(project_id=e1064512a02e40c68c05da7a55e2ebe4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:25.387635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b87bb-c2a2-4e7d-8894-86a6d1a69f8e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:25.389400 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 554/1096] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:16:25 2022] GET /identity/v3/projects/e1064512a02e40c68c05da7a55e2ebe4 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:25.391375 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:25.395692 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b87bb-c2a2-4e7d-8894-86a6d1a69f8e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:25.443455 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:25.465595 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3616e-c718-4c8e-8983-cc12b357ce50 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:25.498906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b87bb-c2a2-4e7d-8894-86a6d1a69f8e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:25.499281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff1168-bb2d-44be-80da-cb9743af8160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:25.499944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff1168-bb2d-44be-80da-cb9743af8160 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:25.500223 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff1168-bb2d-44be-80da-cb9743af8160 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:25.500492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff1168-bb2d-44be-80da-cb9743af8160 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:25.501234 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff1168-bb2d-44be-80da-cb9743af8160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:25.501541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff1168-bb2d-44be-80da-cb9743af8160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:25.502913 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff1168-bb2d-44be-80da-cb9743af8160 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:25.515258 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 543/1097] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:25.520920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff1168-bb2d-44be-80da-cb9743af8160 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:25.533608 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0e1c6-9075-42a7-92fd-1a61daf6326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:25.534262 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0e1c6-9075-42a7-92fd-1a61daf6326f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:25.534539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0e1c6-9075-42a7-92fd-1a61daf6326f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:25.534795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0e1c6-9075-42a7-92fd-1a61daf6326f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:25.535619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0e1c6-9075-42a7-92fd-1a61daf6326f None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=e1064512a02e40c68c05da7a55e2ebe4, user.id=899d41dc15cb4d95ab8f3a3fac427213) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:25.535923 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0e1c6-9075-42a7-92fd-1a61daf6326f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:25.537384 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0e1c6-9075-42a7-92fd-1a61daf6326f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:25.543220 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 555/1098] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:16:25 2022] GET /identity/v3/role_assignments?user.id=899d41dc15cb4d95ab8f3a3fac427213&scope.project.id=e1064512a02e40c68c05da7a55e2ebe4&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:25.611102 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:25.628079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff1168-bb2d-44be-80da-cb9743af8160 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:25.664883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6490908-0b67-48f7-afd3-7743f58e765a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:25.665587 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6490908-0b67-48f7-afd3-7743f58e765a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:25.665928 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6490908-0b67-48f7-afd3-7743f58e765a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:25.666220 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6490908-0b67-48f7-afd3-7743f58e765a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:25.674582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6490908-0b67-48f7-afd3-7743f58e765a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:25.676085 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6490908-0b67-48f7-afd3-7743f58e765a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:25.693627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d6490908-0b67-48f7-afd3-7743f58e765a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:16:25.693627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:25.693627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:25.693627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:25.693627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:25.693627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:25.693627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:25.693627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:25.693627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:25.693627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:25.693627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:25.693627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:25.693627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:16:25.693627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:16:25.693627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:16:25.693627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:25.694716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:25.695745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:25.695745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:25.695745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:16:25.695745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:16:25.695745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:16:25.695745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:16:25.695745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:16:25.695745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:16:25.695745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 03:16:25.695745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:25.695745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 544/1099] 10.222.0.26 () {56 vars in 1093 bytes} [Tue Jul 12 03:16:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:16:25.701263 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0e1c6-9075-42a7-92fd-1a61daf6326f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:25.802075 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0e1c6-9075-42a7-92fd-1a61daf6326f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:25.815339 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:25.838285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919cbab-da0c-4a34-979c-6b5597a03a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:25.838956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919cbab-da0c-4a34-979c-6b5597a03a93 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:25.839228 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919cbab-da0c-4a34-979c-6b5597a03a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:25.839495 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919cbab-da0c-4a34-979c-6b5597a03a93 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:25.840333 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919cbab-da0c-4a34-979c-6b5597a03a93 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:25.840662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919cbab-da0c-4a34-979c-6b5597a03a93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:25.842106 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919cbab-da0c-4a34-979c-6b5597a03a93 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:25.859736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 556/1100] 10.222.0.26 () {56 vars in 1133 bytes} [Tue Jul 12 03:16:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:25.865540 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6490908-0b67-48f7-afd3-7743f58e765a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:25.970105 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6490908-0b67-48f7-afd3-7743f58e765a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:26.004639 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4974df3-f53b-4f7c-a078-62e6bcacc3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:26.005281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4974df3-f53b-4f7c-a078-62e6bcacc3ad None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:26.005558 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4974df3-f53b-4f7c-a078-62e6bcacc3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:26.005827 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4974df3-f53b-4f7c-a078-62e6bcacc3ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:26.020554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:26.073377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4974df3-f53b-4f7c-a078-62e6bcacc3ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:26.074821 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4974df3-f53b-4f7c-a078-62e6bcacc3ad None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:26.174258 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 545/1101] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:16:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 03:16:26.180329 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919cbab-da0c-4a34-979c-6b5597a03a93 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:26.287166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919cbab-da0c-4a34-979c-6b5597a03a93 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:26.323060 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082986ef-95dd-4821-88db-b7f3f97744b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:26.323869 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082986ef-95dd-4821-88db-b7f3f97744b2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:26.324152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082986ef-95dd-4821-88db-b7f3f97744b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:26.324426 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082986ef-95dd-4821-88db-b7f3f97744b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:26.334849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082986ef-95dd-4821-88db-b7f3f97744b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:26.336297 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082986ef-95dd-4821-88db-b7f3f97744b2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:26.355276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-082986ef-95dd-4821-88db-b7f3f97744b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:26.355276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:26.355276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:26.355276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:26.355276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:26.355276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:26.355276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:26.355276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:26.355276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:26.355276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:26.355276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:26.355276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:26.355276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:16:26.355276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:16:26.355276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:16:26.356716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:16:26.356716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:26.356716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:26.356716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:26.356716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:26.356716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:26.356716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:26.356716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:26.356716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:26.356716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:26.356716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:26.356716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:26.356716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:26.356716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:26.356716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:26.356716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:26.356716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:26.357662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:16:26.357662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:16:26.357662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:16:26.357662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:26.357662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 557/1102] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:26.362425 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4974df3-f53b-4f7c-a078-62e6bcacc3ad None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:26.410735 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:26.466742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4974df3-f53b-4f7c-a078-62e6bcacc3ad None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:26.502200 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e4507-c7a4-4082-8f4e-6e286a17df69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:26.502858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e4507-c7a4-4082-8f4e-6e286a17df69 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:26.503134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e4507-c7a4-4082-8f4e-6e286a17df69 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:26.503403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e4507-c7a4-4082-8f4e-6e286a17df69 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:26.504125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e4507-c7a4-4082-8f4e-6e286a17df69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:26.504423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e4507-c7a4-4082-8f4e-6e286a17df69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:26.505822 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e4507-c7a4-4082-8f4e-6e286a17df69 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:26.517771 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 546/1103] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:26.523642 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082986ef-95dd-4821-88db-b7f3f97744b2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:26.549531 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:26.629982 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082986ef-95dd-4821-88db-b7f3f97744b2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:26.673725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440c6b5-c344-4eda-b3dd-02712d903ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:26.674553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440c6b5-c344-4eda-b3dd-02712d903ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:26.674864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440c6b5-c344-4eda-b3dd-02712d903ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:26.675144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440c6b5-c344-4eda-b3dd-02712d903ae8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:26.684419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440c6b5-c344-4eda-b3dd-02712d903ae8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:26.685947 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440c6b5-c344-4eda-b3dd-02712d903ae8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:26.701258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-8440c6b5-c344-4eda-b3dd-02712d903ae8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:16:26.701258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:26.701258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:26.701258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:26.701258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:26.701258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:26.701258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:26.701258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:26.701258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:26.701258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:26.701258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:26.701258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:26.701258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:16:26.701258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:16:26.701258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:16:26.702199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:16:26.702199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:26.702199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:26.702199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:26.702199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:26.702199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:26.702199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:26.702199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:26.702199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:26.702199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:26.702199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:26.702199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:26.702199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:26.702199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:26.702199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:26.702199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:26.702199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:26.703093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:16:26.703093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:16:26.703093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:16:26.703093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:16:26.703093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:16:26.703093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:16:26.703093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:16:26.703093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:26.704887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 558/1104] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:16:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:26.708488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e4507-c7a4-4082-8f4e-6e286a17df69 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:26.812947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e4507-c7a4-4082-8f4e-6e286a17df69 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:26.815245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:26.850289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d51a69-128a-4016-bfc0-c3ea90924f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:26.850953 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d51a69-128a-4016-bfc0-c3ea90924f74 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:26.851213 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d51a69-128a-4016-bfc0-c3ea90924f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:26.851486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d51a69-128a-4016-bfc0-c3ea90924f74 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:26.852270 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d51a69-128a-4016-bfc0-c3ea90924f74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:26.852596 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d51a69-128a-4016-bfc0-c3ea90924f74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:26.854098 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d51a69-128a-4016-bfc0-c3ea90924f74 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:26.865463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 547/1105] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:16:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:26.871818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440c6b5-c344-4eda-b3dd-02712d903ae8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:26.957908 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:26.977821 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440c6b5-c344-4eda-b3dd-02712d903ae8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:27.012885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae1001-b513-4460-9064-a93b6a677cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:27.013547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae1001-b513-4460-9064-a93b6a677cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:27.013831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae1001-b513-4460-9064-a93b6a677cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:27.014104 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae1001-b513-4460-9064-a93b6a677cd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:27.014947 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae1001-b513-4460-9064-a93b6a677cd1 None admin] RBAC: Adding query filter params (role.id=e85eb3b871ec47ddaf83b195c9d4e9db, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=0c43d9d0a6264b19a843077a4669ce70) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:27.015258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae1001-b513-4460-9064-a93b6a677cd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:27.016725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae1001-b513-4460-9064-a93b6a677cd1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:27.023073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 559/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:16:26 2022] GET /identity/v3/role_assignments?user.id=0c43d9d0a6264b19a843077a4669ce70&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=e85eb3b871ec47ddaf83b195c9d4e9db => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:27.595385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2ace-a551-48db-9b4b-a1b5ef8ef508 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:27.595939 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2ace-a551-48db-9b4b-a1b5ef8ef508 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:27.595939 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2ace-a551-48db-9b4b-a1b5ef8ef508 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:27.597441 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 548/1107] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:27.602812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d067cb-7d03-45a3-8394-2ac9faead694 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:27.603319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d067cb-7d03-45a3-8394-2ac9faead694 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:27.603464 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d067cb-7d03-45a3-8394-2ac9faead694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:27.621943 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-42d067cb-7d03-45a3-8394-2ac9faead694 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:27.623155 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-42d067cb-7d03-45a3-8394-2ac9faead694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:27.694661 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 560/1108] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:27.719931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d2ace-a551-48db-9b4b-a1b5ef8ef508 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:27.822622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d2ace-a551-48db-9b4b-a1b5ef8ef508 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:27.859071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28736149-6052-4f78-b47f-ae767967627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:27.859798 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28736149-6052-4f78-b47f-ae767967627b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:27.860073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28736149-6052-4f78-b47f-ae767967627b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:27.860336 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28736149-6052-4f78-b47f-ae767967627b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:27.861638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28736149-6052-4f78-b47f-ae767967627b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:27.863153 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28736149-6052-4f78-b47f-ae767967627b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:27.864817 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 549/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:27.870881 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d067cb-7d03-45a3-8394-2ac9faead694 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:27.943082 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:27.973237 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d067cb-7d03-45a3-8394-2ac9faead694 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:28.011764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91eafe-04f3-431a-9ee5-26d3ccdee318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:28.012434 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91eafe-04f3-431a-9ee5-26d3ccdee318 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:28.012739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91eafe-04f3-431a-9ee5-26d3ccdee318 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:28.013015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91eafe-04f3-431a-9ee5-26d3ccdee318 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:28.013723 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91eafe-04f3-431a-9ee5-26d3ccdee318 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:28.015172 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91eafe-04f3-431a-9ee5-26d3ccdee318 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:28.043483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 561/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:16:27 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:16:30.135093 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06006dd-43b4-4096-9348-aed9a68ce89d None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:30.136038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06006dd-43b4-4096-9348-aed9a68ce89d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:30.136038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06006dd-43b4-4096-9348-aed9a68ce89d None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:30.138001 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 550/1111] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:30.146806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec964c-368a-4fe2-8070-6ee966b774b2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:30.147246 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec964c-368a-4fe2-8070-6ee966b774b2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:30.147374 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec964c-368a-4fe2-8070-6ee966b774b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:30.172058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1aec964c-368a-4fe2-8070-6ee966b774b2 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:30.173290 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1aec964c-368a-4fe2-8070-6ee966b774b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:30.253725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 562/1112] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:30.287229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06006dd-43b4-4096-9348-aed9a68ce89d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:30.327731 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:30.413508 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06006dd-43b4-4096-9348-aed9a68ce89d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:30.451775 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59580d50-ac5e-4bc6-b180-35c47ecafb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:30.453237 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59580d50-ac5e-4bc6-b180-35c47ecafb22 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:30.453683 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59580d50-ac5e-4bc6-b180-35c47ecafb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:30.454126 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59580d50-ac5e-4bc6-b180-35c47ecafb22 None admin] PATH_INFO: `/v3/roles/690fc625fea1445fa7e0e8f40ae2246c` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:30.456834 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59580d50-ac5e-4bc6-b180-35c47ecafb22 None admin] RBAC: Authorizing `identity:get_role(role_id=690fc625fea1445fa7e0e8f40ae2246c)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:30.459093 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59580d50-ac5e-4bc6-b180-35c47ecafb22 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:30.461348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 551/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:16:30 2022] GET /identity/v3/roles/690fc625fea1445fa7e0e8f40ae2246c => generated 223 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:30.468194 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec964c-368a-4fe2-8070-6ee966b774b2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:30.533421 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:30.579605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec964c-368a-4fe2-8070-6ee966b774b2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:30.615898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699060ca-30e4-4821-a874-3b2fbbc5ff47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:30.616798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699060ca-30e4-4821-a874-3b2fbbc5ff47 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:30.617074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699060ca-30e4-4821-a874-3b2fbbc5ff47 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:30.617347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699060ca-30e4-4821-a874-3b2fbbc5ff47 None admin] PATH_INFO: `/v3/users/5afe9f4047a548199839564b7f284ece` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:30.631100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699060ca-30e4-4821-a874-3b2fbbc5ff47 None admin] RBAC: Authorizing `identity:get_user(user_id=5afe9f4047a548199839564b7f284ece)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:30.632582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699060ca-30e4-4821-a874-3b2fbbc5ff47 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:30.634273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 563/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:16:30 2022] GET /identity/v3/users/5afe9f4047a548199839564b7f284ece => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:30.640474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59580d50-ac5e-4bc6-b180-35c47ecafb22 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:30.743077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:30.746394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59580d50-ac5e-4bc6-b180-35c47ecafb22 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:30.783972 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562c63a-5421-4fe3-a71e-ee3e665a4686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:30.784651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562c63a-5421-4fe3-a71e-ee3e665a4686 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:30.784934 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562c63a-5421-4fe3-a71e-ee3e665a4686 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:30.785207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562c63a-5421-4fe3-a71e-ee3e665a4686 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:30.853441 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562c63a-5421-4fe3-a71e-ee3e665a4686 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:30.854908 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562c63a-5421-4fe3-a71e-ee3e665a4686 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:30.956313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:30.962273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 552/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:16:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 03:16:30.969123 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699060ca-30e4-4821-a874-3b2fbbc5ff47 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:31.081960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699060ca-30e4-4821-a874-3b2fbbc5ff47 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:31.111196 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:31.130139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710763d-442c-489d-8c02-bb26effb8564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:31.131023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710763d-442c-489d-8c02-bb26effb8564 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:31.131294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710763d-442c-489d-8c02-bb26effb8564 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:31.131547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710763d-442c-489d-8c02-bb26effb8564 None admin] PATH_INFO: `/v3/projects/e1064512a02e40c68c05da7a55e2ebe4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:31.132836 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710763d-442c-489d-8c02-bb26effb8564 None admin] RBAC: Authorizing `identity:get_project(project_id=e1064512a02e40c68c05da7a55e2ebe4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:31.134349 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710763d-442c-489d-8c02-bb26effb8564 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:31.136363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 564/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:16:30 2022] GET /identity/v3/projects/e1064512a02e40c68c05da7a55e2ebe4 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:31.143401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562c63a-5421-4fe3-a71e-ee3e665a4686 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:31.248589 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562c63a-5421-4fe3-a71e-ee3e665a4686 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:31.283874 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c27a6-275d-4baf-9705-a945bc1f90e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:31.284503 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c27a6-275d-4baf-9705-a945bc1f90e4 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:31.284805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c27a6-275d-4baf-9705-a945bc1f90e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:31.285073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c27a6-275d-4baf-9705-a945bc1f90e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:31.285886 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c27a6-275d-4baf-9705-a945bc1f90e4 None admin] RBAC: Adding query filter params (role.id=690fc625fea1445fa7e0e8f40ae2246c, scope.project.id=e1064512a02e40c68c05da7a55e2ebe4, user.id=5afe9f4047a548199839564b7f284ece) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:31.286194 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c27a6-275d-4baf-9705-a945bc1f90e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:31.287612 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c27a6-275d-4baf-9705-a945bc1f90e4 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:31.293478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 553/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:16:31 2022] GET /identity/v3/role_assignments?user.id=5afe9f4047a548199839564b7f284ece&scope.project.id=e1064512a02e40c68c05da7a55e2ebe4&role.id=690fc625fea1445fa7e0e8f40ae2246c => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:33.265887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5ea15-2dfa-418b-b5a0-71aea8ff208b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:33.266484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5ea15-2dfa-418b-b5a0-71aea8ff208b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:33.266484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5ea15-2dfa-418b-b5a0-71aea8ff208b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:33.267811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 565/1118] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:33.274254 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9a144-950d-4ba9-a2c2-e16b42de7147 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:33.275076 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9a144-950d-4ba9-a2c2-e16b42de7147 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:33.275312 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9a144-950d-4ba9-a2c2-e16b42de7147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:33.303806 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a2a9a144-950d-4ba9-a2c2-e16b42de7147 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:33.305712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a2a9a144-950d-4ba9-a2c2-e16b42de7147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:33.371668 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:33.381742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 554/1119] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:33.411759 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5ea15-2dfa-418b-b5a0-71aea8ff208b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:33.519809 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5ea15-2dfa-418b-b5a0-71aea8ff208b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:33.555264 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046e43a-4f51-4e1f-b0d2-df9513a16a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:33.556191 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046e43a-4f51-4e1f-b0d2-df9513a16a4f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:33.556467 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046e43a-4f51-4e1f-b0d2-df9513a16a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:33.556938 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046e43a-4f51-4e1f-b0d2-df9513a16a4f None admin] PATH_INFO: `/v3/roles/690fc625fea1445fa7e0e8f40ae2246c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:33.558534 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046e43a-4f51-4e1f-b0d2-df9513a16a4f None admin] RBAC: Authorizing `identity:get_role(role_id=690fc625fea1445fa7e0e8f40ae2246c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:33.559914 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046e43a-4f51-4e1f-b0d2-df9513a16a4f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:33.561313 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 566/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:16:33 2022] GET /identity/v3/roles/690fc625fea1445fa7e0e8f40ae2246c => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:33.567483 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9a144-950d-4ba9-a2c2-e16b42de7147 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:33.685735 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9a144-950d-4ba9-a2c2-e16b42de7147 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:33.732149 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb595d24-5e08-421f-9a03-0663d608b8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:33.733052 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb595d24-5e08-421f-9a03-0663d608b8ae None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:33.733326 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb595d24-5e08-421f-9a03-0663d608b8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:33.733623 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb595d24-5e08-421f-9a03-0663d608b8ae None admin] PATH_INFO: `/v3/users/5afe9f4047a548199839564b7f284ece` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:33.734867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb595d24-5e08-421f-9a03-0663d608b8ae None admin] RBAC: Authorizing `identity:get_user(user_id=5afe9f4047a548199839564b7f284ece)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:33.736304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb595d24-5e08-421f-9a03-0663d608b8ae None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:33.737980 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 555/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:16:33 2022] GET /identity/v3/users/5afe9f4047a548199839564b7f284ece => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:33.744368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046e43a-4f51-4e1f-b0d2-df9513a16a4f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:33.805497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:33.850091 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046e43a-4f51-4e1f-b0d2-df9513a16a4f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:33.885363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf27452-da83-481a-a07e-acf725484636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:33.886215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf27452-da83-481a-a07e-acf725484636 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:33.886496 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf27452-da83-481a-a07e-acf725484636 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:33.886767 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf27452-da83-481a-a07e-acf725484636 None admin] PATH_INFO: `/v3/projects/e1064512a02e40c68c05da7a55e2ebe4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:33.887980 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf27452-da83-481a-a07e-acf725484636 None admin] RBAC: Authorizing `identity:get_project(project_id=e1064512a02e40c68c05da7a55e2ebe4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:33.889463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf27452-da83-481a-a07e-acf725484636 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:33.891165 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 567/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:16:33 2022] GET /identity/v3/projects/e1064512a02e40c68c05da7a55e2ebe4 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:33.898068 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb595d24-5e08-421f-9a03-0663d608b8ae None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:33.972865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:34.013868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb595d24-5e08-421f-9a03-0663d608b8ae None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:34.049544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cc5af-81ec-4905-bd5b-de393d9296ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:34.050424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cc5af-81ec-4905-bd5b-de393d9296ad None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:34.050698 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cc5af-81ec-4905-bd5b-de393d9296ad None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:34.050970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cc5af-81ec-4905-bd5b-de393d9296ad None admin] PATH_INFO: `/v3/projects/e1064512a02e40c68c05da7a55e2ebe4/users/5afe9f4047a548199839564b7f284ece/roles/690fc625fea1445fa7e0e8f40ae2246c` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:34.053726 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cc5af-81ec-4905-bd5b-de393d9296ad None admin] RBAC: Authorizing `identity:create_grant(project_id=e1064512a02e40c68c05da7a55e2ebe4, user_id=5afe9f4047a548199839564b7f284ece, role_id=690fc625fea1445fa7e0e8f40ae2246c)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:34.055175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cc5af-81ec-4905-bd5b-de393d9296ad None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:34.071214 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 556/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:16:33 2022] PUT /identity/v3/projects/e1064512a02e40c68c05da7a55e2ebe4/users/5afe9f4047a548199839564b7f284ece/roles/690fc625fea1445fa7e0e8f40ae2246c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:16:36.060042 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62f6fb-51ea-46dc-b1ff-3e97a873f206 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:36.060943 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62f6fb-51ea-46dc-b1ff-3e97a873f206 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:36.060943 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62f6fb-51ea-46dc-b1ff-3e97a873f206 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:36.063024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 568/1124] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:36.069318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e12d0-7c18-4b8f-9904-5b370b50f24b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:36.069768 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e12d0-7c18-4b8f-9904-5b370b50f24b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:36.069868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e12d0-7c18-4b8f-9904-5b370b50f24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:36.089540 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-d78e12d0-7c18-4b8f-9904-5b370b50f24b None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:36.090728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d78e12d0-7c18-4b8f-9904-5b370b50f24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:36.167426 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 557/1125] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:36.191385 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62f6fb-51ea-46dc-b1ff-3e97a873f206 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:36.302543 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62f6fb-51ea-46dc-b1ff-3e97a873f206 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:36.326380 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:36.342906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689636e-24a2-42e8-87e4-0d1adacb0fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:36.343767 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689636e-24a2-42e8-87e4-0d1adacb0fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:36.344380 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689636e-24a2-42e8-87e4-0d1adacb0fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:36.344694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689636e-24a2-42e8-87e4-0d1adacb0fd7 None admin] PATH_INFO: `/v3/roles/690fc625fea1445fa7e0e8f40ae2246c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:36.346373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689636e-24a2-42e8-87e4-0d1adacb0fd7 None admin] RBAC: Authorizing `identity:get_role(role_id=690fc625fea1445fa7e0e8f40ae2246c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:36.347744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689636e-24a2-42e8-87e4-0d1adacb0fd7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:36.349163 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 569/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:16:36 2022] GET /identity/v3/roles/690fc625fea1445fa7e0e8f40ae2246c => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:36.355192 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e12d0-7c18-4b8f-9904-5b370b50f24b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:36.410216 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:36.459494 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e12d0-7c18-4b8f-9904-5b370b50f24b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:36.497070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b2243-077b-4e9a-b749-7c044238405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:36.498487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b2243-077b-4e9a-b749-7c044238405c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:36.498763 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b2243-077b-4e9a-b749-7c044238405c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:36.499028 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b2243-077b-4e9a-b749-7c044238405c None admin] PATH_INFO: `/v3/users/5afe9f4047a548199839564b7f284ece` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:36.500338 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b2243-077b-4e9a-b749-7c044238405c None admin] RBAC: Authorizing `identity:get_user(user_id=5afe9f4047a548199839564b7f284ece)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:36.501981 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b2243-077b-4e9a-b749-7c044238405c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:36.503700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 558/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:16:36 2022] GET /identity/v3/users/5afe9f4047a548199839564b7f284ece => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:36.509632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689636e-24a2-42e8-87e4-0d1adacb0fd7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:36.616010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689636e-24a2-42e8-87e4-0d1adacb0fd7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:36.651472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf15f3-a845-40cd-ac97-cecc6a5ee792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:36.652106 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf15f3-a845-40cd-ac97-cecc6a5ee792 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:36.652382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf15f3-a845-40cd-ac97-cecc6a5ee792 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:36.652652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf15f3-a845-40cd-ac97-cecc6a5ee792 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:36.723736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:36.733827 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf15f3-a845-40cd-ac97-cecc6a5ee792 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:36.735292 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf15f3-a845-40cd-ac97-cecc6a5ee792 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:36.835577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 570/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:16:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 03:16:36.845316 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b2243-077b-4e9a-b749-7c044238405c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:36.949412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b2243-077b-4e9a-b749-7c044238405c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:36.970081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:36.987247 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183add3b-4ae7-4b84-8f5b-a99380cdc74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:36.988113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183add3b-4ae7-4b84-8f5b-a99380cdc74b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:36.988391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183add3b-4ae7-4b84-8f5b-a99380cdc74b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:36.988688 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183add3b-4ae7-4b84-8f5b-a99380cdc74b None admin] PATH_INFO: `/v3/projects/e1064512a02e40c68c05da7a55e2ebe4` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:36.990002 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183add3b-4ae7-4b84-8f5b-a99380cdc74b None admin] RBAC: Authorizing `identity:get_project(project_id=e1064512a02e40c68c05da7a55e2ebe4)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:36.991489 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183add3b-4ae7-4b84-8f5b-a99380cdc74b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:36.993219 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 559/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:16:36 2022] GET /identity/v3/projects/e1064512a02e40c68c05da7a55e2ebe4 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:36.999773 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf15f3-a845-40cd-ac97-cecc6a5ee792 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:37.093573 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:37.109668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf15f3-a845-40cd-ac97-cecc6a5ee792 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:37.150674 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30819d-b021-4c1a-99d8-0e82251693f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:37.151320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30819d-b021-4c1a-99d8-0e82251693f0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:37.151598 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30819d-b021-4c1a-99d8-0e82251693f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:37.151869 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30819d-b021-4c1a-99d8-0e82251693f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:37.152738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30819d-b021-4c1a-99d8-0e82251693f0 None admin] RBAC: Adding query filter params (role.id=690fc625fea1445fa7e0e8f40ae2246c, scope.project.id=e1064512a02e40c68c05da7a55e2ebe4, user.id=5afe9f4047a548199839564b7f284ece) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:37.153050 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30819d-b021-4c1a-99d8-0e82251693f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:37.154493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30819d-b021-4c1a-99d8-0e82251693f0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:37.160308 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 571/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:16:36 2022] GET /identity/v3/role_assignments?user.id=5afe9f4047a548199839564b7f284ece&scope.project.id=e1064512a02e40c68c05da7a55e2ebe4&role.id=690fc625fea1445fa7e0e8f40ae2246c => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:39.190173 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee491f-3a3c-4eb1-aba6-4950992dc34a None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:39.190772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee491f-3a3c-4eb1-aba6-4950992dc34a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:39.190772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee491f-3a3c-4eb1-aba6-4950992dc34a None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:39.192108 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 560/1131] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:39.198697 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba0990-d10e-4ee6-9d0e-1c3c67370d64 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:39.199253 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba0990-d10e-4ee6-9d0e-1c3c67370d64 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:39.199643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba0990-d10e-4ee6-9d0e-1c3c67370d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:39.236772 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0bba0990-d10e-4ee6-9d0e-1c3c67370d64 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:39.237983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0bba0990-d10e-4ee6-9d0e-1c3c67370d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:39.316074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 572/1132] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:39.342686 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee491f-3a3c-4eb1-aba6-4950992dc34a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:39.462420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee491f-3a3c-4eb1-aba6-4950992dc34a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:39.499082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ede2d-3199-4d4d-be32-e838abb1541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:39.499868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ede2d-3199-4d4d-be32-e838abb1541b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:39.500144 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ede2d-3199-4d4d-be32-e838abb1541b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:39.500410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ede2d-3199-4d4d-be32-e838abb1541b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:39.501836 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ede2d-3199-4d4d-be32-e838abb1541b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:39.503273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ede2d-3199-4d4d-be32-e838abb1541b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:39.504923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 561/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:39.513369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba0990-d10e-4ee6-9d0e-1c3c67370d64 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:39.615454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:39.631324 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba0990-d10e-4ee6-9d0e-1c3c67370d64 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:39.670892 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e1248-2cc2-403f-9fd0-c06a59f6f469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:39.671556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e1248-2cc2-403f-9fd0-c06a59f6f469 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:39.671834 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e1248-2cc2-403f-9fd0-c06a59f6f469 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:39.672101 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e1248-2cc2-403f-9fd0-c06a59f6f469 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:39.672848 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e1248-2cc2-403f-9fd0-c06a59f6f469 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:39.674290 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e1248-2cc2-403f-9fd0-c06a59f6f469 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:39.703548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 573/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 03:16:39 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:16:41.745526 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205a3b7-5549-4ec1-a18a-2c0dcd68d3ca None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:41.746373 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205a3b7-5549-4ec1-a18a-2c0dcd68d3ca None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:41.746373 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205a3b7-5549-4ec1-a18a-2c0dcd68d3ca None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:41.748597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 562/1135] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:41.757240 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a3404-9b75-4071-b109-67f27c973fc4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:41.757655 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a3404-9b75-4071-b109-67f27c973fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:41.757817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a3404-9b75-4071-b109-67f27c973fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:41.777938 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0f1a3404-9b75-4071-b109-67f27c973fc4 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:41.779132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0f1a3404-9b75-4071-b109-67f27c973fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:41.852480 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 574/1136] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:41.877981 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205a3b7-5549-4ec1-a18a-2c0dcd68d3ca None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:41.957462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:42.003810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205a3b7-5549-4ec1-a18a-2c0dcd68d3ca None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:42.039823 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca92c6-9bfa-4f0d-9b7e-fbfb11e741af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:42.040618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca92c6-9bfa-4f0d-9b7e-fbfb11e741af None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:42.040892 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca92c6-9bfa-4f0d-9b7e-fbfb11e741af None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:42.041201 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca92c6-9bfa-4f0d-9b7e-fbfb11e741af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:42.042502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca92c6-9bfa-4f0d-9b7e-fbfb11e741af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:42.043925 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca92c6-9bfa-4f0d-9b7e-fbfb11e741af None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:42.045545 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 563/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:16:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:42.054933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a3404-9b75-4071-b109-67f27c973fc4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:42.127415 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:42.162343 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a3404-9b75-4071-b109-67f27c973fc4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:42.201210 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fc33d-aa64-45bc-b9db-9cdfe02ed6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:42.201868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fc33d-aa64-45bc-b9db-9cdfe02ed6f5 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:42.202144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fc33d-aa64-45bc-b9db-9cdfe02ed6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:42.202415 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fc33d-aa64-45bc-b9db-9cdfe02ed6f5 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:42.203120 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fc33d-aa64-45bc-b9db-9cdfe02ed6f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:42.204547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fc33d-aa64-45bc-b9db-9cdfe02ed6f5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:42.232722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 575/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:16:42 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:16:44.264476 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7dd60-f425-4c5d-9132-5443b1549f2a None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:44.265433 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7dd60-f425-4c5d-9132-5443b1549f2a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:44.265433 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7dd60-f425-4c5d-9132-5443b1549f2a None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:44.267637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 564/1139] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:44.272974 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b109d-0582-431a-af26-fffb553f8636 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:44.273397 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b109d-0582-431a-af26-fffb553f8636 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:44.273515 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b109d-0582-431a-af26-fffb553f8636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:44.293195 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-959b109d-0582-431a-af26-fffb553f8636 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:44.294402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-959b109d-0582-431a-af26-fffb553f8636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:44.372018 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 576/1140] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:44.395873 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7dd60-f425-4c5d-9132-5443b1549f2a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:44.506749 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7dd60-f425-4c5d-9132-5443b1549f2a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:44.530673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:44.543106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61a23b-c0a9-45d0-887d-c77e6756b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:44.543894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61a23b-c0a9-45d0-887d-c77e6756b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:44.544169 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61a23b-c0a9-45d0-887d-c77e6756b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:44.544433 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61a23b-c0a9-45d0-887d-c77e6756b5b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:44.554424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61a23b-c0a9-45d0-887d-c77e6756b5b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:16:44.562362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-ac61a23b-c0a9-45d0-887d-c77e6756b5b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:16:44.562362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:44.562362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:44.562362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:44.562362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:44.562362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:44.562362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:44.562362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:44.562362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:44.562362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:44.562362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:44.562362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:44.562362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:16:44.562362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:16:44.562362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:16:44.562362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:16:44.563480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:16:44.563480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:16:44.563480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:16:44.563480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:16:44.563480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:44.563480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:44.563480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:44.563480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:44.563480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:44.563480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:44.563480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:44.563480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:44.563480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:44.563480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:44.563480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:44.563480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:44.569812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:44.569812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:44.569812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:44.569812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:44.569812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:16:44.569812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:16:44.569812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:16:44.569812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:16:44.569812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:16:44.569812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:16:44.569812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:16:44.569812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:44.569812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 565/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:16:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:44.573982 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b109d-0582-431a-af26-fffb553f8636 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:44.642036 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:44.696318 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b109d-0582-431a-af26-fffb553f8636 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:44.739244 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086782f1-7eab-48c3-a650-268ec5bf6a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:44.739923 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086782f1-7eab-48c3-a650-268ec5bf6a24 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:44.740195 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086782f1-7eab-48c3-a650-268ec5bf6a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:44.740465 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086782f1-7eab-48c3-a650-268ec5bf6a24 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:44.741259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086782f1-7eab-48c3-a650-268ec5bf6a24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:44.741558 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086782f1-7eab-48c3-a650-268ec5bf6a24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:44.743061 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086782f1-7eab-48c3-a650-268ec5bf6a24 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:44.751759 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 577/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:16:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:44.757916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61a23b-c0a9-45d0-887d-c77e6756b5b2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:44.881403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61a23b-c0a9-45d0-887d-c77e6756b5b2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:44.917254 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d380e-66de-4003-8ca0-edd29557969c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:44.918113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d380e-66de-4003-8ca0-edd29557969c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:44.918387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d380e-66de-4003-8ca0-edd29557969c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:44.918652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d380e-66de-4003-8ca0-edd29557969c None admin] PATH_INFO: `/v3/users/7ff76fd1379b4e59bcf9ef11ab75208e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:44.937487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d380e-66de-4003-8ca0-edd29557969c None admin] RBAC: Authorizing `identity:get_user(user_id=7ff76fd1379b4e59bcf9ef11ab75208e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:44.938950 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d380e-66de-4003-8ca0-edd29557969c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:44.940649 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 566/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:16:44 2022] GET /identity/v3/users/7ff76fd1379b4e59bcf9ef11ab75208e => generated 286 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:44.946966 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086782f1-7eab-48c3-a650-268ec5bf6a24 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:45.060125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086782f1-7eab-48c3-a650-268ec5bf6a24 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:45.076055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:45.096185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ebd4e-e79e-4712-9059-17d5470763ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:45.096861 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ebd4e-e79e-4712-9059-17d5470763ce None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:45.097130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ebd4e-e79e-4712-9059-17d5470763ce None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:45.097399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ebd4e-e79e-4712-9059-17d5470763ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:45.165098 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ebd4e-e79e-4712-9059-17d5470763ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:45.166555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ebd4e-e79e-4712-9059-17d5470763ce None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:45.268219 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 578/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:16:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 03:16:45.274795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d380e-66de-4003-8ca0-edd29557969c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:45.330511 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:45.411483 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d380e-66de-4003-8ca0-edd29557969c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:45.447279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d6875-be73-46c7-8a46-9f2f38747614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:45.448123 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d6875-be73-46c7-8a46-9f2f38747614 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:45.448397 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d6875-be73-46c7-8a46-9f2f38747614 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:45.448689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d6875-be73-46c7-8a46-9f2f38747614 None admin] PATH_INFO: `/v3/projects/8332e0533b2a496c9f6325e7299a831e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:45.450011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d6875-be73-46c7-8a46-9f2f38747614 None admin] RBAC: Authorizing `identity:get_project(project_id=8332e0533b2a496c9f6325e7299a831e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:45.451438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d6875-be73-46c7-8a46-9f2f38747614 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:45.453188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 567/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:16:45 2022] GET /identity/v3/projects/8332e0533b2a496c9f6325e7299a831e => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:45.460454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ebd4e-e79e-4712-9059-17d5470763ce None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:45.486756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:45.578249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ebd4e-e79e-4712-9059-17d5470763ce None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:45.614445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09904d45-05f6-4621-9d30-59a2d8982f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:45.615088 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09904d45-05f6-4621-9d30-59a2d8982f8d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:45.615363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09904d45-05f6-4621-9d30-59a2d8982f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:45.615627 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09904d45-05f6-4621-9d30-59a2d8982f8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:45.616455 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09904d45-05f6-4621-9d30-59a2d8982f8d None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=8332e0533b2a496c9f6325e7299a831e, user.id=7ff76fd1379b4e59bcf9ef11ab75208e) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:45.616799 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09904d45-05f6-4621-9d30-59a2d8982f8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:45.618232 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09904d45-05f6-4621-9d30-59a2d8982f8d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:45.623758 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 579/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:16:45 2022] GET /identity/v3/role_assignments?user.id=7ff76fd1379b4e59bcf9ef11ab75208e&scope.project.id=8332e0533b2a496c9f6325e7299a831e&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:47.652156 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e8fa5-a86e-499d-bdce-15835ff58619 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:47.653098 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e8fa5-a86e-499d-bdce-15835ff58619 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:47.653098 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e8fa5-a86e-499d-bdce-15835ff58619 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:47.655239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 568/1147] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:47.661583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ced1a4-fad4-4236-a36d-bf5a52875b28 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:47.662301 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ced1a4-fad4-4236-a36d-bf5a52875b28 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:47.662447 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ced1a4-fad4-4236-a36d-bf5a52875b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:47.681508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-42ced1a4-fad4-4236-a36d-bf5a52875b28 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:47.682685 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-42ced1a4-fad4-4236-a36d-bf5a52875b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:47.752266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 580/1148] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:47.775515 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e8fa5-a86e-499d-bdce-15835ff58619 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:47.901633 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e8fa5-a86e-499d-bdce-15835ff58619 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:47.912317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:47.940737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b551d-e71e-4f8e-8dfd-8586117315ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:47.941532 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b551d-e71e-4f8e-8dfd-8586117315ed None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:47.941813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b551d-e71e-4f8e-8dfd-8586117315ed None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:47.942085 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b551d-e71e-4f8e-8dfd-8586117315ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:47.952874 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b551d-e71e-4f8e-8dfd-8586117315ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:16:47.960376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2d4b551d-e71e-4f8e-8dfd-8586117315ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:16:47.960376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:47.960376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:47.960376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:47.960376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:47.960376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:47.960376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:47.960376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:47.960376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:47.960376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:47.960376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:47.960376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:47.960376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:16:47.960376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:16:47.960376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:16:47.960376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:16:47.961546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:16:47.961546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:16:47.961546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:16:47.961546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:16:47.961546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:47.961546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:47.961546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:47.961546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:47.961546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:47.961546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:47.961546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:47.961546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:47.961546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:47.961546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:47.961546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:47.961546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:47.962757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:47.962757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:47.962757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:47.962757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:47.962757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:16:47.962757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:16:47.962757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:16:47.962757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:16:47.962757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:16:47.962757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:16:47.962757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:16:47.962757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:47.962757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 569/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:16:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:47.969517 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ced1a4-fad4-4236-a36d-bf5a52875b28 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:47.988162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:48.077649 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ced1a4-fad4-4236-a36d-bf5a52875b28 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:48.112993 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ae1de-b96b-486b-8506-adf746642c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:48.113644 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ae1de-b96b-486b-8506-adf746642c35 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:48.113926 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ae1de-b96b-486b-8506-adf746642c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:48.114195 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ae1de-b96b-486b-8506-adf746642c35 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:48.114952 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ae1de-b96b-486b-8506-adf746642c35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:48.115262 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ae1de-b96b-486b-8506-adf746642c35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:48.116650 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ae1de-b96b-486b-8506-adf746642c35 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:48.124850 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 581/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:16:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:48.133243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b551d-e71e-4f8e-8dfd-8586117315ed None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:48.238439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b551d-e71e-4f8e-8dfd-8586117315ed None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:48.274665 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6f718-fb98-440b-8ca5-3bba7d4b9566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:48.275686 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6f718-fb98-440b-8ca5-3bba7d4b9566 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:48.275912 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6f718-fb98-440b-8ca5-3bba7d4b9566 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:48.276179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6f718-fb98-440b-8ca5-3bba7d4b9566 None admin] PATH_INFO: `/v3/users/7ff76fd1379b4e59bcf9ef11ab75208e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:48.277433 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6f718-fb98-440b-8ca5-3bba7d4b9566 None admin] RBAC: Authorizing `identity:get_user(user_id=7ff76fd1379b4e59bcf9ef11ab75208e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:48.278858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6f718-fb98-440b-8ca5-3bba7d4b9566 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:48.280464 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 570/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:16:48 2022] GET /identity/v3/users/7ff76fd1379b4e59bcf9ef11ab75208e => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:48.290078 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ae1de-b96b-486b-8506-adf746642c35 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:48.367466 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:48.406318 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ae1de-b96b-486b-8506-adf746642c35 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:48.445803 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00580035-1487-46ec-a874-869b12f12166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:48.446659 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00580035-1487-46ec-a874-869b12f12166 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:48.446940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00580035-1487-46ec-a874-869b12f12166 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:48.447211 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00580035-1487-46ec-a874-869b12f12166 None admin] PATH_INFO: `/v3/projects/8332e0533b2a496c9f6325e7299a831e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:48.448476 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00580035-1487-46ec-a874-869b12f12166 None admin] RBAC: Authorizing `identity:get_project(project_id=8332e0533b2a496c9f6325e7299a831e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:48.449984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00580035-1487-46ec-a874-869b12f12166 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:48.451702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 582/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:16:48 2022] GET /identity/v3/projects/8332e0533b2a496c9f6325e7299a831e => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:48.461195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6f718-fb98-440b-8ca5-3bba7d4b9566 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:48.506147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:48.573828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6f718-fb98-440b-8ca5-3bba7d4b9566 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:48.615418 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f72204-49c5-4bed-9c46-11cf9ea1783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:48.616307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72204-49c5-4bed-9c46-11cf9ea1783a None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:48.616615 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72204-49c5-4bed-9c46-11cf9ea1783a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:48.616886 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72204-49c5-4bed-9c46-11cf9ea1783a None admin] PATH_INFO: `/v3/projects/8332e0533b2a496c9f6325e7299a831e/users/7ff76fd1379b4e59bcf9ef11ab75208e/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:48.618974 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f72204-49c5-4bed-9c46-11cf9ea1783a None admin] RBAC: Authorizing `identity:create_grant(project_id=8332e0533b2a496c9f6325e7299a831e, user_id=7ff76fd1379b4e59bcf9ef11ab75208e, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:48.620554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f72204-49c5-4bed-9c46-11cf9ea1783a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:48.637560 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 571/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:16:48 2022] PUT /identity/v3/projects/8332e0533b2a496c9f6325e7299a831e/users/7ff76fd1379b4e59bcf9ef11ab75208e/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:16:50.621105 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efa2bd-d224-41d7-8fa5-8305caf48216 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:50.622018 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efa2bd-d224-41d7-8fa5-8305caf48216 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:50.622018 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efa2bd-d224-41d7-8fa5-8305caf48216 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:50.624255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 583/1154] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:50.633446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fca53-5113-4d6a-90f5-f44f828c2211 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:50.634134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fca53-5113-4d6a-90f5-f44f828c2211 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:50.634315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fca53-5113-4d6a-90f5-f44f828c2211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:50.661645 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-763fca53-5113-4d6a-90f5-f44f828c2211 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:50.663484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-763fca53-5113-4d6a-90f5-f44f828c2211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:50.734874 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 572/1155] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:50.768857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efa2bd-d224-41d7-8fa5-8305caf48216 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:50.884954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efa2bd-d224-41d7-8fa5-8305caf48216 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:50.921397 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356f660-0165-4926-99eb-1785a980696a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:50.922186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356f660-0165-4926-99eb-1785a980696a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:50.922463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356f660-0165-4926-99eb-1785a980696a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:50.922734 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356f660-0165-4926-99eb-1785a980696a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:50.930663 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:50.934897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356f660-0165-4926-99eb-1785a980696a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:16:50.942909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a356f660-0165-4926-99eb-1785a980696a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:16:50.942909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:50.942909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:50.942909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:50.942909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:50.942909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:50.942909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:50.942909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:50.942909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:50.942909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:50.942909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:50.942909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:50.942909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:16:50.942909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:16:50.942909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:16:50.942909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:16:50.943975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:16:50.943975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:16:50.943975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:16:50.943975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:16:50.943975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:50.943975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:50.943975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:50.943975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:50.943975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:50.943975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:50.943975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:50.943975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:50.943975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:50.943975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:50.943975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:50.943975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:50.945093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:50.945093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:50.945093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:50.945093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:50.945093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:16:50.945093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:16:50.945093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:16:50.945093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:16:50.945093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:16:50.945093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:16:50.945093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:16:50.945093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:16:50.945093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 584/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:16:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:50.950465 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fca53-5113-4d6a-90f5-f44f828c2211 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:50.978683 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:51.058542 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fca53-5113-4d6a-90f5-f44f828c2211 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:51.096511 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85abc8-df32-4c75-ac99-716eb56b366c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:51.097184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85abc8-df32-4c75-ac99-716eb56b366c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:51.097457 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85abc8-df32-4c75-ac99-716eb56b366c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:51.097724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85abc8-df32-4c75-ac99-716eb56b366c None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:51.098463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85abc8-df32-4c75-ac99-716eb56b366c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:51.098755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85abc8-df32-4c75-ac99-716eb56b366c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:51.100106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85abc8-df32-4c75-ac99-716eb56b366c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:51.108384 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 573/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:16:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:16:51.114561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356f660-0165-4926-99eb-1785a980696a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:51.229774 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356f660-0165-4926-99eb-1785a980696a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:51.264447 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101aaf3-e43a-4b88-8861-76f498a16ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:51.265460 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101aaf3-e43a-4b88-8861-76f498a16ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:51.265789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101aaf3-e43a-4b88-8861-76f498a16ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:51.266111 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101aaf3-e43a-4b88-8861-76f498a16ab7 None admin] PATH_INFO: `/v3/users/7ff76fd1379b4e59bcf9ef11ab75208e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:51.267527 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101aaf3-e43a-4b88-8861-76f498a16ab7 None admin] RBAC: Authorizing `identity:get_user(user_id=7ff76fd1379b4e59bcf9ef11ab75208e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:51.268996 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101aaf3-e43a-4b88-8861-76f498a16ab7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:51.270591 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 585/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:16:51 2022] GET /identity/v3/users/7ff76fd1379b4e59bcf9ef11ab75208e => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:51.277383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85abc8-df32-4c75-ac99-716eb56b366c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:51.381903 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:51.392753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85abc8-df32-4c75-ac99-716eb56b366c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:51.428506 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e68b69-cd70-4cb5-a713-d1825d0482e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:51.429439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e68b69-cd70-4cb5-a713-d1825d0482e8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:51.429787 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e68b69-cd70-4cb5-a713-d1825d0482e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:51.430135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e68b69-cd70-4cb5-a713-d1825d0482e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:51.509730 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e68b69-cd70-4cb5-a713-d1825d0482e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:51.511196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e68b69-cd70-4cb5-a713-d1825d0482e8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:51.611920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:51.624157 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 574/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:16:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 03:16:51.633511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101aaf3-e43a-4b88-8861-76f498a16ab7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:51.704816 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:51.740060 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101aaf3-e43a-4b88-8861-76f498a16ab7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:51.776226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f5714-dcb0-44f3-ba56-5a90a04e50c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:51.777056 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f5714-dcb0-44f3-ba56-5a90a04e50c3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:51.777331 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f5714-dcb0-44f3-ba56-5a90a04e50c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:51.777598 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f5714-dcb0-44f3-ba56-5a90a04e50c3 None admin] PATH_INFO: `/v3/projects/8332e0533b2a496c9f6325e7299a831e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:51.778830 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f5714-dcb0-44f3-ba56-5a90a04e50c3 None admin] RBAC: Authorizing `identity:get_project(project_id=8332e0533b2a496c9f6325e7299a831e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:51.780262 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f5714-dcb0-44f3-ba56-5a90a04e50c3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:51.781982 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 586/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:16:51 2022] GET /identity/v3/projects/8332e0533b2a496c9f6325e7299a831e => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:51.788254 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e68b69-cd70-4cb5-a713-d1825d0482e8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:51.900973 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e68b69-cd70-4cb5-a713-d1825d0482e8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:51.937583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd66a6-3ed1-4ce7-a1a0-df98678e9801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:51.938230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd66a6-3ed1-4ce7-a1a0-df98678e9801 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:51.938510 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd66a6-3ed1-4ce7-a1a0-df98678e9801 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:51.938780 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd66a6-3ed1-4ce7-a1a0-df98678e9801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:51.939616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd66a6-3ed1-4ce7-a1a0-df98678e9801 None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=8332e0533b2a496c9f6325e7299a831e, user.id=7ff76fd1379b4e59bcf9ef11ab75208e) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:51.939923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd66a6-3ed1-4ce7-a1a0-df98678e9801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:51.941394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd66a6-3ed1-4ce7-a1a0-df98678e9801 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:51.947341 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 575/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:16:51 2022] GET /identity/v3/role_assignments?user.id=7ff76fd1379b4e59bcf9ef11ab75208e&scope.project.id=8332e0533b2a496c9f6325e7299a831e&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:53.978242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be029209-bf3e-4719-95db-e6eae36fac0b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:53.978826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be029209-bf3e-4719-95db-e6eae36fac0b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:53.978826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be029209-bf3e-4719-95db-e6eae36fac0b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:53.980104 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 587/1162] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:53.986440 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925859ec-9da8-4f24-b234-2f5ad9418fff None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:53.987158 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925859ec-9da8-4f24-b234-2f5ad9418fff None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:53.987310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925859ec-9da8-4f24-b234-2f5ad9418fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:54.008858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-925859ec-9da8-4f24-b234-2f5ad9418fff None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:54.010101 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-925859ec-9da8-4f24-b234-2f5ad9418fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:54.062023 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:54.089829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 576/1163] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:54.112437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be029209-bf3e-4719-95db-e6eae36fac0b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:54.226171 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be029209-bf3e-4719-95db-e6eae36fac0b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:54.263500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a582bfd-1401-459b-8911-47abc60655bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:54.264071 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a582bfd-1401-459b-8911-47abc60655bf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:54.264348 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a582bfd-1401-459b-8911-47abc60655bf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:54.264657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a582bfd-1401-459b-8911-47abc60655bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:54.268028 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:54.331861 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a582bfd-1401-459b-8911-47abc60655bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:54.333336 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a582bfd-1401-459b-8911-47abc60655bf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:54.433139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 588/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:16:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 03:16:54.439549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925859ec-9da8-4f24-b234-2f5ad9418fff None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:54.544242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925859ec-9da8-4f24-b234-2f5ad9418fff None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:54.580204 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f53ae-bf2a-4954-8298-5e1be8f4a30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:54.581051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f53ae-bf2a-4954-8298-5e1be8f4a30d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:54.581297 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f53ae-bf2a-4954-8298-5e1be8f4a30d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:54.581568 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f53ae-bf2a-4954-8298-5e1be8f4a30d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:54.588650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f53ae-bf2a-4954-8298-5e1be8f4a30d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:54.590085 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f53ae-bf2a-4954-8298-5e1be8f4a30d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:54.604625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-5b1f53ae-bf2a-4954-8298-5e1be8f4a30d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 03:16:54.604625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:54.604625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 12 03:16:54.604625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 12 03:16:54.604625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:16:54.604625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:16:54.604625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:16:54.604625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:16:54.604625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 12 03:16:54.604625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:54.604625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:16:54.604625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:54.604625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:16:54.604625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:16:54.604625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:16:54.604625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:16:54.604625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:16:54.605828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:16:54.605828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:16:54.605828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:16:54.605828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:16:54.605828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:16:54.605828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:16:54.605828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:16:54.605828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:16:54.605828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:16:54.605828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:16:54.605828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:16:54.605828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:16:54.605828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:16:54.605828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:16:54.605828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:16:54.605828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:16:54.607383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:16:54.607383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:16:54.607383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:16:54.607383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:16:54.607383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:16:54.607383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:16:54.607383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:16:54.607383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:16:54.607383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:16:54.607383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:16:54.607383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 12 03:16:54.607383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:16:54.607383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 03:16:54.607383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:16:54.607383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 577/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 03:16:54 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:16:54.615257 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a582bfd-1401-459b-8911-47abc60655bf None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:54.654202 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:54.727806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a582bfd-1401-459b-8911-47abc60655bf None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:54.763041 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185d292-678f-45aa-b541-064c6d453152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:54.763695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185d292-678f-45aa-b541-064c6d453152 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:54.763968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185d292-678f-45aa-b541-064c6d453152 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:54.764233 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185d292-678f-45aa-b541-064c6d453152 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:54.764981 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185d292-678f-45aa-b541-064c6d453152 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:16:54.765281 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185d292-678f-45aa-b541-064c6d453152 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:54.766648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185d292-678f-45aa-b541-064c6d453152 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:54.773849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 589/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Tue Jul 12 03:16:54 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:56.764774 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467980cc-62da-4538-b6b3-3e761d498577 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:56.765353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467980cc-62da-4538-b6b3-3e761d498577 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:56.765353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467980cc-62da-4538-b6b3-3e761d498577 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:56.766681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 578/1167] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:56.773116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df101df-6a62-4804-b46d-e7e93bfe1bbb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:56.773841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df101df-6a62-4804-b46d-e7e93bfe1bbb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:56.773968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df101df-6a62-4804-b46d-e7e93bfe1bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:56.799476 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5df101df-6a62-4804-b46d-e7e93bfe1bbb None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:56.800709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5df101df-6a62-4804-b46d-e7e93bfe1bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:56.877103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 590/1168] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:56.909646 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467980cc-62da-4538-b6b3-3e761d498577 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:56.961756 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:57.031981 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467980cc-62da-4538-b6b3-3e761d498577 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:57.067813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf5246-fca8-4bd7-b442-5aa75f9dfdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:57.068459 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf5246-fca8-4bd7-b442-5aa75f9dfdec None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:57.068768 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf5246-fca8-4bd7-b442-5aa75f9dfdec None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:57.069029 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf5246-fca8-4bd7-b442-5aa75f9dfdec None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:57.069804 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf5246-fca8-4bd7-b442-5aa75f9dfdec None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:57.071170 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf5246-fca8-4bd7-b442-5aa75f9dfdec None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:57.092385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 579/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Tue Jul 12 03:16:56 2022] POST /identity/v3/domains => generated 267 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:16:59.147911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441a354-6f8d-4189-ab85-f76ad87b3b33 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:59.148866 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441a354-6f8d-4189-ab85-f76ad87b3b33 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:59.148866 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441a354-6f8d-4189-ab85-f76ad87b3b33 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:59.151008 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 591/1170] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:16:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:16:59.157462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275e333-89d3-41d7-8f69-82038f17b370 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:59.157898 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275e333-89d3-41d7-8f69-82038f17b370 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:59.158015 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275e333-89d3-41d7-8f69-82038f17b370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:59.184105 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-0275e333-89d3-41d7-8f69-82038f17b370 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:16:59.185309 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0275e333-89d3-41d7-8f69-82038f17b370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:16:59.255326 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 580/1171] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:16:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:16:59.279622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441a354-6f8d-4189-ab85-f76ad87b3b33 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:59.322161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:59.400987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441a354-6f8d-4189-ab85-f76ad87b3b33 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:59.435832 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933819f8-acf8-45d8-96fb-5fd880f2aa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:59.436729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933819f8-acf8-45d8-96fb-5fd880f2aa72 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:59.437018 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933819f8-acf8-45d8-96fb-5fd880f2aa72 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:59.437284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933819f8-acf8-45d8-96fb-5fd880f2aa72 None admin] PATH_INFO: `/v3/domains/8ecfe16d7252474594f4c7cab41eb25f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:59.448650 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933819f8-acf8-45d8-96fb-5fd880f2aa72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8ecfe16d7252474594f4c7cab41eb25f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:59.450123 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933819f8-acf8-45d8-96fb-5fd880f2aa72 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:59.451783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 592/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Tue Jul 12 03:16:59 2022] GET /identity/v3/domains/8ecfe16d7252474594f4c7cab41eb25f => generated 267 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:16:59.460908 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275e333-89d3-41d7-8f69-82038f17b370 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:16:59.497887 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:16:59.570035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275e333-89d3-41d7-8f69-82038f17b370 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:16:59.607831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85321c-9cbd-4929-a84c-9092b07392bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:16:59.608474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85321c-9cbd-4929-a84c-9092b07392bb None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:16:59.608784 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85321c-9cbd-4929-a84c-9092b07392bb None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:16:59.609052 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85321c-9cbd-4929-a84c-9092b07392bb None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:16:59.609753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85321c-9cbd-4929-a84c-9092b07392bb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:16:59.611193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85321c-9cbd-4929-a84c-9092b07392bb None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:16:59.640481 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 581/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 03:16:59 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:17:01.686147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eec6cc-6d60-4d7f-9881-08cc41627427 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:01.686727 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eec6cc-6d60-4d7f-9881-08cc41627427 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:01.686727 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eec6cc-6d60-4d7f-9881-08cc41627427 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:01.688065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 593/1174] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:17:01.694383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc950f-2ee5-4413-a0c6-61738aca4d3f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:01.695128 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc950f-2ee5-4413-a0c6-61738aca4d3f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:01.695290 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc950f-2ee5-4413-a0c6-61738aca4d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:01.715976 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6bdc950f-2ee5-4413-a0c6-61738aca4d3f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:17:01.717216 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6bdc950f-2ee5-4413-a0c6-61738aca4d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:17:01.796164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 582/1175] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:17:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:17:01.821272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eec6cc-6d60-4d7f-9881-08cc41627427 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:01.920564 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:17:01.934081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eec6cc-6d60-4d7f-9881-08cc41627427 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:01.970525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df62439-1adf-40c4-99e9-726ec508293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:01.971321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df62439-1adf-40c4-99e9-726ec508293a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:01.971598 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df62439-1adf-40c4-99e9-726ec508293a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:01.971867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df62439-1adf-40c4-99e9-726ec508293a None admin] PATH_INFO: `/v3/domains/8ecfe16d7252474594f4c7cab41eb25f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:01.973071 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df62439-1adf-40c4-99e9-726ec508293a None admin] RBAC: Authorizing `identity:get_domain(domain_id=8ecfe16d7252474594f4c7cab41eb25f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:17:01.974507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df62439-1adf-40c4-99e9-726ec508293a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:17:01.976134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 594/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Tue Jul 12 03:17:01 2022] GET /identity/v3/domains/8ecfe16d7252474594f4c7cab41eb25f => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:17:01.982375 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc950f-2ee5-4413-a0c6-61738aca4d3f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:02.001861 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:17:02.086587 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc950f-2ee5-4413-a0c6-61738aca4d3f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:02.122035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d6c26-706a-4483-b212-b40125d8475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:02.122700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d6c26-706a-4483-b212-b40125d8475b None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:02.122981 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d6c26-706a-4483-b212-b40125d8475b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:02.123303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d6c26-706a-4483-b212-b40125d8475b None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:02.124093 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d6c26-706a-4483-b212-b40125d8475b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:17:02.125572 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d6c26-706a-4483-b212-b40125d8475b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:17:02.149464 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 583/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:17:01 2022] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:17:04.176571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b6bf8-77ba-4239-b08b-0e986685d448 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:04.177469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b6bf8-77ba-4239-b08b-0e986685d448 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:04.177469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b6bf8-77ba-4239-b08b-0e986685d448 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:04.179638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 595/1178] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:17:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:17:04.185927 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af93b3f-65da-4829-8700-20e0160ba930 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:04.186377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af93b3f-65da-4829-8700-20e0160ba930 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:04.186484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af93b3f-65da-4829-8700-20e0160ba930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:04.209091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5af93b3f-65da-4829-8700-20e0160ba930 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:17:04.210288 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5af93b3f-65da-4829-8700-20e0160ba930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:17:04.284689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 584/1179] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:17:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:17:04.308667 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b6bf8-77ba-4239-b08b-0e986685d448 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:04.419330 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b6bf8-77ba-4239-b08b-0e986685d448 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:04.454488 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48847ab6-73be-46e3-95e7-ec145d42bf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:04.455209 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48847ab6-73be-46e3-95e7-ec145d42bf0c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:04.455491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48847ab6-73be-46e3-95e7-ec145d42bf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:04.455767 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48847ab6-73be-46e3-95e7-ec145d42bf0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:04.469607 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48847ab6-73be-46e3-95e7-ec145d42bf0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:17:04.477102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-48847ab6-73be-46e3-95e7-ec145d42bf0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:17:04.477102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:17:04.477102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:17:04.477102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:17:04.477102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:17:04.477102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:17:04.477102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:17:04.477102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:17:04.477102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:17:04.477102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:17:04.477102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:17:04.477102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:17:04.477102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:17:04.477102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:17:04.477102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:17:04.477102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:17:04.478224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:17:04.478224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:17:04.478224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:17:04.478224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:17:04.478224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:17:04.478224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:17:04.478224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:17:04.478224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:17:04.478224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:17:04.478224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:17:04.478224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:17:04.478224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:17:04.478224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:17:04.478224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:17:04.478224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:17:04.478224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:17:04.479289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:17:04.479289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:17:04.479289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:17:04.479289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:17:04.479289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:17:04.479289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:17:04.479289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:17:04.479289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:17:04.479289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:17:04.479289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:17:04.479289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:17:04.479289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:17:04.479289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 596/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:17:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:17:04.484669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af93b3f-65da-4829-8700-20e0160ba930 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:04.486908 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:17:04.595119 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af93b3f-65da-4829-8700-20e0160ba930 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:04.629719 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d14f1-c51a-4bf7-924b-7c36fa0b1a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:04.630368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d14f1-c51a-4bf7-924b-7c36fa0b1a2f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:04.630639 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d14f1-c51a-4bf7-924b-7c36fa0b1a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:04.630910 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d14f1-c51a-4bf7-924b-7c36fa0b1a2f None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:04.631648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d14f1-c51a-4bf7-924b-7c36fa0b1a2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:17:04.631950 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d14f1-c51a-4bf7-924b-7c36fa0b1a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:17:04.633343 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d14f1-c51a-4bf7-924b-7c36fa0b1a2f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:17:04.641800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 585/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:17:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:17:04.648148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48847ab6-73be-46e3-95e7-ec145d42bf0c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:04.669586 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:17:04.768487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48847ab6-73be-46e3-95e7-ec145d42bf0c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:04.805709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5c6a7-9af1-4abd-9b33-efb7816969ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:04.806614 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5c6a7-9af1-4abd-9b33-efb7816969ea None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:04.806853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5c6a7-9af1-4abd-9b33-efb7816969ea None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:04.807203 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5c6a7-9af1-4abd-9b33-efb7816969ea None admin] PATH_INFO: `/v3/users/d61c8644c09c47dcb7812159ab35b2be` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:04.820728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5c6a7-9af1-4abd-9b33-efb7816969ea None admin] RBAC: Authorizing `identity:get_user(user_id=d61c8644c09c47dcb7812159ab35b2be)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:17:04.822230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5c6a7-9af1-4abd-9b33-efb7816969ea None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:17:04.823879 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 597/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:17:04 2022] GET /identity/v3/users/d61c8644c09c47dcb7812159ab35b2be => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:17:04.833283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d14f1-c51a-4bf7-924b-7c36fa0b1a2f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:04.910937 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:17:04.954110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d14f1-c51a-4bf7-924b-7c36fa0b1a2f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:04.991686 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c545d-2216-4cbc-bc46-7428b1c99e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:04.992324 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c545d-2216-4cbc-bc46-7428b1c99e5d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:04.992629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c545d-2216-4cbc-bc46-7428b1c99e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:04.992900 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c545d-2216-4cbc-bc46-7428b1c99e5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:05.064982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c545d-2216-4cbc-bc46-7428b1c99e5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:17:05.066437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c545d-2216-4cbc-bc46-7428b1c99e5d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:17:05.129138 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:17:05.169686 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 586/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:17:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 03:17:05.175852 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5c6a7-9af1-4abd-9b33-efb7816969ea None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:05.252461 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:17:05.285320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5c6a7-9af1-4abd-9b33-efb7816969ea None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:05.319738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c8496-e1c7-4383-ad61-e9d03a45cdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:05.320560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c8496-e1c7-4383-ad61-e9d03a45cdef None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:05.320834 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c8496-e1c7-4383-ad61-e9d03a45cdef None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:05.321105 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c8496-e1c7-4383-ad61-e9d03a45cdef None admin] PATH_INFO: `/v3/projects/3e30b0add53044f98df43ad2abc82ff1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:05.322308 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c8496-e1c7-4383-ad61-e9d03a45cdef None admin] RBAC: Authorizing `identity:get_project(project_id=3e30b0add53044f98df43ad2abc82ff1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:17:05.324035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c8496-e1c7-4383-ad61-e9d03a45cdef None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:17:05.325759 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 598/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:17:05 2022] GET /identity/v3/projects/3e30b0add53044f98df43ad2abc82ff1 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:17:05.335943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c545d-2216-4cbc-bc46-7428b1c99e5d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:05.453457 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c545d-2216-4cbc-bc46-7428b1c99e5d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:05.488713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef59325-95f4-413e-b06c-4956f12068aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:05.489362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef59325-95f4-413e-b06c-4956f12068aa None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:05.489637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef59325-95f4-413e-b06c-4956f12068aa None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:05.489898 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef59325-95f4-413e-b06c-4956f12068aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:05.490718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef59325-95f4-413e-b06c-4956f12068aa None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=3e30b0add53044f98df43ad2abc82ff1, user.id=d61c8644c09c47dcb7812159ab35b2be) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:17:05.491028 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef59325-95f4-413e-b06c-4956f12068aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:17:05.492448 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef59325-95f4-413e-b06c-4956f12068aa None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:17:05.498832 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 587/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:17:05 2022] GET /identity/v3/role_assignments?user.id=d61c8644c09c47dcb7812159ab35b2be&scope.project.id=3e30b0add53044f98df43ad2abc82ff1&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:17:07.490922 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d032cd9-528c-4a17-aa32-e35c24f482d3 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:07.491844 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d032cd9-528c-4a17-aa32-e35c24f482d3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:07.491844 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d032cd9-528c-4a17-aa32-e35c24f482d3 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:07.494469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 599/1186] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:17:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:17:07.502607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919aa89-6cc8-44e3-9198-6381c65468c3 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:07.503077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919aa89-6cc8-44e3-9198-6381c65468c3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:07.503178 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919aa89-6cc8-44e3-9198-6381c65468c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:07.526241 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6919aa89-6cc8-44e3-9198-6381c65468c3 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:17:07.527445 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6919aa89-6cc8-44e3-9198-6381c65468c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:17:07.552412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:17:07.600244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 588/1187] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:17:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:17:07.624390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d032cd9-528c-4a17-aa32-e35c24f482d3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:07.747918 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d032cd9-528c-4a17-aa32-e35c24f482d3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:07.783865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2eb9b4-7668-43d2-af63-5f2c77107980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:07.784696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2eb9b4-7668-43d2-af63-5f2c77107980 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:07.784969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2eb9b4-7668-43d2-af63-5f2c77107980 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:07.785239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2eb9b4-7668-43d2-af63-5f2c77107980 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:07.796487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2eb9b4-7668-43d2-af63-5f2c77107980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:17:07.803977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-5b2eb9b4-7668-43d2-af63-5f2c77107980 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:17:07.803977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:17:07.803977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:17:07.803977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:17:07.803977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:17:07.803977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:17:07.803977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:17:07.803977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:17:07.803977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:17:07.803977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:17:07.803977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:17:07.803977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:17:07.803977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:17:07.803977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:17:07.803977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:17:07.803977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:17:07.805097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:17:07.805097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:17:07.805097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:17:07.805097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:17:07.805097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:17:07.805097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:17:07.805097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:17:07.805097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:17:07.805097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:17:07.805097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:17:07.805097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:17:07.805097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:17:07.805097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:17:07.805097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:17:07.805097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:17:07.805097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:17:07.805948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:17:07.805948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:17:07.805948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:17:07.805948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:17:07.805948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:17:07.805948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:17:07.805948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:17:07.805948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:17:07.805948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:17:07.805948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:17:07.805948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:17:07.805948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:17:07.805948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 600/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:17:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:17:07.813147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919aa89-6cc8-44e3-9198-6381c65468c3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:07.918520 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919aa89-6cc8-44e3-9198-6381c65468c3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:07.955415 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f7690-5f19-4c72-bce8-54b9ab0ee409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:07.956083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f7690-5f19-4c72-bce8-54b9ab0ee409 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:07.956363 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f7690-5f19-4c72-bce8-54b9ab0ee409 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:07.956670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f7690-5f19-4c72-bce8-54b9ab0ee409 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:07.957406 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f7690-5f19-4c72-bce8-54b9ab0ee409 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:17:07.957706 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f7690-5f19-4c72-bce8-54b9ab0ee409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:17:07.959084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f7690-5f19-4c72-bce8-54b9ab0ee409 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:17:07.967494 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 589/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:17:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:17:07.974555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2eb9b4-7668-43d2-af63-5f2c77107980 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:07.980078 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:17:08.080795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2eb9b4-7668-43d2-af63-5f2c77107980 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:08.115791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e66569-1a90-4c8e-a342-33b02131bb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:08.116674 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66569-1a90-4c8e-a342-33b02131bb95 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:08.116954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66569-1a90-4c8e-a342-33b02131bb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:08.117225 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66569-1a90-4c8e-a342-33b02131bb95 None admin] PATH_INFO: `/v3/users/d61c8644c09c47dcb7812159ab35b2be` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:08.118531 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e66569-1a90-4c8e-a342-33b02131bb95 None admin] RBAC: Authorizing `identity:get_user(user_id=d61c8644c09c47dcb7812159ab35b2be)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:17:08.120066 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e66569-1a90-4c8e-a342-33b02131bb95 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:17:08.121761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 601/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:17:07 2022] GET /identity/v3/users/d61c8644c09c47dcb7812159ab35b2be => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:17:08.130543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f7690-5f19-4c72-bce8-54b9ab0ee409 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:08.163217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:17:08.248748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f7690-5f19-4c72-bce8-54b9ab0ee409 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:08.286411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e1ea2-a21a-4356-a65f-d081cc34bdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:08.287307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e1ea2-a21a-4356-a65f-d081cc34bdeb None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:08.287592 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e1ea2-a21a-4356-a65f-d081cc34bdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:08.287858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e1ea2-a21a-4356-a65f-d081cc34bdeb None admin] PATH_INFO: `/v3/projects/3e30b0add53044f98df43ad2abc82ff1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:08.289167 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e1ea2-a21a-4356-a65f-d081cc34bdeb None admin] RBAC: Authorizing `identity:get_project(project_id=3e30b0add53044f98df43ad2abc82ff1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:17:08.290604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e1ea2-a21a-4356-a65f-d081cc34bdeb None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:17:08.292543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 590/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:17:08 2022] GET /identity/v3/projects/3e30b0add53044f98df43ad2abc82ff1 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:17:08.299035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e66569-1a90-4c8e-a342-33b02131bb95 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:08.371545 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:17:08.402440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e66569-1a90-4c8e-a342-33b02131bb95 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:08.437613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08358754-5021-4d49-92fa-b2f787f6e086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:08.438519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358754-5021-4d49-92fa-b2f787f6e086 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:08.438800 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358754-5021-4d49-92fa-b2f787f6e086 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:08.439074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358754-5021-4d49-92fa-b2f787f6e086 None admin] PATH_INFO: `/v3/projects/3e30b0add53044f98df43ad2abc82ff1/users/d61c8644c09c47dcb7812159ab35b2be/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:08.441367 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08358754-5021-4d49-92fa-b2f787f6e086 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e30b0add53044f98df43ad2abc82ff1, user_id=d61c8644c09c47dcb7812159ab35b2be, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:17:08.442820 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08358754-5021-4d49-92fa-b2f787f6e086 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:17:08.458260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 602/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:17:08 2022] PUT /identity/v3/projects/3e30b0add53044f98df43ad2abc82ff1/users/d61c8644c09c47dcb7812159ab35b2be/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:17:10.473267 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bacb2-2648-4580-a61c-f24d12ebd70a None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:10.474125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bacb2-2648-4580-a61c-f24d12ebd70a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:10.474125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bacb2-2648-4580-a61c-f24d12ebd70a None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:10.476303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 591/1193] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:17:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:17:10.482916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709dd9c-64fc-4ab6-86ad-84d7065ee68c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:10.483633 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709dd9c-64fc-4ab6-86ad-84d7065ee68c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:10.483784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709dd9c-64fc-4ab6-86ad-84d7065ee68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:10.506491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b709dd9c-64fc-4ab6-86ad-84d7065ee68c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:17:10.507669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b709dd9c-64fc-4ab6-86ad-84d7065ee68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:17:10.577819 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 603/1194] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:17:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:17:10.602517 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bacb2-2648-4580-a61c-f24d12ebd70a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:10.719255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:17:10.732942 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bacb2-2648-4580-a61c-f24d12ebd70a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:10.767448 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b1281-5081-49e9-b881-36d85aa00ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:10.768238 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b1281-5081-49e9-b881-36d85aa00ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:10.768543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b1281-5081-49e9-b881-36d85aa00ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:10.768816 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b1281-5081-49e9-b881-36d85aa00ee8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:10.779568 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b1281-5081-49e9-b881-36d85aa00ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:17:10.787180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-ab8b1281-5081-49e9-b881-36d85aa00ee8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:17:10.787180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:17:10.787180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:17:10.787180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:17:10.787180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:17:10.787180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:17:10.787180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:17:10.787180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:17:10.787180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:17:10.787180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:17:10.787180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:17:10.787180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:17:10.787180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:17:10.787180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:17:10.787180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:17:10.787180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:17:10.788230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:17:10.788230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:17:10.788230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:17:10.788230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:17:10.788230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:17:10.788230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:17:10.788230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:17:10.788230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:17:10.788230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:17:10.788230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:17:10.788230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:17:10.788230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:17:10.788230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:17:10.788230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:17:10.788230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:17:10.788230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:17:10.789186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:17:10.789186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:17:10.789186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:17:10.789186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:17:10.789186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:17:10.789186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:17:10.789186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:17:10.789186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:17:10.789186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:17:10.789186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:17:10.789186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:17:10.789186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:17:10.789186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 592/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:17:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:17:10.795279 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709dd9c-64fc-4ab6-86ad-84d7065ee68c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:10.876430 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:17:10.926720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709dd9c-64fc-4ab6-86ad-84d7065ee68c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:10.969712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153985f-69a5-45cc-94e3-d4b23ab862c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:10.970376 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153985f-69a5-45cc-94e3-d4b23ab862c6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:10.970653 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153985f-69a5-45cc-94e3-d4b23ab862c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:10.970921 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153985f-69a5-45cc-94e3-d4b23ab862c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:10.971675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153985f-69a5-45cc-94e3-d4b23ab862c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:17:10.971978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153985f-69a5-45cc-94e3-d4b23ab862c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:17:10.973401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153985f-69a5-45cc-94e3-d4b23ab862c6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:17:10.981720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 604/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:17:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:17:10.991409 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b1281-5081-49e9-b881-36d85aa00ee8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:11.106650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b1281-5081-49e9-b881-36d85aa00ee8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:11.144849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33113ced-11ed-4356-a42c-c24b6b142238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:11.145712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113ced-11ed-4356-a42c-c24b6b142238 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:11.145994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113ced-11ed-4356-a42c-c24b6b142238 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:11.146264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113ced-11ed-4356-a42c-c24b6b142238 None admin] PATH_INFO: `/v3/users/d61c8644c09c47dcb7812159ab35b2be` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:11.147587 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33113ced-11ed-4356-a42c-c24b6b142238 None admin] RBAC: Authorizing `identity:get_user(user_id=d61c8644c09c47dcb7812159ab35b2be)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:17:11.149066 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33113ced-11ed-4356-a42c-c24b6b142238 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:17:11.150743 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 593/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Tue Jul 12 03:17:10 2022] GET /identity/v3/users/d61c8644c09c47dcb7812159ab35b2be => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:17:11.157411 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153985f-69a5-45cc-94e3-d4b23ab862c6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:11.278038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153985f-69a5-45cc-94e3-d4b23ab862c6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:11.301712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:17:11.320939 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5e348-6c7c-4bde-a5d4-322c6ceee3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:11.321854 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5e348-6c7c-4bde-a5d4-322c6ceee3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:11.322152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5e348-6c7c-4bde-a5d4-322c6ceee3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:11.322418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5e348-6c7c-4bde-a5d4-322c6ceee3d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:11.398693 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5e348-6c7c-4bde-a5d4-322c6ceee3d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:17:11.400322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5e348-6c7c-4bde-a5d4-322c6ceee3d4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:17:11.516179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 605/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:17:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 03:17:11.522482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33113ced-11ed-4356-a42c-c24b6b142238 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:11.541787 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:17:11.628814 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33113ced-11ed-4356-a42c-c24b6b142238 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:11.663936 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436ee3e-d421-4ed0-885a-a1b62a935a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:11.664829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436ee3e-d421-4ed0-885a-a1b62a935a61 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:11.665087 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436ee3e-d421-4ed0-885a-a1b62a935a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:11.665366 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436ee3e-d421-4ed0-885a-a1b62a935a61 None admin] PATH_INFO: `/v3/projects/3e30b0add53044f98df43ad2abc82ff1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:11.666857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436ee3e-d421-4ed0-885a-a1b62a935a61 None admin] RBAC: Authorizing `identity:get_project(project_id=3e30b0add53044f98df43ad2abc82ff1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:17:11.668296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436ee3e-d421-4ed0-885a-a1b62a935a61 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:17:11.670041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 594/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Tue Jul 12 03:17:11 2022] GET /identity/v3/projects/3e30b0add53044f98df43ad2abc82ff1 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:17:11.677258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5e348-6c7c-4bde-a5d4-322c6ceee3d4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:17:11.709898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:17:11.783913 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5e348-6c7c-4bde-a5d4-322c6ceee3d4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:17:11.819594 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05686fd7-1a38-4bd2-9963-bbc39e70d34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:17:11.820235 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05686fd7-1a38-4bd2-9963-bbc39e70d34b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:17:11.820508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05686fd7-1a38-4bd2-9963-bbc39e70d34b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:17:11.820816 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05686fd7-1a38-4bd2-9963-bbc39e70d34b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:17:11.821627 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05686fd7-1a38-4bd2-9963-bbc39e70d34b None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=3e30b0add53044f98df43ad2abc82ff1, user.id=d61c8644c09c47dcb7812159ab35b2be) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:17:11.821986 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05686fd7-1a38-4bd2-9963-bbc39e70d34b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:17:11.823593 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05686fd7-1a38-4bd2-9963-bbc39e70d34b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:17:11.829559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 606/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:17:11 2022] GET /identity/v3/role_assignments?user.id=d61c8644c09c47dcb7812159ab35b2be&scope.project.id=3e30b0add53044f98df43ad2abc82ff1&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:17:21.659317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=58 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:17:21.827169 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=56 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:07.701607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23be18b-3379-4acf-ad6b-4d3b267bac68 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:07.702222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23be18b-3379-4acf-ad6b-4d3b267bac68 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:07.702222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23be18b-3379-4acf-ad6b-4d3b267bac68 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:07.703840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 595/1201] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:18:07.710213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7e5f-bfe2-4241-807f-8236364675d6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:07.710736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7e5f-bfe2-4241-807f-8236364675d6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:07.710948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7e5f-bfe2-4241-807f-8236364675d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:07.733582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-dddc7e5f-bfe2-4241-807f-8236364675d6 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:18:07.734793 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dddc7e5f-bfe2-4241-807f-8236364675d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:18:07.829523 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 607/1202] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:18:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:18:07.858347 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23be18b-3379-4acf-ad6b-4d3b267bac68 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:08.014130 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23be18b-3379-4acf-ad6b-4d3b267bac68 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:08.063316 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8717dc5-0977-4967-93e1-893cf7e518e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:08.064123 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8717dc5-0977-4967-93e1-893cf7e518e3 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:08.064406 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8717dc5-0977-4967-93e1-893cf7e518e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:08.064702 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8717dc5-0977-4967-93e1-893cf7e518e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:08.078787 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8717dc5-0977-4967-93e1-893cf7e518e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:08.078787 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8717dc5-0977-4967-93e1-893cf7e518e3 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:08.098229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d8717dc5-0977-4967-93e1-893cf7e518e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:08.098229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:08.098229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:08.098229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:08.098229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:08.098229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:08.098229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:08.098229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:08.098229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:08.098229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:08.098229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:08.098229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:08.098229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:18:08.098229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:18:08.098229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:18:08.099369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:18:08.099369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:08.099369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:08.099369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:08.099369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:08.099369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:08.099369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:08.099369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:08.099369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:08.099369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:08.099369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:08.099369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:08.099369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:08.099369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:08.099369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:08.099369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:08.099369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:08.100567 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:18:08.100567 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:18:08.100567 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:08.100567 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:18:08.102127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 596/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:08.108333 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7e5f-bfe2-4241-807f-8236364675d6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:08.239187 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7e5f-bfe2-4241-807f-8236364675d6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:08.285088 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:08.291632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3b83a-334e-4c3f-808c-688b91c6da2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:08.292298 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3b83a-334e-4c3f-808c-688b91c6da2e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:08.294960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3b83a-334e-4c3f-808c-688b91c6da2e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:08.295243 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3b83a-334e-4c3f-808c-688b91c6da2e None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:08.296003 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3b83a-334e-4c3f-808c-688b91c6da2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:08.296312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3b83a-334e-4c3f-808c-688b91c6da2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:08.297728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3b83a-334e-4c3f-808c-688b91c6da2e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:08.310114 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 608/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:08.316146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8717dc5-0977-4967-93e1-893cf7e518e3 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:08.378356 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:08.445376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8717dc5-0977-4967-93e1-893cf7e518e3 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:08.485454 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd1d91-f9aa-4756-8294-f64553749585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:08.486131 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd1d91-f9aa-4756-8294-f64553749585 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:08.486410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd1d91-f9aa-4756-8294-f64553749585 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:08.486678 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd1d91-f9aa-4756-8294-f64553749585 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:08.487396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd1d91-f9aa-4756-8294-f64553749585 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:08.488850 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd1d91-f9aa-4756-8294-f64553749585 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:08.514517 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 597/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Tue Jul 12 03:18:08 2022] POST /identity/v3/users => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:18:10.789727 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bb444-6df3-4c1a-b483-31a504ea975e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:10.790437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bb444-6df3-4c1a-b483-31a504ea975e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:10.790437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bb444-6df3-4c1a-b483-31a504ea975e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:10.791811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 609/1206] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:18:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:18:10.796957 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750033ea-6829-4104-beca-085961947e5b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:10.797389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750033ea-6829-4104-beca-085961947e5b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:10.797490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750033ea-6829-4104-beca-085961947e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:10.814929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-750033ea-6829-4104-beca-085961947e5b None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:18:10.816119 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-750033ea-6829-4104-beca-085961947e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:18:10.892685 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 598/1207] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:18:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:18:10.915726 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bb444-6df3-4c1a-b483-31a504ea975e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:11.042964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bb444-6df3-4c1a-b483-31a504ea975e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:11.096293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d61b1a-1f9d-48f6-a3ea-2fe1874da6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:11.097555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d61b1a-1f9d-48f6-a3ea-2fe1874da6ac None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:11.097989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d61b1a-1f9d-48f6-a3ea-2fe1874da6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:11.098508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d61b1a-1f9d-48f6-a3ea-2fe1874da6ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:11.113955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d61b1a-1f9d-48f6-a3ea-2fe1874da6ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:18:11.125798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-48d61b1a-1f9d-48f6-a3ea-2fe1874da6ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:18:11.125798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:11.125798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:11.125798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:11.125798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:11.125798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:11.125798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:11.125798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:11.125798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:11.125798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:11.125798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:11.125798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:11.125798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:18:11.125798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:18:11.125798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:18:11.125798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:18:11.126911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:18:11.126911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:18:11.126911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:18:11.126911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:18:11.126911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:11.126911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:11.126911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:11.126911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:11.126911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:11.126911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:11.126911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:11.126911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:11.126911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:11.126911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:11.126911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:11.126911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:11.127882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:11.127882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:11.127882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:11.127882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:11.127882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:18:11.127882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:18:11.127882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:18:11.127882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:18:11.127882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:18:11.127882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:18:11.127882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:18:11.127882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:11.129917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 610/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:18:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:11.134283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750033ea-6829-4104-beca-085961947e5b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:11.187110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:11.253656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750033ea-6829-4104-beca-085961947e5b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:11.291044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587bf3f-9ffa-4c6c-b923-91ca0e1b8b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:11.291716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587bf3f-9ffa-4c6c-b923-91ca0e1b8b6a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:11.291991 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587bf3f-9ffa-4c6c-b923-91ca0e1b8b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:11.292260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587bf3f-9ffa-4c6c-b923-91ca0e1b8b6a None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:11.293094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587bf3f-9ffa-4c6c-b923-91ca0e1b8b6a None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:11.293340 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587bf3f-9ffa-4c6c-b923-91ca0e1b8b6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:11.294709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587bf3f-9ffa-4c6c-b923-91ca0e1b8b6a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:11.303827 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 599/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:18:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:11.309675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d61b1a-1f9d-48f6-a3ea-2fe1874da6ac None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:11.372450 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:11.439438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d61b1a-1f9d-48f6-a3ea-2fe1874da6ac None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:11.491943 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef003a8-faf4-47be-af74-03bb84463187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:11.492797 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef003a8-faf4-47be-af74-03bb84463187 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:11.493102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef003a8-faf4-47be-af74-03bb84463187 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:11.493425 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef003a8-faf4-47be-af74-03bb84463187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:11.506085 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef003a8-faf4-47be-af74-03bb84463187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:11.507620 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef003a8-faf4-47be-af74-03bb84463187 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:11.525956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2ef003a8-faf4-47be-af74-03bb84463187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:11.525956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:11.525956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:11.525956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:11.525956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:11.525956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:11.525956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:11.525956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:11.525956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:11.525956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:11.525956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:11.525956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:11.525956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:18:11.525956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:18:11.525956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:18:11.527160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:18:11.527160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:11.527160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:11.527160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:11.527160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:11.527160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:11.527160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:11.527160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:11.527160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:11.527160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:11.527160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:11.527160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:11.527160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:11.527160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:11.527160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:11.527160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:11.527160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:11.528058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:18:11.528058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:18:11.528058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:11.528058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:11.528058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 611/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:11.533125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587bf3f-9ffa-4c6c-b923-91ca0e1b8b6a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:11.637878 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:11.640822 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587bf3f-9ffa-4c6c-b923-91ca0e1b8b6a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:11.681831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4106a-b903-43df-a9fc-f401310defd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:11.682514 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4106a-b903-43df-a9fc-f401310defd9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:11.682795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4106a-b903-43df-a9fc-f401310defd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:11.683070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4106a-b903-43df-a9fc-f401310defd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:11.683799 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4106a-b903-43df-a9fc-f401310defd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:11.684103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4106a-b903-43df-a9fc-f401310defd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:11.685509 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4106a-b903-43df-a9fc-f401310defd9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:11.708560 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 600/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:18:11.711259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef003a8-faf4-47be-af74-03bb84463187 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:11.822842 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef003a8-faf4-47be-af74-03bb84463187 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:11.824410 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:11.859580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2346100-822a-49b8-8f70-0b94866fa342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:11.860504 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2346100-822a-49b8-8f70-0b94866fa342 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:11.860769 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2346100-822a-49b8-8f70-0b94866fa342 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:11.861048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2346100-822a-49b8-8f70-0b94866fa342 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:11.870734 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2346100-822a-49b8-8f70-0b94866fa342 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:11.872501 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2346100-822a-49b8-8f70-0b94866fa342 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:11.889215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a2346100-822a-49b8-8f70-0b94866fa342 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 03:18:11.889215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:11.889215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:11.889215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:11.889215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:11.889215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:11.889215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:11.889215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:11.889215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:11.889215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:11.889215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:11.889215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:11.889215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:18:11.889215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:18:11.889215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:18:11.889215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:11.890167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:11.896132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:11.896132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:11.896132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:18:11.896132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:18:11.896132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:18:11.896132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:18:11.896132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:18:11.896132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:18:11.896132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 03:18:11.896132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:11.896132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 612/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:11.898212 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4106a-b903-43df-a9fc-f401310defd9 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:12.006783 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4106a-b903-43df-a9fc-f401310defd9 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:12.063825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e87b8a-1c7e-491e-9d4c-0de3812c06eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:12.064536 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e87b8a-1c7e-491e-9d4c-0de3812c06eb None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:12.064821 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e87b8a-1c7e-491e-9d4c-0de3812c06eb None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:12.065084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e87b8a-1c7e-491e-9d4c-0de3812c06eb None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:12.065924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e87b8a-1c7e-491e-9d4c-0de3812c06eb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:12.066234 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e87b8a-1c7e-491e-9d4c-0de3812c06eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:12.067677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e87b8a-1c7e-491e-9d4c-0de3812c06eb None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:12.087301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 601/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Jul 12 03:18:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:12.100367 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2346100-822a-49b8-8f70-0b94866fa342 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:12.225518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2346100-822a-49b8-8f70-0b94866fa342 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:12.265313 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52e8d4-3b6f-457a-98ba-ae0406eafb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:12.265968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52e8d4-3b6f-457a-98ba-ae0406eafb8a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:12.266240 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52e8d4-3b6f-457a-98ba-ae0406eafb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:12.266507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52e8d4-3b6f-457a-98ba-ae0406eafb8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:12.301332 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:12.355556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52e8d4-3b6f-457a-98ba-ae0406eafb8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:12.357081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52e8d4-3b6f-457a-98ba-ae0406eafb8a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:12.488068 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 613/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:18:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 03:18:12.493999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e87b8a-1c7e-491e-9d4c-0de3812c06eb None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:12.513794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:12.605704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e87b8a-1c7e-491e-9d4c-0de3812c06eb None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:12.641745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dacf9-c960-4a4b-9e78-7dc0542be590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:12.642550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dacf9-c960-4a4b-9e78-7dc0542be590 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:12.642828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dacf9-c960-4a4b-9e78-7dc0542be590 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:12.643096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dacf9-c960-4a4b-9e78-7dc0542be590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:12.657255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dacf9-c960-4a4b-9e78-7dc0542be590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:12.658753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dacf9-c960-4a4b-9e78-7dc0542be590 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:12.677031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-ee2dacf9-c960-4a4b-9e78-7dc0542be590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:12.677031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:12.677031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:12.677031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:12.677031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:12.677031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:12.677031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:12.677031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:12.677031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:12.677031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:12.677031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:12.677031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:12.677031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:18:12.677031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:18:12.677031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:18:12.678117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:18:12.678117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:12.678117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:12.678117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:12.678117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:12.678117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:12.678117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:12.678117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:12.678117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:12.678117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:12.678117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:12.678117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:12.678117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:12.678117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:12.678117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:12.678117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:12.678117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:12.679070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:18:12.679070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:18:12.679070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:12.679070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:18:12.679070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 602/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:12.685606 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52e8d4-3b6f-457a-98ba-ae0406eafb8a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:12.757673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:12.803551 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52e8d4-3b6f-457a-98ba-ae0406eafb8a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:12.841584 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f9135-2068-4241-bfc5-39864505853e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:12.842348 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f9135-2068-4241-bfc5-39864505853e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:12.842536 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f9135-2068-4241-bfc5-39864505853e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:12.842800 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f9135-2068-4241-bfc5-39864505853e None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:12.843555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f9135-2068-4241-bfc5-39864505853e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:12.843861 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f9135-2068-4241-bfc5-39864505853e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:12.845274 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f9135-2068-4241-bfc5-39864505853e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:12.864779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 614/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:12.866081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dacf9-c960-4a4b-9e78-7dc0542be590 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:12.948884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:12.987420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dacf9-c960-4a4b-9e78-7dc0542be590 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:13.034099 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0915a4-27d3-41ee-bd25-9621f734997f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:13.035031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0915a4-27d3-41ee-bd25-9621f734997f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:13.035401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0915a4-27d3-41ee-bd25-9621f734997f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:13.035685 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0915a4-27d3-41ee-bd25-9621f734997f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:13.044381 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0915a4-27d3-41ee-bd25-9621f734997f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:13.046305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0915a4-27d3-41ee-bd25-9621f734997f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:13.062022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2f0915a4-27d3-41ee-bd25-9621f734997f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:18:13.062022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:13.062022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:13.062022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:13.062022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:13.062022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:13.062022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:13.062022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:13.062022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:13.062022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:13.062022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:13.062022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:13.062022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:18:13.062022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:18:13.062022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:18:13.063005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:18:13.063005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:13.063005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:13.063005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:13.063005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:13.063005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:13.063005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:13.063005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:13.063005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:13.063005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:13.063005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:13.063005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:13.063005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:13.063005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:13.063005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:13.063005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:13.063005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:13.064106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:18:13.064106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:18:13.064106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:18:13.064106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:18:13.064106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:18:13.064106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:18:13.064106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:18:13.064106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:18:13.064106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 603/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:18:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:13.069336 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f9135-2068-4241-bfc5-39864505853e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:13.186974 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f9135-2068-4241-bfc5-39864505853e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:13.213009 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:13.229567 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba59ae-be19-49fa-9430-546edbcdcb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:13.230412 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba59ae-be19-49fa-9430-546edbcdcb0e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:13.230753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba59ae-be19-49fa-9430-546edbcdcb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:13.231089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba59ae-be19-49fa-9430-546edbcdcb0e None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:13.231992 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba59ae-be19-49fa-9430-546edbcdcb0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:13.232357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba59ae-be19-49fa-9430-546edbcdcb0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:13.233892 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba59ae-be19-49fa-9430-546edbcdcb0e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:13.248350 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 615/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:18:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:13.254402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0915a4-27d3-41ee-bd25-9621f734997f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:13.385940 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0915a4-27d3-41ee-bd25-9621f734997f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:13.419849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:13.430260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02956e99-89d8-4dbf-85a9-58922bde28e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:13.431355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02956e99-89d8-4dbf-85a9-58922bde28e2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:13.431643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02956e99-89d8-4dbf-85a9-58922bde28e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:13.431916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02956e99-89d8-4dbf-85a9-58922bde28e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:13.432957 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02956e99-89d8-4dbf-85a9-58922bde28e2 None admin] RBAC: Adding query filter params (role.id=8a9636f0fea542a19f6fcaf54b9c1d11, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=361ad35021eb43cca46d9b66e6f24ba6) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:13.433274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02956e99-89d8-4dbf-85a9-58922bde28e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:13.434802 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02956e99-89d8-4dbf-85a9-58922bde28e2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:13.452563 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 604/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:18:13 2022] GET /identity/v3/role_assignments?user.id=361ad35021eb43cca46d9b66e6f24ba6&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=8a9636f0fea542a19f6fcaf54b9c1d11 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:15.517156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a97b4-4e97-4406-8704-54baf4877963 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:15.517704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a97b4-4e97-4406-8704-54baf4877963 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:15.517704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a97b4-4e97-4406-8704-54baf4877963 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:15.519064 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 616/1220] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:18:15.525142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935badd-11bb-4590-8660-ce5a4a631e48 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:15.525608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935badd-11bb-4590-8660-ce5a4a631e48 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:15.525704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935badd-11bb-4590-8660-ce5a4a631e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:15.545793 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-d935badd-11bb-4590-8660-ce5a4a631e48 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:18:15.547125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d935badd-11bb-4590-8660-ce5a4a631e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:18:15.630424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 605/1221] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:18:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:18:15.653220 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a97b4-4e97-4406-8704-54baf4877963 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:15.774031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a97b4-4e97-4406-8704-54baf4877963 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:15.812111 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d672c4f-8462-4f90-94ce-c863d1a2ae4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:15.813377 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d672c4f-8462-4f90-94ce-c863d1a2ae4b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:15.813884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d672c4f-8462-4f90-94ce-c863d1a2ae4b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:15.814277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d672c4f-8462-4f90-94ce-c863d1a2ae4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:15.827074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d672c4f-8462-4f90-94ce-c863d1a2ae4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:18:15.834917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4d672c4f-8462-4f90-94ce-c863d1a2ae4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:18:15.834917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:15.834917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:15.834917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:15.834917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:15.834917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:15.834917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:15.834917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:15.834917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:15.834917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:15.834917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:15.834917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:15.834917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:18:15.834917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:18:15.834917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:18:15.834917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:18:15.835897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:18:15.835897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:18:15.835897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:18:15.835897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:18:15.835897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:15.835897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:15.835897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:15.835897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:15.835897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:15.835897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:15.835897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:15.835897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:15.835897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:15.835897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:15.835897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:15.835897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:15.836764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:15.836764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:15.836764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:15.836764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:15.836764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:18:15.836764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:18:15.836764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:18:15.836764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:18:15.836764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:18:15.836764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:18:15.836764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:18:15.836764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:15.836764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 617/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:18:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:15.843413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935badd-11bb-4590-8660-ce5a4a631e48 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:15.940852 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935badd-11bb-4590-8660-ce5a4a631e48 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:15.966228 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:15.978842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b1ad7-33a6-469a-ac8c-7365c79e8bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:15.979623 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1ad7-33a6-469a-ac8c-7365c79e8bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:15.979904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1ad7-33a6-469a-ac8c-7365c79e8bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:15.980230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1ad7-33a6-469a-ac8c-7365c79e8bb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:15.981015 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b1ad7-33a6-469a-ac8c-7365c79e8bb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:15.981394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b1ad7-33a6-469a-ac8c-7365c79e8bb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:15.982810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b1ad7-33a6-469a-ac8c-7365c79e8bb9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:15.990927 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 606/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:18:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:15.996791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d672c4f-8462-4f90-94ce-c863d1a2ae4b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:16.041601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:16.102372 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d672c4f-8462-4f90-94ce-c863d1a2ae4b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:16.139374 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a5810-ec6a-470f-a62a-2da532682d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:16.140239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a5810-ec6a-470f-a62a-2da532682d38 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:16.140543 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a5810-ec6a-470f-a62a-2da532682d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:16.140863 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a5810-ec6a-470f-a62a-2da532682d38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:16.153114 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a5810-ec6a-470f-a62a-2da532682d38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:16.154787 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a5810-ec6a-470f-a62a-2da532682d38 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:16.174902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b92a5810-ec6a-470f-a62a-2da532682d38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:16.174902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:16.174902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:16.174902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:16.174902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:16.174902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:16.174902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:16.174902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:16.174902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:16.174902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:16.174902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:16.174902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:16.174902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:18:16.174902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:18:16.174902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:18:16.176022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:18:16.176022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:16.176022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:16.176022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:16.176022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:16.176022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:16.176022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:16.176022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:16.176022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:16.176022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:16.176022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:16.176022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:16.176022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:16.176022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:16.176022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:16.176022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:16.176022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:16.177073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:18:16.177073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:18:16.177073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:16.177073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:16.177073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 618/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:16.182704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b1ad7-33a6-469a-ac8c-7365c79e8bb9 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:16.285420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b1ad7-33a6-469a-ac8c-7365c79e8bb9 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:16.323290 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b82b94-6d52-4394-aeb2-7f8c3d89bcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:16.324263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82b94-6d52-4394-aeb2-7f8c3d89bcc4 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:16.324673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82b94-6d52-4394-aeb2-7f8c3d89bcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:16.325099 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82b94-6d52-4394-aeb2-7f8c3d89bcc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:16.326011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b82b94-6d52-4394-aeb2-7f8c3d89bcc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:16.326501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b82b94-6d52-4394-aeb2-7f8c3d89bcc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:16.328267 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b82b94-6d52-4394-aeb2-7f8c3d89bcc4 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:16.343943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 607/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:16.351401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a5810-ec6a-470f-a62a-2da532682d38 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:16.471381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:16.481944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a5810-ec6a-470f-a62a-2da532682d38 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:16.520658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc848554-e998-43c0-89a6-9c13e4f490dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:16.521482 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc848554-e998-43c0-89a6-9c13e4f490dc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:16.521762 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc848554-e998-43c0-89a6-9c13e4f490dc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:16.522036 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc848554-e998-43c0-89a6-9c13e4f490dc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:16.530124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc848554-e998-43c0-89a6-9c13e4f490dc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:16.531599 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc848554-e998-43c0-89a6-9c13e4f490dc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:16.548046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-dc848554-e998-43c0-89a6-9c13e4f490dc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 03:18:16.548046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:16.548046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:16.548046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:16.548046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:16.548046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:16.548046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:16.548046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:16.548046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:16.548046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:16.548046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:16.548046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:16.548046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:18:16.548046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:18:16.548046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:18:16.548046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:16.549445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:16.550658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:16.550658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:16.550658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:18:16.550658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:18:16.550658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:18:16.550658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:18:16.550658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:18:16.550658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:18:16.550658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 03:18:16.550658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:16.550658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 619/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:18:16.556109 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b82b94-6d52-4394-aeb2-7f8c3d89bcc4 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:16.607795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:16.662870 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b82b94-6d52-4394-aeb2-7f8c3d89bcc4 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:16.704405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec792b-f9f5-4f32-8b23-8b33bc146e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:16.705157 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec792b-f9f5-4f32-8b23-8b33bc146e27 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:16.705432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec792b-f9f5-4f32-8b23-8b33bc146e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:16.705699 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec792b-f9f5-4f32-8b23-8b33bc146e27 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:16.706550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec792b-f9f5-4f32-8b23-8b33bc146e27 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:16.706851 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec792b-f9f5-4f32-8b23-8b33bc146e27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:16.708309 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec792b-f9f5-4f32-8b23-8b33bc146e27 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:16.727257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 608/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Jul 12 03:18:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:18:16.733288 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc848554-e998-43c0-89a6-9c13e4f490dc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:16.844306 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc848554-e998-43c0-89a6-9c13e4f490dc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:16.889940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbfdda-331d-4961-9d47-0dc16e2c6348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:16.890792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbfdda-331d-4961-9d47-0dc16e2c6348 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:16.891074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbfdda-331d-4961-9d47-0dc16e2c6348 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:16.891335 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbfdda-331d-4961-9d47-0dc16e2c6348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:16.903730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbfdda-331d-4961-9d47-0dc16e2c6348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:16.905641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbfdda-331d-4961-9d47-0dc16e2c6348 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:16.928396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7ecbfdda-331d-4961-9d47-0dc16e2c6348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:16.928396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:16.928396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:16.928396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:16.928396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:16.928396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:16.928396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:16.928396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:16.928396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:16.928396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:16.928396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:16.928396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:16.928396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:18:16.928396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:18:16.928396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:18:16.929668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:18:16.929668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:16.929668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:16.929668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:16.929668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:16.929668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:16.929668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:16.929668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:16.929668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:16.929668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:16.929668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:16.929668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:16.929668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:16.929668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:16.929668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:16.929668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:16.929668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:16.930702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:18:16.930702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:18:16.930702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:16.930702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:16.930702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 620/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:18:16.935627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec792b-f9f5-4f32-8b23-8b33bc146e27 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:17.049468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec792b-f9f5-4f32-8b23-8b33bc146e27 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:17.051966 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:17.089290 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc2b88-59e9-4bd5-a3b6-a64c02f549a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:17.090334 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc2b88-59e9-4bd5-a3b6-a64c02f549a5 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:17.090592 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc2b88-59e9-4bd5-a3b6-a64c02f549a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:17.090874 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc2b88-59e9-4bd5-a3b6-a64c02f549a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:17.091567 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc2b88-59e9-4bd5-a3b6-a64c02f549a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:17.091861 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc2b88-59e9-4bd5-a3b6-a64c02f549a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:17.093413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc2b88-59e9-4bd5-a3b6-a64c02f549a5 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:17.105889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 609/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:17.111985 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbfdda-331d-4961-9d47-0dc16e2c6348 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:17.122174 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:17.220600 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbfdda-331d-4961-9d47-0dc16e2c6348 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:17.254005 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc9b79-2fe9-46cb-8f84-8e3b85b34690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:17.254809 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc9b79-2fe9-46cb-8f84-8e3b85b34690 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:17.255113 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc9b79-2fe9-46cb-8f84-8e3b85b34690 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:17.255361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc9b79-2fe9-46cb-8f84-8e3b85b34690 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:17.262769 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc9b79-2fe9-46cb-8f84-8e3b85b34690 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:17.264254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc9b79-2fe9-46cb-8f84-8e3b85b34690 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:17.280370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-64fc9b79-2fe9-46cb-8f84-8e3b85b34690 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:18:17.280370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:17.280370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:17.280370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:17.280370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:17.280370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:17.280370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:17.280370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:17.280370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:17.280370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:17.280370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:17.280370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:17.280370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:18:17.280370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:18:17.280370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:18:17.281518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:18:17.281518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:17.281518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:17.281518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:17.281518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:17.281518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:17.281518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:17.281518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:17.281518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:17.281518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:17.281518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:17.281518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:17.281518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:17.281518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:17.281518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:17.281518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:17.281518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:17.282613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:18:17.282613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:18:17.282613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:18:17.282613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:18:17.282613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:18:17.282613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:18:17.282613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:18:17.282613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:17.287271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 621/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:18:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:17.288612 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc2b88-59e9-4bd5-a3b6-a64c02f549a5 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:17.398404 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc2b88-59e9-4bd5-a3b6-a64c02f549a5 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:17.435350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ddc9b-f9b3-46af-8fad-8e43b416a13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:17.436015 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ddc9b-f9b3-46af-8fad-8e43b416a13b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:17.436303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ddc9b-f9b3-46af-8fad-8e43b416a13b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:17.436597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ddc9b-f9b3-46af-8fad-8e43b416a13b None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:17.437379 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ddc9b-f9b3-46af-8fad-8e43b416a13b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:17.437701 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ddc9b-f9b3-46af-8fad-8e43b416a13b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:17.439122 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ddc9b-f9b3-46af-8fad-8e43b416a13b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:17.451384 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 610/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:18:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:17.457601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc9b79-2fe9-46cb-8f84-8e3b85b34690 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:17.531993 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:17.567965 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc9b79-2fe9-46cb-8f84-8e3b85b34690 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:17.608320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6a7ab-4e99-44a9-b49a-c0a61835248b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:17.609333 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6a7ab-4e99-44a9-b49a-c0a61835248b None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:17.609722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6a7ab-4e99-44a9-b49a-c0a61835248b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:17.610035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6a7ab-4e99-44a9-b49a-c0a61835248b None admin] PATH_INFO: `/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/361ad35021eb43cca46d9b66e6f24ba6/roles/8a9636f0fea542a19f6fcaf54b9c1d11` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:17.627365 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6a7ab-4e99-44a9-b49a-c0a61835248b None admin] RBAC: Authorizing `identity:create_grant(project_id=afd5f89a049d40dc8456bd351f01f603, user_id=361ad35021eb43cca46d9b66e6f24ba6, role_id=8a9636f0fea542a19f6fcaf54b9c1d11)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:17.628863 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6a7ab-4e99-44a9-b49a-c0a61835248b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:17.644452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 622/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:18:17 2022] PUT /identity/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/361ad35021eb43cca46d9b66e6f24ba6/roles/8a9636f0fea542a19f6fcaf54b9c1d11 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:18:19.823617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7479406-2bb0-4ddb-8ecf-eaa7ba1a612b None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:19.824246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7479406-2bb0-4ddb-8ecf-eaa7ba1a612b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:19.824246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7479406-2bb0-4ddb-8ecf-eaa7ba1a612b None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:19.826411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 611/1233] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:18:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:18:19.832196 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dc5f9-f005-404c-8ffe-46195fe3dac2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:19.832651 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dc5f9-f005-404c-8ffe-46195fe3dac2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:19.832796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dc5f9-f005-404c-8ffe-46195fe3dac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:19.857932 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a50dc5f9-f005-404c-8ffe-46195fe3dac2 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:18:19.859155 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a50dc5f9-f005-404c-8ffe-46195fe3dac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:18:19.931487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 623/1234] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:18:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:18:19.955376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7479406-2bb0-4ddb-8ecf-eaa7ba1a612b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:19.982476 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:20.065251 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7479406-2bb0-4ddb-8ecf-eaa7ba1a612b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:20.102233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e70dc7-996e-47cb-b626-cce4f3a04d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:20.103040 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e70dc7-996e-47cb-b626-cce4f3a04d03 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:20.103318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e70dc7-996e-47cb-b626-cce4f3a04d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:20.103589 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e70dc7-996e-47cb-b626-cce4f3a04d03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:20.113627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e70dc7-996e-47cb-b626-cce4f3a04d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:18:20.122163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-10e70dc7-996e-47cb-b626-cce4f3a04d03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:18:20.122163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:20.122163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:20.122163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:20.122163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:20.122163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:20.122163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:20.122163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:20.122163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:20.122163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:20.122163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:20.122163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:20.122163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:18:20.122163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:18:20.122163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:18:20.122163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:18:20.123371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:18:20.123371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:18:20.123371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:18:20.123371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:18:20.123371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:20.123371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:20.123371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:20.123371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:20.123371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:20.123371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:20.123371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:20.123371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:20.123371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:20.123371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:20.123371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:20.123371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:20.124235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:20.124235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:20.124235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:20.124235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:20.124235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:18:20.124235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:18:20.124235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:18:20.124235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:18:20.124235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:18:20.124235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:18:20.124235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 03:18:20.124235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:18:20.124235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 612/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Tue Jul 12 03:18:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:20.129733 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50dc5f9-f005-404c-8ffe-46195fe3dac2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:20.178800 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:20.236128 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50dc5f9-f005-404c-8ffe-46195fe3dac2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:20.270025 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d26b8-0604-4e51-ba38-0a5571b90d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:20.270701 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d26b8-0604-4e51-ba38-0a5571b90d87 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:20.270975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d26b8-0604-4e51-ba38-0a5571b90d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:20.271245 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d26b8-0604-4e51-ba38-0a5571b90d87 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:20.271996 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d26b8-0604-4e51-ba38-0a5571b90d87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:20.272384 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d26b8-0604-4e51-ba38-0a5571b90d87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:20.273812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d26b8-0604-4e51-ba38-0a5571b90d87 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:20.282964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 624/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Tue Jul 12 03:18:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:20.289104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e70dc7-996e-47cb-b626-cce4f3a04d03 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:20.383047 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:20.401756 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e70dc7-996e-47cb-b626-cce4f3a04d03 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:20.437432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399aafb-eb59-4ff6-af38-307f9140744a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:20.438281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399aafb-eb59-4ff6-af38-307f9140744a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:20.438610 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399aafb-eb59-4ff6-af38-307f9140744a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:20.438882 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399aafb-eb59-4ff6-af38-307f9140744a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:20.451066 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399aafb-eb59-4ff6-af38-307f9140744a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:20.452640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399aafb-eb59-4ff6-af38-307f9140744a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:20.471461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-9399aafb-eb59-4ff6-af38-307f9140744a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:20.471461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:20.471461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:20.471461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:20.471461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:20.471461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:20.471461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:20.471461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:20.471461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:20.471461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:20.471461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:20.471461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:20.471461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:18:20.471461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:18:20.471461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:18:20.472667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:18:20.472667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:20.472667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:20.472667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:20.472667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:20.472667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:20.472667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:20.472667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:20.472667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:20.472667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:20.472667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:20.472667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:20.472667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:20.472667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:20.472667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:20.472667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:20.472667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:20.473631 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:18:20.473631 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:18:20.473631 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:20.473631 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:18:20.473631 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 613/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:20.478835 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d26b8-0604-4e51-ba38-0a5571b90d87 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:20.584381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d26b8-0604-4e51-ba38-0a5571b90d87 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:20.596286 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:20.623649 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96696a-b725-4571-89ee-2309e6eb6cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:20.624351 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96696a-b725-4571-89ee-2309e6eb6cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:20.624717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96696a-b725-4571-89ee-2309e6eb6cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:20.624993 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96696a-b725-4571-89ee-2309e6eb6cf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:20.625743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96696a-b725-4571-89ee-2309e6eb6cf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:20.626041 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96696a-b725-4571-89ee-2309e6eb6cf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:20.627411 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96696a-b725-4571-89ee-2309e6eb6cf0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:20.639716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 625/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:20.645483 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399aafb-eb59-4ff6-af38-307f9140744a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:20.757377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399aafb-eb59-4ff6-af38-307f9140744a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:20.795822 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41212e7-7d3e-43af-92d9-6c43f30c6f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:20.797184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41212e7-7d3e-43af-92d9-6c43f30c6f78 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:20.797499 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41212e7-7d3e-43af-92d9-6c43f30c6f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:20.797806 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41212e7-7d3e-43af-92d9-6c43f30c6f78 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:20.800920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:20.806906 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41212e7-7d3e-43af-92d9-6c43f30c6f78 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:20.808640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41212e7-7d3e-43af-92d9-6c43f30c6f78 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:20.822865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d41212e7-7d3e-43af-92d9-6c43f30c6f78 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 03:18:20.822865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:20.822865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:20.822865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:20.822865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:20.822865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:20.822865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:20.822865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:20.822865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:20.822865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:20.822865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:20.822865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:20.822865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:18:20.822865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:18:20.822865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:18:20.822865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:20.824495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:20.825663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:20.825663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:20.825663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:18:20.825663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:18:20.825663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:18:20.825663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:18:20.825663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:18:20.825663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:18:20.825663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 03:18:20.825663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:18:20.825663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 614/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:20.829930 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96696a-b725-4571-89ee-2309e6eb6cf0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:20.936948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96696a-b725-4571-89ee-2309e6eb6cf0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:20.974343 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1b683-ddab-4c26-a37e-2fc7ef7cc500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:20.975180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1b683-ddab-4c26-a37e-2fc7ef7cc500 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:20.975519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1b683-ddab-4c26-a37e-2fc7ef7cc500 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:20.975840 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1b683-ddab-4c26-a37e-2fc7ef7cc500 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:20.976714 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1b683-ddab-4c26-a37e-2fc7ef7cc500 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:20.977019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1b683-ddab-4c26-a37e-2fc7ef7cc500 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:20.978457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1b683-ddab-4c26-a37e-2fc7ef7cc500 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:20.997824 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 626/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Jul 12 03:18:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:21.003872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41212e7-7d3e-43af-92d9-6c43f30c6f78 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:21.111993 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41212e7-7d3e-43af-92d9-6c43f30c6f78 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:21.150375 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052917b-8821-47df-9e58-b287bb3003b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:21.151100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052917b-8821-47df-9e58-b287bb3003b6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:21.151428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052917b-8821-47df-9e58-b287bb3003b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:21.151704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052917b-8821-47df-9e58-b287bb3003b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:21.224795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:21.232555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052917b-8821-47df-9e58-b287bb3003b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:21.234255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052917b-8821-47df-9e58-b287bb3003b6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:21.337269 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 615/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:18:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 03:18:21.343593 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1b683-ddab-4c26-a37e-2fc7ef7cc500 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:21.373669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:21.452582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1b683-ddab-4c26-a37e-2fc7ef7cc500 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:21.491496 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c3cc2-a6d3-44b8-bda9-e7905300427f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:21.492259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c3cc2-a6d3-44b8-bda9-e7905300427f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:21.492566 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c3cc2-a6d3-44b8-bda9-e7905300427f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:21.492841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c3cc2-a6d3-44b8-bda9-e7905300427f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:21.503483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c3cc2-a6d3-44b8-bda9-e7905300427f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:21.504966 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c3cc2-a6d3-44b8-bda9-e7905300427f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:21.525214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f01c3cc2-a6d3-44b8-bda9-e7905300427f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:21.525214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:21.525214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:21.525214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:21.525214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:21.525214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:21.525214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:21.525214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:21.525214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:21.525214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:21.525214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:21.525214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:21.525214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:18:21.525214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:18:21.525214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:18:21.526317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:18:21.526317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:21.526317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:21.526317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:21.526317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:21.526317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:21.526317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:21.526317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:21.526317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:21.526317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:21.526317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:21.526317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:21.526317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:21.526317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:21.526317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:21.526317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:21.526317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:21.527369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:18:21.527369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:18:21.527369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:21.527369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:21.527369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 627/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:21.532607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052917b-8821-47df-9e58-b287bb3003b6 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:21.638056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:21.644335 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052917b-8821-47df-9e58-b287bb3003b6 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:21.679904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2d3f4-0a6e-4a07-99c3-f9e80c1b2dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:21.680749 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2d3f4-0a6e-4a07-99c3-f9e80c1b2dad None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:21.681120 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2d3f4-0a6e-4a07-99c3-f9e80c1b2dad None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:21.681508 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2d3f4-0a6e-4a07-99c3-f9e80c1b2dad None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:21.682335 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2d3f4-0a6e-4a07-99c3-f9e80c1b2dad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:21.682726 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2d3f4-0a6e-4a07-99c3-f9e80c1b2dad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:21.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2d3f4-0a6e-4a07-99c3-f9e80c1b2dad None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:21.696273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 616/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:21.702142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c3cc2-a6d3-44b8-bda9-e7905300427f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:21.791788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:21.820614 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c3cc2-a6d3-44b8-bda9-e7905300427f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:21.864048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e53fb-b43e-4af9-95a0-67d3a6c66459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:21.865033 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e53fb-b43e-4af9-95a0-67d3a6c66459 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:21.865363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e53fb-b43e-4af9-95a0-67d3a6c66459 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:21.865757 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e53fb-b43e-4af9-95a0-67d3a6c66459 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:21.873271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e53fb-b43e-4af9-95a0-67d3a6c66459 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:21.874739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e53fb-b43e-4af9-95a0-67d3a6c66459 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:21.889206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-464e53fb-b43e-4af9-95a0-67d3a6c66459 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:18:21.889206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:21.889206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:21.889206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:21.889206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:21.889206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:21.889206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:21.889206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:21.889206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:21.889206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:21.889206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:21.889206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:21.889206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:18:21.889206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:18:21.889206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:18:21.890259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:18:21.890259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:21.890259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:21.890259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:21.890259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:21.890259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:21.890259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:21.890259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:21.890259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:21.890259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:21.890259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:21.890259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:21.890259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:21.890259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:21.890259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:21.890259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:21.890259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:21.891402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:18:21.891402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:18:21.891402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:18:21.891402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:18:21.891402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:18:21.891402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:18:21.891402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:18:21.891402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:21.891402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 628/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:18:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:21.899401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2d3f4-0a6e-4a07-99c3-f9e80c1b2dad None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:22.014386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2d3f4-0a6e-4a07-99c3-f9e80c1b2dad None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:22.054871 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6393a-6733-4dfd-bde9-720c32581f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:22.055506 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6393a-6733-4dfd-bde9-720c32581f78 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:22.055855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6393a-6733-4dfd-bde9-720c32581f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:22.056156 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6393a-6733-4dfd-bde9-720c32581f78 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:22.056992 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6393a-6733-4dfd-bde9-720c32581f78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:22.057369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6393a-6733-4dfd-bde9-720c32581f78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:22.058839 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6393a-6733-4dfd-bde9-720c32581f78 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:22.072751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 617/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:18:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:18:22.079250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e53fb-b43e-4af9-95a0-67d3a6c66459 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:22.197999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e53fb-b43e-4af9-95a0-67d3a6c66459 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:22.233972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a7069-916c-49c3-b339-ab0567fb4f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:22.234631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a7069-916c-49c3-b339-ab0567fb4f76 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:22.234911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a7069-916c-49c3-b339-ab0567fb4f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:22.235183 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a7069-916c-49c3-b339-ab0567fb4f76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:22.236026 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a7069-916c-49c3-b339-ab0567fb4f76 None admin] RBAC: Adding query filter params (role.id=8a9636f0fea542a19f6fcaf54b9c1d11, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=361ad35021eb43cca46d9b66e6f24ba6) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:22.236336 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a7069-916c-49c3-b339-ab0567fb4f76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:22.237961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a7069-916c-49c3-b339-ab0567fb4f76 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:22.244794 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 629/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:18:22 2022] GET /identity/v3/role_assignments?user.id=361ad35021eb43cca46d9b66e6f24ba6&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=8a9636f0fea542a19f6fcaf54b9c1d11 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:24.459485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15499b42-4b0b-481e-b0d0-c393ad1641f4 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:24.460084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15499b42-4b0b-481e-b0d0-c393ad1641f4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:24.460084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15499b42-4b0b-481e-b0d0-c393ad1641f4 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:24.461796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 618/1247] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:18:24.467970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc407f-cb34-4df6-91d5-b6ec699193f7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:24.468411 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc407f-cb34-4df6-91d5-b6ec699193f7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:24.468505 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc407f-cb34-4df6-91d5-b6ec699193f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:24.473747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:24.487034 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c0bc407f-cb34-4df6-91d5-b6ec699193f7 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:18:24.488315 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c0bc407f-cb34-4df6-91d5-b6ec699193f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:18:24.561382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 630/1248] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:18:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:18:24.591101 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15499b42-4b0b-481e-b0d0-c393ad1641f4 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:24.611681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:24.711763 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15499b42-4b0b-481e-b0d0-c393ad1641f4 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:24.752211 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d0036-fff4-4ef0-bf95-e254db78fa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:24.753189 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d0036-fff4-4ef0-bf95-e254db78fa06 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:24.753503 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d0036-fff4-4ef0-bf95-e254db78fa06 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:24.753786 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d0036-fff4-4ef0-bf95-e254db78fa06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:24.764969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d0036-fff4-4ef0-bf95-e254db78fa06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:18:24.773342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-5d6d0036-fff4-4ef0-bf95-e254db78fa06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:18:24.773342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:24.773342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:24.773342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:24.773342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:24.773342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:24.773342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:24.773342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:24.773342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:24.773342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:24.773342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:24.773342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:24.773342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:18:24.773342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:18:24.773342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:18:24.773342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:18:24.774359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:18:24.774359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:18:24.774359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:18:24.774359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:18:24.774359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:24.774359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:24.774359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:24.774359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:24.774359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:24.774359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:24.774359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:24.774359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:24.774359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:24.774359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:24.774359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:24.774359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:24.775728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:24.775728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:24.775728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:24.775728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:24.775728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:18:24.775728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:18:24.775728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:18:24.775728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:18:24.775728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:18:24.775728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:18:24.775728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:18:24.775728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:18:24.775728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 619/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:18:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:24.781550 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc407f-cb34-4df6-91d5-b6ec699193f7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:24.897279 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc407f-cb34-4df6-91d5-b6ec699193f7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:24.928721 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:24.935239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d21a2-db93-42b8-aa93-878a4e194bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:24.935920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d21a2-db93-42b8-aa93-878a4e194bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:24.936206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d21a2-db93-42b8-aa93-878a4e194bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:24.936480 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d21a2-db93-42b8-aa93-878a4e194bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:24.937280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d21a2-db93-42b8-aa93-878a4e194bf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:24.937586 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d21a2-db93-42b8-aa93-878a4e194bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:24.938965 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d21a2-db93-42b8-aa93-878a4e194bf5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:24.947591 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 631/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:18:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:24.953868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d0036-fff4-4ef0-bf95-e254db78fa06 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:25.059295 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:25.086464 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d0036-fff4-4ef0-bf95-e254db78fa06 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:25.124667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e6625-5c6f-4afd-88e0-f6a7720900ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:25.125663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e6625-5c6f-4afd-88e0-f6a7720900ed None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:25.126031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e6625-5c6f-4afd-88e0-f6a7720900ed None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:25.126277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e6625-5c6f-4afd-88e0-f6a7720900ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:25.139704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e6625-5c6f-4afd-88e0-f6a7720900ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:25.141313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e6625-5c6f-4afd-88e0-f6a7720900ed None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:25.161689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-1e9e6625-5c6f-4afd-88e0-f6a7720900ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:25.161689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:25.161689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:25.161689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:25.161689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:25.161689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:25.161689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:25.161689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:25.161689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:25.161689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:25.161689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:25.161689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:25.161689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:18:25.161689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:18:25.161689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:18:25.162986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:18:25.162986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:25.162986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:25.162986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:25.162986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:25.162986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:25.162986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:25.162986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:25.162986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:25.162986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:25.162986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:25.162986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:25.162986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:25.162986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:25.162986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:25.162986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:25.162986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:25.163994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:18:25.163994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:18:25.163994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:25.163994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:18:25.163994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 620/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:18:25.169131 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d21a2-db93-42b8-aa93-878a4e194bf5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:25.291641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d21a2-db93-42b8-aa93-878a4e194bf5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:25.326141 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ee816-ad7e-45e5-a1dd-735ccad16fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:25.326810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ee816-ad7e-45e5-a1dd-735ccad16fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:25.327095 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ee816-ad7e-45e5-a1dd-735ccad16fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:25.327366 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ee816-ad7e-45e5-a1dd-735ccad16fa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:25.328163 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ee816-ad7e-45e5-a1dd-735ccad16fa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:25.328467 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ee816-ad7e-45e5-a1dd-735ccad16fa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:25.330043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ee816-ad7e-45e5-a1dd-735ccad16fa1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:25.343512 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 632/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:25.349614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e6625-5c6f-4afd-88e0-f6a7720900ed None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:25.461409 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e6625-5c6f-4afd-88e0-f6a7720900ed None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:25.488910 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:25.498135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41d83a-60cd-4a15-8372-f744aad6aa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:25.498948 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41d83a-60cd-4a15-8372-f744aad6aa38 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:25.499231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41d83a-60cd-4a15-8372-f744aad6aa38 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:25.499500 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41d83a-60cd-4a15-8372-f744aad6aa38 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:25.508457 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41d83a-60cd-4a15-8372-f744aad6aa38 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:25.510032 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41d83a-60cd-4a15-8372-f744aad6aa38 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:25.525461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-8a41d83a-60cd-4a15-8372-f744aad6aa38 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 03:18:25.525461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:25.525461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:25.525461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:25.525461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:25.525461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:25.525461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:25.525461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:25.525461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:25.525461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:25.525461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:25.525461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:25.525461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:18:25.525461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:18:25.525461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:18:25.525461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:25.526601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:25.527712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:25.527712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:25.527712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:18:25.527712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:18:25.527712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:18:25.527712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:18:25.527712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:18:25.527712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:18:25.527712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 03:18:25.527712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:18:25.527712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 621/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:25.532700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ee816-ad7e-45e5-a1dd-735ccad16fa1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:25.594887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:25.643929 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ee816-ad7e-45e5-a1dd-735ccad16fa1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:25.683548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75238ee6-8f7b-4b33-b6fa-d6e37f55dcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:25.684242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75238ee6-8f7b-4b33-b6fa-d6e37f55dcf7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:25.684544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75238ee6-8f7b-4b33-b6fa-d6e37f55dcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:25.684857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75238ee6-8f7b-4b33-b6fa-d6e37f55dcf7 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:25.685676 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75238ee6-8f7b-4b33-b6fa-d6e37f55dcf7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:25.686007 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75238ee6-8f7b-4b33-b6fa-d6e37f55dcf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:25.687431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75238ee6-8f7b-4b33-b6fa-d6e37f55dcf7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:25.708084 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 633/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Jul 12 03:18:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:25.714080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41d83a-60cd-4a15-8372-f744aad6aa38 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:25.830804 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41d83a-60cd-4a15-8372-f744aad6aa38 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:25.866160 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c0c64-6f14-402a-ad82-2280428d52cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:25.866376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c0c64-6f14-402a-ad82-2280428d52cf None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:25.866559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c0c64-6f14-402a-ad82-2280428d52cf None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:25.866901 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c0c64-6f14-402a-ad82-2280428d52cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:25.925321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:25.939730 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c0c64-6f14-402a-ad82-2280428d52cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:25.941228 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c0c64-6f14-402a-ad82-2280428d52cf None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:26.049938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 622/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:18:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 03:18:26.056408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75238ee6-8f7b-4b33-b6fa-d6e37f55dcf7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:26.164952 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75238ee6-8f7b-4b33-b6fa-d6e37f55dcf7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:26.182123 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:26.212690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5bd30-3a5b-4ea0-a8ec-4e4f139aac95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:26.213526 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5bd30-3a5b-4ea0-a8ec-4e4f139aac95 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:26.213802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5bd30-3a5b-4ea0-a8ec-4e4f139aac95 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:26.214404 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5bd30-3a5b-4ea0-a8ec-4e4f139aac95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:26.225178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5bd30-3a5b-4ea0-a8ec-4e4f139aac95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:26.226102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5bd30-3a5b-4ea0-a8ec-4e4f139aac95 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:26.245884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-68a5bd30-3a5b-4ea0-a8ec-4e4f139aac95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:26.245884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:26.245884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:26.245884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:26.245884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:26.245884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:26.245884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:26.245884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:26.245884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:26.245884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:26.245884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:26.245884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:26.245884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:18:26.245884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:18:26.245884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:18:26.246990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:18:26.246990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:26.246990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:26.246990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:26.246990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:26.246990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:26.246990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:26.246990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:26.246990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:26.246990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:26.246990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:26.246990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:26.246990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:26.246990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:26.246990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:26.246990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:26.246990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:26.247893 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:18:26.247893 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:18:26.247893 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:26.247893 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:26.247893 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 634/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:26.252998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c0c64-6f14-402a-ad82-2280428d52cf None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:26.342942 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:26.356367 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c0c64-6f14-402a-ad82-2280428d52cf None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:26.394776 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61b91e-c184-4c24-86ae-908855a188fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:26.395426 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61b91e-c184-4c24-86ae-908855a188fc None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:26.395707 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61b91e-c184-4c24-86ae-908855a188fc None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:26.395995 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61b91e-c184-4c24-86ae-908855a188fc None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:26.396782 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61b91e-c184-4c24-86ae-908855a188fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:26.397257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61b91e-c184-4c24-86ae-908855a188fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:26.398471 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61b91e-c184-4c24-86ae-908855a188fc None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:26.410288 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 623/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:26.416663 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5bd30-3a5b-4ea0-a8ec-4e4f139aac95 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:26.522184 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5bd30-3a5b-4ea0-a8ec-4e4f139aac95 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:26.558864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a18c87-5353-4c4b-9780-ee3a2f5fad4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:26.559665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a18c87-5353-4c4b-9780-ee3a2f5fad4c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:26.559935 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a18c87-5353-4c4b-9780-ee3a2f5fad4c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:26.560233 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a18c87-5353-4c4b-9780-ee3a2f5fad4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:26.566994 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a18c87-5353-4c4b-9780-ee3a2f5fad4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:26.568565 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a18c87-5353-4c4b-9780-ee3a2f5fad4c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:26.583062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e7a18c87-5353-4c4b-9780-ee3a2f5fad4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:18:26.583062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:26.583062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:26.583062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:26.583062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:26.583062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:26.583062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:26.583062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:26.583062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:26.583062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:26.583062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:26.583062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:26.583062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:18:26.583062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:18:26.583062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:18:26.584223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:18:26.584223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:26.584223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:26.584223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:26.584223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:26.584223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:26.584223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:26.584223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:26.584223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:26.584223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:26.584223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:26.584223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:26.584223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:26.584223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:26.584223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:26.584223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:26.584223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:26.585381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:18:26.585381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:18:26.585381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:18:26.585381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:18:26.585381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:18:26.585381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:18:26.585381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:18:26.585381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:26.585381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 635/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:18:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:26.591593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61b91e-c184-4c24-86ae-908855a188fc None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:26.698919 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61b91e-c184-4c24-86ae-908855a188fc None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:26.734424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea96e61-1143-458a-842b-f08afe88f7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:26.735081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea96e61-1143-458a-842b-f08afe88f7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:26.735371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea96e61-1143-458a-842b-f08afe88f7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:26.735640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea96e61-1143-458a-842b-f08afe88f7b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:26.736411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea96e61-1143-458a-842b-f08afe88f7b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:26.736742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea96e61-1143-458a-842b-f08afe88f7b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:26.738186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea96e61-1143-458a-842b-f08afe88f7b7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:26.750512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 624/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:18:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:26.758231 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a18c87-5353-4c4b-9780-ee3a2f5fad4c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:26.785328 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:26.867017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a18c87-5353-4c4b-9780-ee3a2f5fad4c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:26.903895 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842804c-32bc-4cc4-bc49-1e459ef33048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:26.904638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842804c-32bc-4cc4-bc49-1e459ef33048 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:26.904922 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842804c-32bc-4cc4-bc49-1e459ef33048 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:26.905242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842804c-32bc-4cc4-bc49-1e459ef33048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:26.906058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842804c-32bc-4cc4-bc49-1e459ef33048 None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=361ad35021eb43cca46d9b66e6f24ba6) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:26.906400 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842804c-32bc-4cc4-bc49-1e459ef33048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:26.907825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842804c-32bc-4cc4-bc49-1e459ef33048 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:26.913696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 636/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:18:26 2022] GET /identity/v3/role_assignments?user.id=361ad35021eb43cca46d9b66e6f24ba6&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:29.042790 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b9107-7017-432b-a70b-db218e132f20 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:29.043318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b9107-7017-432b-a70b-db218e132f20 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:29.043318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b9107-7017-432b-a70b-db218e132f20 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:29.044633 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 625/1261] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:18:29.051009 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffca5cc-0286-4910-9e5e-874205eceb10 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:29.051714 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffca5cc-0286-4910-9e5e-874205eceb10 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:29.051864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffca5cc-0286-4910-9e5e-874205eceb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:29.072732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cffca5cc-0286-4910-9e5e-874205eceb10 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:18:29.073944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cffca5cc-0286-4910-9e5e-874205eceb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:18:29.147563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 637/1262] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:18:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:18:29.171451 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b9107-7017-432b-a70b-db218e132f20 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:29.185557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:29.283904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b9107-7017-432b-a70b-db218e132f20 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:29.320549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c9dc9-6709-4aff-8cf6-c72150752de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:29.321329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c9dc9-6709-4aff-8cf6-c72150752de1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:29.321600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c9dc9-6709-4aff-8cf6-c72150752de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:29.321856 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c9dc9-6709-4aff-8cf6-c72150752de1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:29.332325 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c9dc9-6709-4aff-8cf6-c72150752de1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:18:29.340317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-578c9dc9-6709-4aff-8cf6-c72150752de1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:18:29.340317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:29.340317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:29.340317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:29.340317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:29.340317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:29.340317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:29.340317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:29.340317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:29.340317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:29.340317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:29.340317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:29.340317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:18:29.340317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:18:29.340317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:18:29.340317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:18:29.341437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:18:29.341437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:18:29.341437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:18:29.341437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:18:29.341437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:29.341437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:29.341437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:29.341437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:29.341437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:29.341437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:29.341437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:29.341437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:29.341437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:29.341437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:29.341437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:29.341437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:29.342428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:29.342428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:29.342428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:29.342428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:29.342428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:18:29.342428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:18:29.342428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:18:29.342428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:18:29.342428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:18:29.342428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:18:29.342428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:18:29.342428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:18:29.342428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 626/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:18:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:29.348205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffca5cc-0286-4910-9e5e-874205eceb10 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:29.371139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:29.456445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffca5cc-0286-4910-9e5e-874205eceb10 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:29.492158 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c09626-4286-45e9-a1ca-10503d0354e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:29.492859 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c09626-4286-45e9-a1ca-10503d0354e4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:29.493139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c09626-4286-45e9-a1ca-10503d0354e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:29.493393 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c09626-4286-45e9-a1ca-10503d0354e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:29.494142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c09626-4286-45e9-a1ca-10503d0354e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:29.494447 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c09626-4286-45e9-a1ca-10503d0354e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:29.495829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c09626-4286-45e9-a1ca-10503d0354e4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:29.504873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 638/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:18:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:29.513759 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c9dc9-6709-4aff-8cf6-c72150752de1 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:29.582635 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:29.617830 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c9dc9-6709-4aff-8cf6-c72150752de1 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:29.652190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348d3d2-aa40-49dc-812d-eb3a295cff43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:29.652999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348d3d2-aa40-49dc-812d-eb3a295cff43 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:29.653273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348d3d2-aa40-49dc-812d-eb3a295cff43 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:29.653541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348d3d2-aa40-49dc-812d-eb3a295cff43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:29.664637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348d3d2-aa40-49dc-812d-eb3a295cff43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:29.666081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348d3d2-aa40-49dc-812d-eb3a295cff43 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:29.683364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-6348d3d2-aa40-49dc-812d-eb3a295cff43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:29.683364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:29.683364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:29.683364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:29.683364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:29.683364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:29.683364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:29.683364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:29.683364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:29.683364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:29.683364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:29.683364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:29.683364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:18:29.683364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:18:29.683364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:18:29.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:18:29.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:29.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:29.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:29.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:29.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:29.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:29.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:29.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:29.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:29.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:29.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:29.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:29.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:29.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:29.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:29.684396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:29.685458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:18:29.685458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:18:29.685458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:29.685458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:18:29.688759 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 627/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 03:18:29.690622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c09626-4286-45e9-a1ca-10503d0354e4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:29.773981 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:29.806375 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c09626-4286-45e9-a1ca-10503d0354e4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:29.842323 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1547b-5afd-4e64-97ff-ef2074f664fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:29.842908 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1547b-5afd-4e64-97ff-ef2074f664fd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:29.843188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1547b-5afd-4e64-97ff-ef2074f664fd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:29.843463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1547b-5afd-4e64-97ff-ef2074f664fd None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:29.844192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1547b-5afd-4e64-97ff-ef2074f664fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:29.844499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1547b-5afd-4e64-97ff-ef2074f664fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:29.845891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1547b-5afd-4e64-97ff-ef2074f664fd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:29.857665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 639/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:18:29.866772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348d3d2-aa40-49dc-812d-eb3a295cff43 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:29.980083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348d3d2-aa40-49dc-812d-eb3a295cff43 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:29.999856 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:30.022550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7bacd-2601-4985-b1e3-8b201ff313c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:30.023232 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7bacd-2601-4985-b1e3-8b201ff313c9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:30.023507 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7bacd-2601-4985-b1e3-8b201ff313c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:30.023779 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7bacd-2601-4985-b1e3-8b201ff313c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:30.031757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7bacd-2601-4985-b1e3-8b201ff313c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:30.033230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7bacd-2601-4985-b1e3-8b201ff313c9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:30.047391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-8ce7bacd-2601-4985-b1e3-8b201ff313c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 03:18:30.047391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:30.047391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:30.047391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:30.047391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:30.047391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:30.047391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:30.047391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:30.047391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:30.047391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:30.047391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:30.047391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:30.047391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:18:30.047391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:18:30.047391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:18:30.047391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:30.048920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:30.049894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:30.049894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:30.049894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:18:30.049894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:18:30.049894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:18:30.049894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:18:30.049894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:18:30.049894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:18:30.049894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 03:18:30.049894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:18:30.049894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 628/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:30.055227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1547b-5afd-4e64-97ff-ef2074f664fd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:30.169601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1547b-5afd-4e64-97ff-ef2074f664fd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:30.206297 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f54cf9-f883-4c72-9429-9fa6e66b5a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:30.206952 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f54cf9-f883-4c72-9429-9fa6e66b5a8f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:30.207225 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f54cf9-f883-4c72-9429-9fa6e66b5a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:30.207491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f54cf9-f883-4c72-9429-9fa6e66b5a8f None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:30.208321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f54cf9-f883-4c72-9429-9fa6e66b5a8f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:30.208648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f54cf9-f883-4c72-9429-9fa6e66b5a8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:30.210259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f54cf9-f883-4c72-9429-9fa6e66b5a8f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:30.223689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:30.234036 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 640/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Jul 12 03:18:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:30.243402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7bacd-2601-4985-b1e3-8b201ff313c9 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:30.367641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7bacd-2601-4985-b1e3-8b201ff313c9 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:30.408888 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424b662-2a4c-4fab-9b8d-dc76ab7486db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:30.409680 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424b662-2a4c-4fab-9b8d-dc76ab7486db None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:30.409959 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424b662-2a4c-4fab-9b8d-dc76ab7486db None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:30.410229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424b662-2a4c-4fab-9b8d-dc76ab7486db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:30.422115 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424b662-2a4c-4fab-9b8d-dc76ab7486db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:30.423502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424b662-2a4c-4fab-9b8d-dc76ab7486db None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:30.443801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7424b662-2a4c-4fab-9b8d-dc76ab7486db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:30.443801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:30.443801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:30.443801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:30.443801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:30.443801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:30.443801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:30.443801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:30.443801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:30.443801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:30.443801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:30.443801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:30.443801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:18:30.443801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:18:30.443801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:18:30.444854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:18:30.444854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:30.444854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:30.444854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:30.444854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:30.444854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:30.444854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:30.444854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:30.444854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:30.444854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:30.444854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:30.444854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:30.444854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:30.444854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:30.444854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:30.444854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:30.444854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:30.446417 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:18:30.446417 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:18:30.446417 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:30.446417 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:18:30.446417 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 629/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:30.454022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f54cf9-f883-4c72-9429-9fa6e66b5a8f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:30.566804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f54cf9-f883-4c72-9429-9fa6e66b5a8f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:30.601636 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af9046-0f1c-4255-897b-626cb6595d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:30.602260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af9046-0f1c-4255-897b-626cb6595d10 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:30.602533 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af9046-0f1c-4255-897b-626cb6595d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:30.602803 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af9046-0f1c-4255-897b-626cb6595d10 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:30.603524 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af9046-0f1c-4255-897b-626cb6595d10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:30.603823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af9046-0f1c-4255-897b-626cb6595d10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:30.605216 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af9046-0f1c-4255-897b-626cb6595d10 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:30.617918 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 641/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:30.624408 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424b662-2a4c-4fab-9b8d-dc76ab7486db None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:30.659915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:30.734863 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424b662-2a4c-4fab-9b8d-dc76ab7486db None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:30.771452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcf8f2-4f73-4338-9dca-322042a7e0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:30.772362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcf8f2-4f73-4338-9dca-322042a7e0da None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:30.772673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcf8f2-4f73-4338-9dca-322042a7e0da None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:30.772932 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcf8f2-4f73-4338-9dca-322042a7e0da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:30.779729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcf8f2-4f73-4338-9dca-322042a7e0da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:30.781211 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcf8f2-4f73-4338-9dca-322042a7e0da None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:30.795505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-11fcf8f2-4f73-4338-9dca-322042a7e0da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:18:30.795505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:30.795505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:30.795505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:30.795505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:30.795505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:30.795505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:30.795505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:30.795505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:30.795505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:30.795505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:30.795505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:30.795505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:18:30.795505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:18:30.795505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:18:30.796437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:18:30.796437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:30.796437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:30.796437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:30.796437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:30.796437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:30.796437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:30.796437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:30.796437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:30.796437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:30.796437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:30.796437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:30.796437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:30.796437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:30.796437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:30.796437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:30.796437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:30.797474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:18:30.797474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:18:30.797474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:18:30.797474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:18:30.797474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:18:30.797474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:18:30.797474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:18:30.797474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:18:30.797474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 630/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:18:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:30.803112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af9046-0f1c-4255-897b-626cb6595d10 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:30.866385 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:30.916616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af9046-0f1c-4255-897b-626cb6595d10 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:30.951582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240769c6-8551-489d-83ec-172163f4fc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:30.952226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240769c6-8551-489d-83ec-172163f4fc97 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:30.952500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240769c6-8551-489d-83ec-172163f4fc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:30.952801 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240769c6-8551-489d-83ec-172163f4fc97 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:30.953646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240769c6-8551-489d-83ec-172163f4fc97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:30.953882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240769c6-8551-489d-83ec-172163f4fc97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:30.955324 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240769c6-8551-489d-83ec-172163f4fc97 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:30.967690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 642/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:18:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:30.974365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcf8f2-4f73-4338-9dca-322042a7e0da None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:31.087327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:31.101671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcf8f2-4f73-4338-9dca-322042a7e0da None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:31.138206 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3ff47-0c79-49f2-b663-2885074a4566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:31.139310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3ff47-0c79-49f2-b663-2885074a4566 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:31.139652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3ff47-0c79-49f2-b663-2885074a4566 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:31.139931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3ff47-0c79-49f2-b663-2885074a4566 None admin] PATH_INFO: `/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/361ad35021eb43cca46d9b66e6f24ba6/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:31.142159 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3ff47-0c79-49f2-b663-2885074a4566 None admin] RBAC: Authorizing `identity:create_grant(project_id=afd5f89a049d40dc8456bd351f01f603, user_id=361ad35021eb43cca46d9b66e6f24ba6, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:31.143712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3ff47-0c79-49f2-b663-2885074a4566 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:31.159483 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 631/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Tue Jul 12 03:18:30 2022] PUT /identity/v3/projects/afd5f89a049d40dc8456bd351f01f603/users/361ad35021eb43cca46d9b66e6f24ba6/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:18:33.173432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400417a1-172e-48ca-98db-4722120015b6 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:33.174053 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400417a1-172e-48ca-98db-4722120015b6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:33.174053 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400417a1-172e-48ca-98db-4722120015b6 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:33.175383 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 643/1274] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:18:33.181789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1f85b-46bd-4439-b914-e5a35641fdf6 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:33.182544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1f85b-46bd-4439-b914-e5a35641fdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:33.182700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1f85b-46bd-4439-b914-e5a35641fdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:33.204762 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9fe1f85b-46bd-4439-b914-e5a35641fdf6 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:18:33.205943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9fe1f85b-46bd-4439-b914-e5a35641fdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:18:33.281364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 632/1275] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:18:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:18:33.306903 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400417a1-172e-48ca-98db-4722120015b6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:33.415728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400417a1-172e-48ca-98db-4722120015b6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:33.434794 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:33.453248 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d246d-92ac-4ec9-860f-adb94677147d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:33.454033 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d246d-92ac-4ec9-860f-adb94677147d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:33.454310 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d246d-92ac-4ec9-860f-adb94677147d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:33.454582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d246d-92ac-4ec9-860f-adb94677147d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:33.465790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d246d-92ac-4ec9-860f-adb94677147d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 03:18:33.473337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-ef6d246d-92ac-4ec9-860f-adb94677147d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:18:33.473337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:33.473337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:33.473337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:33.473337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:33.473337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:33.473337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:33.473337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:33.473337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:33.473337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:33.473337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:33.473337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:33.473337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 03:18:33.473337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 03:18:33.473337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 03:18:33.473337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 03:18:33.474369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 03:18:33.474369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 03:18:33.474369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 03:18:33.474369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 03:18:33.474369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:33.474369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:33.474369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:33.474369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:33.474369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:33.474369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:33.474369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:33.474369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:33.474369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:33.474369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:33.474369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:33.474369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:33.475394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:33.475394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:33.475394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:33.475394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:33.475394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 03:18:33.475394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 03:18:33.475394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 03:18:33.475394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 03:18:33.475394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 03:18:33.475394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 03:18:33.475394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 03:18:33.475394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:33.475394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 644/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Tue Jul 12 03:18:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:33.480835 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1f85b-46bd-4439-b914-e5a35641fdf6 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:33.566738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:33.593809 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1f85b-46bd-4439-b914-e5a35641fdf6 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:33.630779 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c88082-4815-497a-a670-6e313d22db43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:33.631994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c88082-4815-497a-a670-6e313d22db43 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:33.632271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c88082-4815-497a-a670-6e313d22db43 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:33.632553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c88082-4815-497a-a670-6e313d22db43 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:33.633418 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c88082-4815-497a-a670-6e313d22db43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:33.633724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c88082-4815-497a-a670-6e313d22db43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:33.635102 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c88082-4815-497a-a670-6e313d22db43 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:33.643660 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 633/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Tue Jul 12 03:18:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:33.651058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d246d-92ac-4ec9-860f-adb94677147d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:33.756739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d246d-92ac-4ec9-860f-adb94677147d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:33.792990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979bbd5-9ea1-4389-babc-38b67915e885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:33.793774 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979bbd5-9ea1-4389-babc-38b67915e885 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:33.794050 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979bbd5-9ea1-4389-babc-38b67915e885 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:33.794313 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979bbd5-9ea1-4389-babc-38b67915e885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:33.805007 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979bbd5-9ea1-4389-babc-38b67915e885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:33.806461 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979bbd5-9ea1-4389-babc-38b67915e885 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:33.823630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-9979bbd5-9ea1-4389-babc-38b67915e885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:33.823630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:33.823630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:33.823630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:33.823630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:33.823630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:33.823630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:33.823630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:33.823630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:33.823630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:33.823630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:33.823630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:33.823630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:18:33.823630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:18:33.823630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:18:33.824700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:18:33.824700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:33.824700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:33.824700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:33.824700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:33.824700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:33.824700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:33.824700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:33.824700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:33.824700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:33.824700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:33.824700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:33.824700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:33.824700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:33.824700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:33.824700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:33.824700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:33.825771 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:18:33.825771 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:18:33.825771 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:33.825771 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:33.825771 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 645/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:33.831147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c88082-4815-497a-a670-6e313d22db43 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:33.941015 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c88082-4815-497a-a670-6e313d22db43 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:33.976186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a4158-6670-4b1c-97fa-460ff669d061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:33.976805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4158-6670-4b1c-97fa-460ff669d061 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:33.977085 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4158-6670-4b1c-97fa-460ff669d061 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:33.977360 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4158-6670-4b1c-97fa-460ff669d061 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:33.978080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a4158-6670-4b1c-97fa-460ff669d061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:33.978380 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a4158-6670-4b1c-97fa-460ff669d061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:33.979759 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a4158-6670-4b1c-97fa-460ff669d061 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:33.991831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 634/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:33.997794 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979bbd5-9ea1-4389-babc-38b67915e885 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:34.033216 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:34.110350 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979bbd5-9ea1-4389-babc-38b67915e885 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:34.146676 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521a638-37a3-4308-bd9f-1d287d6dbf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:34.147470 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521a638-37a3-4308-bd9f-1d287d6dbf33 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:34.147749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521a638-37a3-4308-bd9f-1d287d6dbf33 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:34.148023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521a638-37a3-4308-bd9f-1d287d6dbf33 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:34.155747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521a638-37a3-4308-bd9f-1d287d6dbf33 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:34.157251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521a638-37a3-4308-bd9f-1d287d6dbf33 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:34.171792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3521a638-37a3-4308-bd9f-1d287d6dbf33 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 03:18:34.171792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:34.171792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:34.171792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:34.171792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:34.171792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:34.171792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:34.171792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:34.171792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:34.171792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:34.171792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:34.171792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:34.171792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 03:18:34.171792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 03:18:34.171792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 03:18:34.171792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:34.172890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:34.174756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:34.174756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:34.174756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 03:18:34.174756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 03:18:34.174756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 03:18:34.174756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 03:18:34.174756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 03:18:34.174756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 03:18:34.174756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 03:18:34.174756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:34.174756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 646/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:34.179251 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a4158-6670-4b1c-97fa-460ff669d061 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:34.183295 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:34.288656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a4158-6670-4b1c-97fa-460ff669d061 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:34.323323 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2b334-c4a3-44ce-afd2-f4d22f2fdd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:34.323983 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2b334-c4a3-44ce-afd2-f4d22f2fdd7f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:34.324261 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2b334-c4a3-44ce-afd2-f4d22f2fdd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:34.324560 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2b334-c4a3-44ce-afd2-f4d22f2fdd7f None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:34.325364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2b334-c4a3-44ce-afd2-f4d22f2fdd7f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:34.325668 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2b334-c4a3-44ce-afd2-f4d22f2fdd7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:34.327129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2b334-c4a3-44ce-afd2-f4d22f2fdd7f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:34.345034 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 635/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Tue Jul 12 03:18:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:34.351951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521a638-37a3-4308-bd9f-1d287d6dbf33 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:34.447698 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:34.461802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521a638-37a3-4308-bd9f-1d287d6dbf33 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:34.501214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e92eed-bf92-4e5b-b7f2-e46fe45f7e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:34.501855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e92eed-bf92-4e5b-b7f2-e46fe45f7e7f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:34.502132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e92eed-bf92-4e5b-b7f2-e46fe45f7e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:34.502401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e92eed-bf92-4e5b-b7f2-e46fe45f7e7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:34.572440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e92eed-bf92-4e5b-b7f2-e46fe45f7e7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:34.573918 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e92eed-bf92-4e5b-b7f2-e46fe45f7e7f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:34.665813 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:34.677721 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 647/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Tue Jul 12 03:18:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 03:18:34.685903 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2b334-c4a3-44ce-afd2-f4d22f2fdd7f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:34.751016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:34.789044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2b334-c4a3-44ce-afd2-f4d22f2fdd7f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:34.824356 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151b2cb-54e9-4b92-84b1-660670ee65e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:34.825106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151b2cb-54e9-4b92-84b1-660670ee65e1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:34.825378 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151b2cb-54e9-4b92-84b1-660670ee65e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:34.825647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151b2cb-54e9-4b92-84b1-660670ee65e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:34.836011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151b2cb-54e9-4b92-84b1-660670ee65e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:34.837478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151b2cb-54e9-4b92-84b1-660670ee65e1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:34.855484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2151b2cb-54e9-4b92-84b1-660670ee65e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:34.855484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:34.855484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:34.855484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:34.855484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:34.855484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:34.855484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:34.855484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:34.855484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:34.855484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:34.855484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:34.855484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:34.855484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 03:18:34.855484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 03:18:34.855484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 03:18:34.856482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 03:18:34.856482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:34.856482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:34.856482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:34.856482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:34.856482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:34.856482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:34.856482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:34.856482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:34.856482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:34.856482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:34.856482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:34.856482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:34.856482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:34.856482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:34.856482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:34.856482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:34.857556 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 03:18:34.857556 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 03:18:34.857556 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 03:18:34.857556 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:18:34.857556 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 636/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:34.864438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e92eed-bf92-4e5b-b7f2-e46fe45f7e7f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:34.975312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e92eed-bf92-4e5b-b7f2-e46fe45f7e7f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:35.014419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351e217-88e8-4e40-8e89-2ad3a0cad0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:35.015067 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351e217-88e8-4e40-8e89-2ad3a0cad0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:35.015343 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351e217-88e8-4e40-8e89-2ad3a0cad0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:35.015611 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351e217-88e8-4e40-8e89-2ad3a0cad0b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:35.016331 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351e217-88e8-4e40-8e89-2ad3a0cad0b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:35.016664 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351e217-88e8-4e40-8e89-2ad3a0cad0b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:35.018063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351e217-88e8-4e40-8e89-2ad3a0cad0b2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:35.029462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 648/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Tue Jul 12 03:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:35.035363 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151b2cb-54e9-4b92-84b1-660670ee65e1 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:35.144282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151b2cb-54e9-4b92-84b1-660670ee65e1 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:35.158183 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:35.179812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b8cd1-fb99-456b-a112-4d01b5cef311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:35.180615 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b8cd1-fb99-456b-a112-4d01b5cef311 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:35.180894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b8cd1-fb99-456b-a112-4d01b5cef311 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:35.181151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b8cd1-fb99-456b-a112-4d01b5cef311 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:35.187816 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b8cd1-fb99-456b-a112-4d01b5cef311 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:35.189274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b8cd1-fb99-456b-a112-4d01b5cef311 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:35.202738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-388b8cd1-fb99-456b-a112-4d01b5cef311 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:18:35.202738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:35.202738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:35.202738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:35.202738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:35.202738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:35.202738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:35.202738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:35.202738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:35.202738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:35.202738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:35.202738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:35.202738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 03:18:35.202738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 03:18:35.202738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 03:18:35.203767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 03:18:35.203767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:35.203767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:35.203767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:35.203767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:35.203767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:35.203767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:35.203767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:35.203767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:35.203767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:35.203767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:35.203767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:35.203767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:35.203767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:35.203767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:35.203767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:35.203767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:35.204713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 03:18:35.204713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 03:18:35.204713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 03:18:35.204713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 03:18:35.204713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 03:18:35.204713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 03:18:35.204713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 03:18:35.204713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 12 03:18:35.204713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 637/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Tue Jul 12 03:18:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:35.209975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351e217-88e8-4e40-8e89-2ad3a0cad0b2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:35.260999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:35.316918 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351e217-88e8-4e40-8e89-2ad3a0cad0b2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:35.354764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe541d0-2428-4a13-90b7-e11eaa979ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:35.355458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe541d0-2428-4a13-90b7-e11eaa979ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:35.355733 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe541d0-2428-4a13-90b7-e11eaa979ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:35.356174 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe541d0-2428-4a13-90b7-e11eaa979ce0 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:35.356944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe541d0-2428-4a13-90b7-e11eaa979ce0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:35.357287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe541d0-2428-4a13-90b7-e11eaa979ce0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:35.358706 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe541d0-2428-4a13-90b7-e11eaa979ce0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:35.374333 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 649/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Tue Jul 12 03:18:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:35.381196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b8cd1-fb99-456b-a112-4d01b5cef311 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:35.487757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b8cd1-fb99-456b-a112-4d01b5cef311 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:35.522472 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626f036-2069-4e4a-9121-be33138aba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:35.523110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626f036-2069-4e4a-9121-be33138aba93 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:35.523387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626f036-2069-4e4a-9121-be33138aba93 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:35.523652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626f036-2069-4e4a-9121-be33138aba93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:35.524472 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626f036-2069-4e4a-9121-be33138aba93 None admin] RBAC: Adding query filter params (role.id=f557c8be1c0a46d49499d22d273b67c6, scope.project.id=afd5f89a049d40dc8456bd351f01f603, user.id=361ad35021eb43cca46d9b66e6f24ba6) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:35.524807 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626f036-2069-4e4a-9121-be33138aba93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:35.526244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626f036-2069-4e4a-9121-be33138aba93 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:35.532125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 638/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Tue Jul 12 03:18:35 2022] GET /identity/v3/role_assignments?user.id=361ad35021eb43cca46d9b66e6f24ba6&scope.project.id=afd5f89a049d40dc8456bd351f01f603&role.id=f557c8be1c0a46d49499d22d273b67c6 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:18:37.563271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be8a4a-4261-4649-b5d6-f7d5f5aee72b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:37.563881 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be8a4a-4261-4649-b5d6-f7d5f5aee72b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:37.563881 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be8a4a-4261-4649-b5d6-f7d5f5aee72b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:37.565225 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 650/1288] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:18:37.571575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5faa8-0ef0-4236-bc4c-beb2ec2e8592 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:37.572299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5faa8-0ef0-4236-bc4c-beb2ec2e8592 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:37.572508 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5faa8-0ef0-4236-bc4c-beb2ec2e8592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:37.594456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-17f5faa8-0ef0-4236-bc4c-beb2ec2e8592 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:18:37.595641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-17f5faa8-0ef0-4236-bc4c-beb2ec2e8592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:18:37.626617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:37.670012 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 639/1289] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:18:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:18:37.701375 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be8a4a-4261-4649-b5d6-f7d5f5aee72b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:37.805370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be8a4a-4261-4649-b5d6-f7d5f5aee72b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:37.816193 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:37.854710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7499de9-812d-4465-bed5-35d751bf56bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:37.855509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7499de9-812d-4465-bed5-35d751bf56bf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:37.855838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7499de9-812d-4465-bed5-35d751bf56bf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:37.856117 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7499de9-812d-4465-bed5-35d751bf56bf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:37.856826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7499de9-812d-4465-bed5-35d751bf56bf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:37.858208 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7499de9-812d-4465-bed5-35d751bf56bf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:37.871136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e7499de9-812d-4465-bed5-35d751bf56bf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 03:18:37.871136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:37.871136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:18:37.871136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:18:37.871136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:18:37.871136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:18:37.871136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:18:37.871136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:18:37.871136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 03:18:37.871136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:37.871136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:18:37.871136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:37.871136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:37.871136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:37.871136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:37.871136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:37.871136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:37.872340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:37.872340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:37.872340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:37.872340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:37.872340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:37.872340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:37.872340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:18:37.872340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:18:37.872340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:18:37.872340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:18:37.872340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:37.872340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:37.872340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:37.872340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:37.872340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:37.872340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:37.873303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:37.873303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:37.873303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:37.873303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:37.873303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:37.873303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:37.873303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:37.873303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:37.873303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:37.873303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:37.873303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:18:37.873303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:18:37.873303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 03:18:37.873303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:37.873303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 651/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 03:18:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:37.880361 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5faa8-0ef0-4236-bc4c-beb2ec2e8592 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:37.984116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5faa8-0ef0-4236-bc4c-beb2ec2e8592 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:38.019054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87a484-a7d0-48bc-a42c-e1d2f0bf4012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:38.019702 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87a484-a7d0-48bc-a42c-e1d2f0bf4012 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:38.019977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87a484-a7d0-48bc-a42c-e1d2f0bf4012 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:38.020245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87a484-a7d0-48bc-a42c-e1d2f0bf4012 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:38.020982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87a484-a7d0-48bc-a42c-e1d2f0bf4012 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:38.021289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87a484-a7d0-48bc-a42c-e1d2f0bf4012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:38.022730 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87a484-a7d0-48bc-a42c-e1d2f0bf4012 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:38.027640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 640/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Jul 12 03:18:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:18:38.033817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7499de9-812d-4465-bed5-35d751bf56bf None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:38.145418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7499de9-812d-4465-bed5-35d751bf56bf None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:38.184854 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741da665-77c0-4458-824e-1dc845bb6de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:38.185510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741da665-77c0-4458-824e-1dc845bb6de3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:38.185788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741da665-77c0-4458-824e-1dc845bb6de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:38.186057 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741da665-77c0-4458-824e-1dc845bb6de3 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:38.186774 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741da665-77c0-4458-824e-1dc845bb6de3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:38.187077 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741da665-77c0-4458-824e-1dc845bb6de3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:38.188470 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741da665-77c0-4458-824e-1dc845bb6de3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:38.193470 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 652/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Jul 12 03:18:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:40.214528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7feaf-d1c7-42ab-83c8-e7822afa90ff None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:40.215381 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7feaf-d1c7-42ab-83c8-e7822afa90ff None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:40.215381 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7feaf-d1c7-42ab-83c8-e7822afa90ff None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:40.217564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 641/1293] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:18:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:18:40.226438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81871550-9aca-41ce-8f15-08dc287d4d36 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:40.226870 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81871550-9aca-41ce-8f15-08dc287d4d36 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:40.227007 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81871550-9aca-41ce-8f15-08dc287d4d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:40.250149 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-81871550-9aca-41ce-8f15-08dc287d4d36 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:18:40.251372 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-81871550-9aca-41ce-8f15-08dc287d4d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:18:40.283377 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:40.323770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 653/1294] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:18:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:18:40.347559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7feaf-d1c7-42ab-83c8-e7822afa90ff None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:40.388102 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:40.468559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7feaf-d1c7-42ab-83c8-e7822afa90ff None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:40.503019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bee1b-2ce5-4abe-8e94-eb70d4ee1784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:40.503669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bee1b-2ce5-4abe-8e94-eb70d4ee1784 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:40.503944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bee1b-2ce5-4abe-8e94-eb70d4ee1784 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:40.504211 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bee1b-2ce5-4abe-8e94-eb70d4ee1784 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:40.504943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349bee1b-2ce5-4abe-8e94-eb70d4ee1784 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:40.506397 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349bee1b-2ce5-4abe-8e94-eb70d4ee1784 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:40.525707 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 642/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Tue Jul 12 03:18:40 2022] POST /identity/v3/services => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:18:42.518272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70a08d-5e44-4fd1-8942-d5195efcacd1 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:42.519147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70a08d-5e44-4fd1-8942-d5195efcacd1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:42.519147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70a08d-5e44-4fd1-8942-d5195efcacd1 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:42.521599 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 654/1296] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:18:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:18:42.526907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d84b1-971d-4dd3-8c26-f2e9d5cf383a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:42.527327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d84b1-971d-4dd3-8c26-f2e9d5cf383a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:42.527416 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d84b1-971d-4dd3-8c26-f2e9d5cf383a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:42.546664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-265d84b1-971d-4dd3-8c26-f2e9d5cf383a None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:18:42.547843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-265d84b1-971d-4dd3-8c26-f2e9d5cf383a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:18:42.624811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 643/1297] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:18:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:18:42.656252 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70a08d-5e44-4fd1-8942-d5195efcacd1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:42.767909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70a08d-5e44-4fd1-8942-d5195efcacd1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:42.803853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7341e-80ec-4680-908f-a532d1f9c5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:42.804651 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7341e-80ec-4680-908f-a532d1f9c5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:42.804928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7341e-80ec-4680-908f-a532d1f9c5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:42.805192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7341e-80ec-4680-908f-a532d1f9c5d6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:42.805841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7341e-80ec-4680-908f-a532d1f9c5d6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:42.807235 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7341e-80ec-4680-908f-a532d1f9c5d6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:42.819381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d2e7341e-80ec-4680-908f-a532d1f9c5d6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 03:18:42.819381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:42.819381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:18:42.819381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:18:42.819381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:18:42.819381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:18:42.819381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:18:42.819381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:18:42.819381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 03:18:42.819381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:42.819381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:18:42.819381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:42.819381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:42.819381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:42.819381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:42.819381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:42.819381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:42.820499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:42.820499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:42.820499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:42.820499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:42.820499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:42.820499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:42.820499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:18:42.820499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:18:42.820499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:18:42.820499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:18:42.820499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:42.820499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:42.820499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:42.820499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:42.820499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:42.820499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:42.821548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:42.821548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:42.821548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:42.821548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:42.821548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:42.821548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:42.821548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:42.821548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:42.821548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:42.821548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:42.821548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:18:42.821548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:18:42.821548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 03:18:42.821548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:42.821548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 655/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 03:18:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:42.828687 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d84b1-971d-4dd3-8c26-f2e9d5cf383a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:42.847984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:42.930650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d84b1-971d-4dd3-8c26-f2e9d5cf383a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:42.966680 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4c97c-7bd9-49be-b6b9-b94d046e0fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:42.967342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4c97c-7bd9-49be-b6b9-b94d046e0fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:42.967619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4c97c-7bd9-49be-b6b9-b94d046e0fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:42.967888 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4c97c-7bd9-49be-b6b9-b94d046e0fc9 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:42.968617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4c97c-7bd9-49be-b6b9-b94d046e0fc9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:42.968921 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4c97c-7bd9-49be-b6b9-b94d046e0fc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:42.970280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4c97c-7bd9-49be-b6b9-b94d046e0fc9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:42.978192 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 644/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Jul 12 03:18:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:18:42.984728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7341e-80ec-4680-908f-a532d1f9c5d6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:43.022129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:43.098894 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7341e-80ec-4680-908f-a532d1f9c5d6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:43.141530 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1082b-f91f-49a0-8aa7-13fbc33cb1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:43.142184 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1082b-f91f-49a0-8aa7-13fbc33cb1bd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:43.142467 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1082b-f91f-49a0-8aa7-13fbc33cb1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:43.142742 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1082b-f91f-49a0-8aa7-13fbc33cb1bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:43.143544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1082b-f91f-49a0-8aa7-13fbc33cb1bd None admin] RBAC: Adding query filter params (interface=public, service_id=8e7373eb75654f82868b276924e44e7a, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:43.143861 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1082b-f91f-49a0-8aa7-13fbc33cb1bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:43.145291 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1082b-f91f-49a0-8aa7-13fbc33cb1bd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:43.150638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 656/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Tue Jul 12 03:18:42 2022] GET /identity/v3/endpoints?service_id=8e7373eb75654f82868b276924e44e7a&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:43.159818 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4c97c-7bd9-49be-b6b9-b94d046e0fc9 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:43.249030 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:43.277609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4c97c-7bd9-49be-b6b9-b94d046e0fc9 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:43.313599 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d710b-9c87-40c2-9f7b-01f1286dbb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:43.314273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d710b-9c87-40c2-9f7b-01f1286dbb78 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:43.314551 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d710b-9c87-40c2-9f7b-01f1286dbb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:43.314831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d710b-9c87-40c2-9f7b-01f1286dbb78 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:43.315507 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d710b-9c87-40c2-9f7b-01f1286dbb78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:43.316944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d710b-9c87-40c2-9f7b-01f1286dbb78 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:43.328998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 645/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Tue Jul 12 03:18:43 2022] GET /identity/v3/services => generated 2191 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:18:45.322644 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76667f5-d2ef-4eba-a5b2-10d2827311ec None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:45.323208 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76667f5-d2ef-4eba-a5b2-10d2827311ec None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:45.323208 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76667f5-d2ef-4eba-a5b2-10d2827311ec None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:45.324572 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 657/1302] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:18:45.331291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d7683-9ff5-499b-9cde-8d6e5e0b00b8 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:45.332037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d7683-9ff5-499b-9cde-8d6e5e0b00b8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:45.332206 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d7683-9ff5-499b-9cde-8d6e5e0b00b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:45.357955 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-fd7d7683-9ff5-499b-9cde-8d6e5e0b00b8 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:18:45.359170 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fd7d7683-9ff5-499b-9cde-8d6e5e0b00b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:18:45.439593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 646/1303] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:18:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 03:18:45.464367 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76667f5-d2ef-4eba-a5b2-10d2827311ec None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:45.568401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:45.576935 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76667f5-d2ef-4eba-a5b2-10d2827311ec None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:45.612301 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405762e-ae52-4909-b4eb-da8518f3e64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:45.613112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405762e-ae52-4909-b4eb-da8518f3e64d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:45.613388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405762e-ae52-4909-b4eb-da8518f3e64d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:45.613657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405762e-ae52-4909-b4eb-da8518f3e64d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:45.614302 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405762e-ae52-4909-b4eb-da8518f3e64d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:45.615776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405762e-ae52-4909-b4eb-da8518f3e64d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:45.628321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4405762e-ae52-4909-b4eb-da8518f3e64d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 03:18:45.628321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:45.628321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 03:18:45.628321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 03:18:45.628321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 03:18:45.628321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 03:18:45.628321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 03:18:45.628321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:18:45.628321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 03:18:45.628321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:45.628321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 03:18:45.628321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:45.628321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 03:18:45.628321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 03:18:45.628321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 03:18:45.628321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 03:18:45.628321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 03:18:45.629359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 03:18:45.629359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 03:18:45.629359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 03:18:45.629359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 03:18:45.629359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 03:18:45.629359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 03:18:45.629359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 03:18:45.629359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 03:18:45.629359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 03:18:45.629359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 03:18:45.629359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 03:18:45.629359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 03:18:45.629359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 03:18:45.629359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 03:18:45.629359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 03:18:45.629359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 03:18:45.630394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 03:18:45.630394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 12 03:18:45.630394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 03:18:45.630394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 12 03:18:45.630394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 03:18:45.630394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 03:18:45.630394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 03:18:45.630394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 12 03:18:45.630394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 03:18:45.630394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 12 03:18:45.630394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 03:18:45.630394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 03:18:45.630394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 03:18:45.630394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 12 03:18:45.630394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 658/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Tue Jul 12 03:18:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 03:18:45.636670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d7683-9ff5-499b-9cde-8d6e5e0b00b8 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:45.746409 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:45.777498 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d7683-9ff5-499b-9cde-8d6e5e0b00b8 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:45.816796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e295c5-f2e1-4046-931f-426b7af64c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:45.817753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e295c5-f2e1-4046-931f-426b7af64c9c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:45.818092 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e295c5-f2e1-4046-931f-426b7af64c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:45.818587 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e295c5-f2e1-4046-931f-426b7af64c9c None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:45.819712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e295c5-f2e1-4046-931f-426b7af64c9c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:18:45.820056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e295c5-f2e1-4046-931f-426b7af64c9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:45.822186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e295c5-f2e1-4046-931f-426b7af64c9c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:45.831246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 647/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Tue Jul 12 03:18:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:18:45.838097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405762e-ae52-4909-b4eb-da8518f3e64d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:18:45.956008 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405762e-ae52-4909-b4eb-da8518f3e64d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:18:45.992469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d225c98-ad2e-40dd-bbfc-c2277d531adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:18:45.993154 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d225c98-ad2e-40dd-bbfc-c2277d531adb None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:18:45.993435 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d225c98-ad2e-40dd-bbfc-c2277d531adb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:18:45.993706 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d225c98-ad2e-40dd-bbfc-c2277d531adb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:18:45.994437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d225c98-ad2e-40dd-bbfc-c2277d531adb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:18:45.995817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d225c98-ad2e-40dd-bbfc-c2277d531adb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:18:46.018857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 659/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Tue Jul 12 03:18:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:18:55.825464 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=30 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:18:56.014212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:19:48.869119 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc651ba-3d3e-40b0-9bcf-19982602d2ff None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:19:48.869718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc651ba-3d3e-40b0-9bcf-19982602d2ff None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:19:48.869718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc651ba-3d3e-40b0-9bcf-19982602d2ff None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:19:48.876546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d48a0c-2128-4119-b8ce-4d338292be8f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:19:48.877019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d48a0c-2128-4119-b8ce-4d338292be8f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:19:48.877107 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d48a0c-2128-4119-b8ce-4d338292be8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:19:48.881186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 648/1307] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:19:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:19:48.962265 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b0d48a0c-2128-4119-b8ce-4d338292be8f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:19:48.963823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b0d48a0c-2128-4119-b8ce-4d338292be8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:19:49.141283 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 660/1308] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:19:49.179059 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4304e6-9dc7-4f67-8205-32cbdf6b1b23 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:19:49.179620 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4304e6-9dc7-4f67-8205-32cbdf6b1b23 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:19:49.179830 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4304e6-9dc7-4f67-8205-32cbdf6b1b23 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:19:49.182011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 649/1309] 10.222.0.26 () {54 vars in 964 bytes} [Tue Jul 12 03:19:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:19:49.188645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b345a8b-3a61-4c10-baf6-46621d93cda9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:19:49.188935 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b345a8b-3a61-4c10-baf6-46621d93cda9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:19:49.189215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b345a8b-3a61-4c10-baf6-46621d93cda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:19:49.303268 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0b345a8b-3a61-4c10-baf6-46621d93cda9 None None] MFA Rules not processed for user `c2908efc19944583810abceb4c5d8d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:19:49.304472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0b345a8b-3a61-4c10-baf6-46621d93cda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:19:49.327516 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:19:49.392731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 661/1310] 10.222.0.26 () {58 vars in 1061 bytes} [Tue Jul 12 03:19:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:19:49.400723 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4304e6-9dc7-4f67-8205-32cbdf6b1b23 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:19:49.402468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-dd4304e6-9dc7-4f67-8205-32cbdf6b1b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:19:49.548140 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4304e6-9dc7-4f67-8205-32cbdf6b1b23 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:19:49.637415 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96109d3d-31c0-499b-ba08-9062ce080eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:19:49.638291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96109d3d-31c0-499b-ba08-9062ce080eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:19:49.638636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96109d3d-31c0-499b-ba08-9062ce080eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:19:49.638969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96109d3d-31c0-499b-ba08-9062ce080eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:19:49.640699 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-96109d3d-31c0-499b-ba08-9062ce080eb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:19:49.717788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:19:49.783991 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96109d3d-31c0-499b-ba08-9062ce080eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:19:49.784782 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96109d3d-31c0-499b-ba08-9062ce080eb7 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:19:49.821863 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 650/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:19:52.223507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4694a-4b7c-4d93-8ca5-6f2b8efb33ae None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:19:52.224067 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4694a-4b7c-4d93-8ca5-6f2b8efb33ae None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:19:52.224067 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4694a-4b7c-4d93-8ca5-6f2b8efb33ae None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:19:52.225490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 662/1312] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:19:52.231067 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a275fc9-94b1-4956-825d-7f449872030f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:19:52.231562 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a275fc9-94b1-4956-825d-7f449872030f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:19:52.231656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a275fc9-94b1-4956-825d-7f449872030f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:19:52.312398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6a275fc9-94b1-4956-825d-7f449872030f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:19:52.313653 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6a275fc9-94b1-4956-825d-7f449872030f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:19:52.413103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 651/1313] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:19:52.450951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4694a-4b7c-4d93-8ca5-6f2b8efb33ae None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:19:52.452584 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3ab4694a-4b7c-4d93-8ca5-6f2b8efb33ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:19:52.564739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4694a-4b7c-4d93-8ca5-6f2b8efb33ae None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:19:52.643706 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:19:52.646687 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef86ef-4748-4638-a393-f67e9b3b5932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:19:52.647329 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef86ef-4748-4638-a393-f67e9b3b5932 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:19:52.647920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef86ef-4748-4638-a393-f67e9b3b5932 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:19:52.648178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef86ef-4748-4638-a393-f67e9b3b5932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:19:52.650416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-feef86ef-4748-4638-a393-f67e9b3b5932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:19:52.771493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef86ef-4748-4638-a393-f67e9b3b5932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:19:52.772983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef86ef-4748-4638-a393-f67e9b3b5932 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:19:52.791101 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 663/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:19:55.166845 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01943674-2445-4dbd-b15d-64c55aadcccd None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:19:55.167751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01943674-2445-4dbd-b15d-64c55aadcccd None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:19:55.167751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01943674-2445-4dbd-b15d-64c55aadcccd None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:19:55.170051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 652/1315] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:19:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:19:55.175485 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e16c-4142-4ce5-9465-6e61b9dadb93 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:19:55.175911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e16c-4142-4ce5-9465-6e61b9dadb93 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:19:55.176001 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e16c-4142-4ce5-9465-6e61b9dadb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:19:55.253000 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0716e16c-4142-4ce5-9465-6e61b9dadb93 None None] MFA Rules not processed for user `b1f6a3270f434dc79c93cb4804c35e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:19:55.254173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0716e16c-4142-4ce5-9465-6e61b9dadb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:19:55.312417 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:19:55.362954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 664/1316] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:19:55 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:19:55.427038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8c705-9718-4652-a187-0f66e635858b None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:19:55.427288 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8c705-9718-4652-a187-0f66e635858b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:19:55.427586 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8c705-9718-4652-a187-0f66e635858b None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:19:55.429021 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 653/1317] 10.222.0.26 () {54 vars in 964 bytes} [Tue Jul 12 03:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:19:55.434969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e33d3-6f57-4f66-bf89-dae95a15b415 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:19:55.435258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e33d3-6f57-4f66-bf89-dae95a15b415 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:19:55.435539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e33d3-6f57-4f66-bf89-dae95a15b415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:19:55.510488 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3f3e33d3-6f57-4f66-bf89-dae95a15b415 None None] MFA Rules not processed for user `c2908efc19944583810abceb4c5d8d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:19:55.511611 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3f3e33d3-6f57-4f66-bf89-dae95a15b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:19:55.593990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 665/1318] 10.222.0.26 () {58 vars in 1061 bytes} [Tue Jul 12 03:19:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:19:55.603778 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8c705-9718-4652-a187-0f66e635858b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:19:55.605349 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8dd8c705-9718-4652-a187-0f66e635858b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:19:55.615823 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:19:55.716557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8c705-9718-4652-a187-0f66e635858b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:19:55.798431 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c30e38-2026-40c2-abe6-2cd174cfc6b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:19:55.799444 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c30e38-2026-40c2-abe6-2cd174cfc6b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:19:55.799724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c30e38-2026-40c2-abe6-2cd174cfc6b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:19:55.799994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c30e38-2026-40c2-abe6-2cd174cfc6b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:19:55.801705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b8c30e38-2026-40c2-abe6-2cd174cfc6b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:19:55.880949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:19:55.939977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c30e38-2026-40c2-abe6-2cd174cfc6b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:19:55.941449 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c30e38-2026-40c2-abe6-2cd174cfc6b0 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:19:55.960754 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 654/1319] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:19:55 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:19:58.913384 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6aaf1-a64a-42d3-956b-4eb5f3341f0c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:19:58.914298 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6aaf1-a64a-42d3-956b-4eb5f3341f0c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:19:58.914298 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6aaf1-a64a-42d3-956b-4eb5f3341f0c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:19:58.916442 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 666/1320] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:19:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:19:58.925302 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3f662-ef06-46f8-b62d-1619d6a7e5e6 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:19:58.925987 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3f662-ef06-46f8-b62d-1619d6a7e5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:19:58.926131 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3f662-ef06-46f8-b62d-1619d6a7e5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:19:58.997650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-82a3f662-ef06-46f8-b62d-1619d6a7e5e6 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:19:58.998765 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-82a3f662-ef06-46f8-b62d-1619d6a7e5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:19:59.123500 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 655/1321] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:19:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:19:59.175532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6aaf1-a64a-42d3-956b-4eb5f3341f0c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:19:59.177960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c8d6aaf1-a64a-42d3-956b-4eb5f3341f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:19:59.244614 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:19:59.303012 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6aaf1-a64a-42d3-956b-4eb5f3341f0c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:19:59.383504 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e50ac2-789d-40f8-9838-d3c6f189507c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:19:59.384157 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e50ac2-789d-40f8-9838-d3c6f189507c service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:19:59.384429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e50ac2-789d-40f8-9838-d3c6f189507c service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:19:59.384724 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e50ac2-789d-40f8-9838-d3c6f189507c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:19:59.386367 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-70e50ac2-789d-40f8-9838-d3c6f189507c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:19:59.488428 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:19:59.502843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e50ac2-789d-40f8-9838-d3c6f189507c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:19:59.504360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e50ac2-789d-40f8-9838-d3c6f189507c service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:19:59.523048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 667/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:19:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:20:02.226279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7cbc6-9d39-4ec7-b349-f601ed324a5c None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:02.226870 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7cbc6-9d39-4ec7-b349-f601ed324a5c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:02.226870 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7cbc6-9d39-4ec7-b349-f601ed324a5c None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:02.228186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 656/1323] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:02.233605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf8ff1-fd69-4c0a-8778-c454c6d1023e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:02.234031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf8ff1-fd69-4c0a-8778-c454c6d1023e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:02.234151 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf8ff1-fd69-4c0a-8778-c454c6d1023e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:02.299674 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0aaf8ff1-fd69-4c0a-8778-c454c6d1023e None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:02.300895 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0aaf8ff1-fd69-4c0a-8778-c454c6d1023e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:02.401774 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 668/1324] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:02.437733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7cbc6-9d39-4ec7-b349-f601ed324a5c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:20:02.440216 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8be7cbc6-9d39-4ec7-b349-f601ed324a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:02.462820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:02.564700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7cbc6-9d39-4ec7-b349-f601ed324a5c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:20:02.644071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d8bcd-afef-447e-b84b-ac9c37773c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:20:02.644753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d8bcd-afef-447e-b84b-ac9c37773c85 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:02.645031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d8bcd-afef-447e-b84b-ac9c37773c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:02.645299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d8bcd-afef-447e-b84b-ac9c37773c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:02.646962 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f38d8bcd-afef-447e-b84b-ac9c37773c85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:02.722151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:02.761985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d8bcd-afef-447e-b84b-ac9c37773c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:20:02.763430 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d8bcd-afef-447e-b84b-ac9c37773c85 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:20:02.782712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 657/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:20:04.876628 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3624e6-a3cb-4be1-b710-37ea13824ab8 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:04.877284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3624e6-a3cb-4be1-b710-37ea13824ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:04.877284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3624e6-a3cb-4be1-b710-37ea13824ab8 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:04.878579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 669/1326] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:04.883926 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d778995-da62-4f8d-8f85-d7428952dd9b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:04.884393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d778995-da62-4f8d-8f85-d7428952dd9b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:04.884674 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d778995-da62-4f8d-8f85-d7428952dd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:04.953021 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3d778995-da62-4f8d-8f85-d7428952dd9b None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:04.954122 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3d778995-da62-4f8d-8f85-d7428952dd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:05.056312 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 658/1327] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:05.093691 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3624e6-a3cb-4be1-b710-37ea13824ab8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:20:05.095809 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6d3624e6-a3cb-4be1-b710-37ea13824ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:05.159827 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:05.204927 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3624e6-a3cb-4be1-b710-37ea13824ab8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:20:05.280583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13f019-5ce0-42c1-8e9a-6b650587777c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:20:05.281265 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13f019-5ce0-42c1-8e9a-6b650587777c service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:05.281542 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13f019-5ce0-42c1-8e9a-6b650587777c service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:05.281813 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13f019-5ce0-42c1-8e9a-6b650587777c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:05.283577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1e13f019-5ce0-42c1-8e9a-6b650587777c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:05.400183 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:05.402592 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13f019-5ce0-42c1-8e9a-6b650587777c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:20:05.404248 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13f019-5ce0-42c1-8e9a-6b650587777c service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:20:05.423295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 670/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:20:07.474303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ff6bc-c0c2-46d1-97d7-5d659547b71d None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:07.474885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ff6bc-c0c2-46d1-97d7-5d659547b71d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:07.474885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ff6bc-c0c2-46d1-97d7-5d659547b71d None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:07.476221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 659/1329] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:07.481555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95b410-f26b-4fbe-bc07-3377ae0a391f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:07.482040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95b410-f26b-4fbe-bc07-3377ae0a391f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:07.482121 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95b410-f26b-4fbe-bc07-3377ae0a391f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:07.547485 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-df95b410-f26b-4fbe-bc07-3377ae0a391f None None] MFA Rules not processed for user `b1f6a3270f434dc79c93cb4804c35e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:07.548960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-df95b410-f26b-4fbe-bc07-3377ae0a391f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:07.647797 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 671/1330] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:20:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:07.685603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ff6bc-c0c2-46d1-97d7-5d659547b71d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:20:07.687136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-343ff6bc-c0c2-46d1-97d7-5d659547b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:07.720646 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:07.790498 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ff6bc-c0c2-46d1-97d7-5d659547b71d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:20:07.869681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7b336-9173-4653-b2a1-2321022248ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:20:07.870251 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7b336-9173-4653-b2a1-2321022248ae service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:07.870493 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7b336-9173-4653-b2a1-2321022248ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:07.870759 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7b336-9173-4653-b2a1-2321022248ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:07.872380 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-31a7b336-9173-4653-b2a1-2321022248ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:07.957095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:07.990427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7b336-9173-4653-b2a1-2321022248ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:20:07.991874 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7b336-9173-4653-b2a1-2321022248ae service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:20:08.010975 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 660/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:20:07 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:20:10.298844 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d2311-6faa-4a7c-9d4c-4f8e9e8653b4 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:10.299444 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d2311-6faa-4a7c-9d4c-4f8e9e8653b4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:10.299444 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d2311-6faa-4a7c-9d4c-4f8e9e8653b4 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:10.300794 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 672/1332] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:10.307100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa7cb0-556e-4682-b465-bab12800db0f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:10.307865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa7cb0-556e-4682-b465-bab12800db0f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:10.308054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa7cb0-556e-4682-b465-bab12800db0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:10.387150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-b0aa7cb0-556e-4682-b465-bab12800db0f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:10.388379 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b0aa7cb0-556e-4682-b465-bab12800db0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:10.489765 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 661/1333] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:10.528461 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d2311-6faa-4a7c-9d4c-4f8e9e8653b4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:20:10.530030 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-908d2311-6faa-4a7c-9d4c-4f8e9e8653b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:10.605601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:10.646548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d2311-6faa-4a7c-9d4c-4f8e9e8653b4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:20:10.726719 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc07916-6358-419b-b1f1-475f97e7b916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:20:10.727362 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc07916-6358-419b-b1f1-475f97e7b916 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:10.727634 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc07916-6358-419b-b1f1-475f97e7b916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:10.727908 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc07916-6358-419b-b1f1-475f97e7b916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:10.729584 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-afc07916-6358-419b-b1f1-475f97e7b916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:10.847994 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc07916-6358-419b-b1f1-475f97e7b916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:20:10.849487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc07916-6358-419b-b1f1-475f97e7b916 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:20:10.862623 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:10.874218 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 673/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:20:12.963314 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a5874-63cf-4f95-a385-4605d7a8382c None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:12.964101 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a5874-63cf-4f95-a385-4605d7a8382c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:12.964101 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a5874-63cf-4f95-a385-4605d7a8382c None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:12.966334 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 662/1335] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:20:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:12.973657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60380bf3-cbd4-4c74-8ff9-2c3207eb7ebb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:12.974055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60380bf3-cbd4-4c74-8ff9-2c3207eb7ebb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:12.974232 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60380bf3-cbd4-4c74-8ff9-2c3207eb7ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:13.050828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-60380bf3-cbd4-4c74-8ff9-2c3207eb7ebb None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:13.052052 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-60380bf3-cbd4-4c74-8ff9-2c3207eb7ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:13.154415 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 674/1336] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:13.197712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a5874-63cf-4f95-a385-4605d7a8382c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:20:13.200071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-aa9a5874-63cf-4f95-a385-4605d7a8382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:13.251299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:13.328038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a5874-63cf-4f95-a385-4605d7a8382c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:20:13.408704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69690e-4014-4f25-8b87-c296625a0aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:20:13.409350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69690e-4014-4f25-8b87-c296625a0aef service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:13.409626 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69690e-4014-4f25-8b87-c296625a0aef service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:13.409926 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69690e-4014-4f25-8b87-c296625a0aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:13.411562 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0d69690e-4014-4f25-8b87-c296625a0aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:13.498852 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:13.526198 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69690e-4014-4f25-8b87-c296625a0aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:20:13.527576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69690e-4014-4f25-8b87-c296625a0aef service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:20:13.549486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 663/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:20:16.055712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14aa09-4e7e-4e0a-b585-172384e3b1bb None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:16.055712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14aa09-4e7e-4e0a-b585-172384e3b1bb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:16.055712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14aa09-4e7e-4e0a-b585-172384e3b1bb None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:16.055712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 675/1338] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:16.059702 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a192385-45f4-4561-bdfb-9b981cd60ce3 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:16.060152 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a192385-45f4-4561-bdfb-9b981cd60ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:16.060250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a192385-45f4-4561-bdfb-9b981cd60ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:16.136167 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6a192385-45f4-4561-bdfb-9b981cd60ce3 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:16.137427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6a192385-45f4-4561-bdfb-9b981cd60ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:16.243058 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 664/1339] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:20:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:20:16.281242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14aa09-4e7e-4e0a-b585-172384e3b1bb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:20:16.282824 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1b14aa09-4e7e-4e0a-b585-172384e3b1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:16.375332 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:16.405452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14aa09-4e7e-4e0a-b585-172384e3b1bb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:20:16.490284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8612442-cd00-4e30-a917-8ce531aeeab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:20:16.491187 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8612442-cd00-4e30-a917-8ce531aeeab2 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:16.491493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8612442-cd00-4e30-a917-8ce531aeeab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:16.491804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8612442-cd00-4e30-a917-8ce531aeeab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:16.494612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c8612442-cd00-4e30-a917-8ce531aeeab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:16.630836 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8612442-cd00-4e30-a917-8ce531aeeab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:20:16.632321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8612442-cd00-4e30-a917-8ce531aeeab2 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:20:16.651501 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 676/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:20:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:20:20.841374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894de32-c1bc-4641-94ad-d9487945baa4 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:20.841925 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894de32-c1bc-4641-94ad-d9487945baa4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:20.841925 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894de32-c1bc-4641-94ad-d9487945baa4 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:20.843303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 665/1341] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:20.848647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d25755-82b5-4a33-8cc2-7c9a8d81c4e1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:20.849040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d25755-82b5-4a33-8cc2-7c9a8d81c4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:20.849196 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d25755-82b5-4a33-8cc2-7c9a8d81c4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:20.853402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:20.913902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f2d25755-82b5-4a33-8cc2-7c9a8d81c4e1 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:20.915006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f2d25755-82b5-4a33-8cc2-7c9a8d81c4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:21.020555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 677/1342] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:21.057512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894de32-c1bc-4641-94ad-d9487945baa4 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:20:21.059034 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f894de32-c1bc-4641-94ad-d9487945baa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:21.109301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:21.171244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894de32-c1bc-4641-94ad-d9487945baa4 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:20:21.247226 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60746a75-a1bf-4279-8be9-1e103d17d8c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:20:21.247883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60746a75-a1bf-4279-8be9-1e103d17d8c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:21.248135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60746a75-a1bf-4279-8be9-1e103d17d8c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:21.248437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60746a75-a1bf-4279-8be9-1e103d17d8c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:21.250098 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-60746a75-a1bf-4279-8be9-1e103d17d8c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:21.351206 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:21.369304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60746a75-a1bf-4279-8be9-1e103d17d8c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:20:21.370767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60746a75-a1bf-4279-8be9-1e103d17d8c4 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:20:21.389694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 666/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:20:24.045290 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba74597-3037-441c-8836-f48cb7a03353 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:24.045824 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba74597-3037-441c-8836-f48cb7a03353 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:24.045824 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba74597-3037-441c-8836-f48cb7a03353 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:24.047087 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 678/1344] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:24.052574 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9cdbe-3661-4088-989e-cb69ac0b91eb None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:24.052997 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9cdbe-3661-4088-989e-cb69ac0b91eb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:24.053206 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9cdbe-3661-4088-989e-cb69ac0b91eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:24.130852 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-72a9cdbe-3661-4088-989e-cb69ac0b91eb None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:24.132183 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-72a9cdbe-3661-4088-989e-cb69ac0b91eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:24.240277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 667/1345] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:20:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:24.277963 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba74597-3037-441c-8836-f48cb7a03353 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:20:24.279501 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1ba74597-3037-441c-8836-f48cb7a03353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:24.369906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:24.389392 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba74597-3037-441c-8836-f48cb7a03353 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:20:24.463770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acc53a-043d-4764-aab5-030d4ed41bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:20:24.464415 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acc53a-043d-4764-aab5-030d4ed41bfa service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:24.464716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acc53a-043d-4764-aab5-030d4ed41bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:24.464987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acc53a-043d-4764-aab5-030d4ed41bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:24.466599 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-66acc53a-043d-4764-aab5-030d4ed41bfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:24.579070 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acc53a-043d-4764-aab5-030d4ed41bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:20:24.580550 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acc53a-043d-4764-aab5-030d4ed41bfa service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:20:24.600426 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 679/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:20:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:20:29.045451 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4538c-6ca9-46da-a0ff-20dea197fa5f None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:29.045941 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4538c-6ca9-46da-a0ff-20dea197fa5f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:29.046034 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4538c-6ca9-46da-a0ff-20dea197fa5f None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:29.047677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 668/1347] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:29.053312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9fbe6-d04f-48c6-bdeb-4d4783849913 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:29.053804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9fbe6-d04f-48c6-bdeb-4d4783849913 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:29.053911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9fbe6-d04f-48c6-bdeb-4d4783849913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:29.069783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:29.132356 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3ed9fbe6-d04f-48c6-bdeb-4d4783849913 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:29.133712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3ed9fbe6-d04f-48c6-bdeb-4d4783849913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:29.243572 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 680/1348] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:29.284064 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4538c-6ca9-46da-a0ff-20dea197fa5f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:20:29.285655 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0cb4538c-6ca9-46da-a0ff-20dea197fa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:29.348970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:29.399352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4538c-6ca9-46da-a0ff-20dea197fa5f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:20:29.477535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184f18b-a6c1-4bd7-bedb-1eca6bb5db25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:20:29.478187 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f18b-a6c1-4bd7-bedb-1eca6bb5db25 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:29.478458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f18b-a6c1-4bd7-bedb-1eca6bb5db25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:29.478720 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f18b-a6c1-4bd7-bedb-1eca6bb5db25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:29.480335 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d184f18b-a6c1-4bd7-bedb-1eca6bb5db25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:29.598450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:29.602340 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184f18b-a6c1-4bd7-bedb-1eca6bb5db25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:20:29.604061 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184f18b-a6c1-4bd7-bedb-1eca6bb5db25 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:20:29.623683 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 669/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:20:34.540750 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5018b9-82ce-4270-bff1-a04989b36c70 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:34.541284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5018b9-82ce-4270-bff1-a04989b36c70 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:34.541543 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5018b9-82ce-4270-bff1-a04989b36c70 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:34.543197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 681/1350] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 03:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:34.548612 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c776475-d242-4a89-aab1-d4a4add8f592 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:34.549037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c776475-d242-4a89-aab1-d4a4add8f592 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:34.549741 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c776475-d242-4a89-aab1-d4a4add8f592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:34.662210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6c776475-d242-4a89-aab1-d4a4add8f592 None None] MFA Rules not processed for user `361ad35021eb43cca46d9b66e6f24ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:34.664215 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6c776475-d242-4a89-aab1-d4a4add8f592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:34.804046 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 670/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 03:20:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:38.906224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74331a01-e445-4445-a06b-ad44e28021e5 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:38.906796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74331a01-e445-4445-a06b-ad44e28021e5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:38.906796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74331a01-e445-4445-a06b-ad44e28021e5 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:38.908366 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 682/1352] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 03:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:38.914075 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22452f4-a782-403f-8ee0-b20e20f50360 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:38.914878 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22452f4-a782-403f-8ee0-b20e20f50360 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:38.915127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22452f4-a782-403f-8ee0-b20e20f50360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:38.972500 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:38.996361 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c22452f4-a782-403f-8ee0-b20e20f50360 None None] MFA Rules not processed for user `361ad35021eb43cca46d9b66e6f24ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:38.997647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c22452f4-a782-403f-8ee0-b20e20f50360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:39.110864 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 671/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 03:20:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:39.241385 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=59 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:40.397445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e2968-5616-463e-9556-0bc1e367b38e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:40.398083 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e2968-5616-463e-9556-0bc1e367b38e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:40.398083 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e2968-5616-463e-9556-0bc1e367b38e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:40.399381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 683/1354] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 03:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:40.404595 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db5c72-3300-4ce7-890d-af3c2ef82020 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:40.405030 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db5c72-3300-4ce7-890d-af3c2ef82020 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:40.405281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db5c72-3300-4ce7-890d-af3c2ef82020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:40.481086 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e9db5c72-3300-4ce7-890d-af3c2ef82020 None None] MFA Rules not processed for user `361ad35021eb43cca46d9b66e6f24ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:40.482304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e9db5c72-3300-4ce7-890d-af3c2ef82020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:40.523433 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:40.589457 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 672/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 03:20:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:44.073666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54630acd-5b65-4d97-bc76-d849340bb302 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:44.074220 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54630acd-5b65-4d97-bc76-d849340bb302 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:44.074220 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54630acd-5b65-4d97-bc76-d849340bb302 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:44.075731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 684/1356] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:44.082782 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471f1e6-f15e-4d1f-bed8-d04037d3f9dd None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:44.083271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471f1e6-f15e-4d1f-bed8-d04037d3f9dd None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:44.083381 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471f1e6-f15e-4d1f-bed8-d04037d3f9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:44.158752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-d471f1e6-f15e-4d1f-bed8-d04037d3f9dd None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:44.160314 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d471f1e6-f15e-4d1f-bed8-d04037d3f9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:44.264659 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 673/1357] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:44.314837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0495f-18b7-4a1a-a005-e03fd159a516 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:44.315115 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0495f-18b7-4a1a-a005-e03fd159a516 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:44.315384 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0495f-18b7-4a1a-a005-e03fd159a516 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:44.317355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 685/1358] 10.222.0.26 () {54 vars in 961 bytes} [Tue Jul 12 03:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:44.326974 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209d921-476f-4bb0-90cb-d229765cf3ca None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:44.327616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209d921-476f-4bb0-90cb-d229765cf3ca None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:44.327993 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209d921-476f-4bb0-90cb-d229765cf3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:44.346547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:44.434903 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4209d921-476f-4bb0-90cb-d229765cf3ca None None] MFA Rules not processed for user `0c43d9d0a6264b19a843077a4669ce70`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:44.436153 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4209d921-476f-4bb0-90cb-d229765cf3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:44.562670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 674/1359] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Jul 12 03:20:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:44.570955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0495f-18b7-4a1a-a005-e03fd159a516 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:20:44.572493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-78b0495f-18b7-4a1a-a005-e03fd159a516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:44.747936 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0495f-18b7-4a1a-a005-e03fd159a516 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:20:44.833722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:44.877234 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e9171-3e7b-47eb-93c4-511ef88e2285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:20:44.877913 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e9171-3e7b-47eb-93c4-511ef88e2285 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:44.878153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e9171-3e7b-47eb-93c4-511ef88e2285 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:44.878459 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e9171-3e7b-47eb-93c4-511ef88e2285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:44.880086 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-708e9171-3e7b-47eb-93c4-511ef88e2285 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:44.976214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e9171-3e7b-47eb-93c4-511ef88e2285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:20:44.977844 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e9171-3e7b-47eb-93c4-511ef88e2285 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:20:44.996585 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 686/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:20:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:20:47.215779 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ddd99-0c39-4cbe-9656-2e3a3ac9e757 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:47.216334 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ddd99-0c39-4cbe-9656-2e3a3ac9e757 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:47.216640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ddd99-0c39-4cbe-9656-2e3a3ac9e757 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:47.218360 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 675/1361] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:20:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:47.224394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b89af-480a-468c-9804-75852b35cb2a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:47.224989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b89af-480a-468c-9804-75852b35cb2a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:47.225079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b89af-480a-468c-9804-75852b35cb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:47.294614 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f36b89af-480a-468c-9804-75852b35cb2a None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:47.295772 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f36b89af-480a-468c-9804-75852b35cb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:47.338554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:47.416563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 687/1362] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:47.456755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ddd99-0c39-4cbe-9656-2e3a3ac9e757 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:20:47.458954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-467ddd99-0c39-4cbe-9656-2e3a3ac9e757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:47.537652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:47.627237 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ddd99-0c39-4cbe-9656-2e3a3ac9e757 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:20:47.750890 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01630ce-d53a-48c5-8961-ad2ecd47e4f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:20:47.751543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01630ce-d53a-48c5-8961-ad2ecd47e4f3 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:47.751822 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01630ce-d53a-48c5-8961-ad2ecd47e4f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:47.752096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01630ce-d53a-48c5-8961-ad2ecd47e4f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:47.754362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c01630ce-d53a-48c5-8961-ad2ecd47e4f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:47.785584 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:47.851161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01630ce-d53a-48c5-8961-ad2ecd47e4f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:20:47.852977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01630ce-d53a-48c5-8961-ad2ecd47e4f3 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:20:47.872207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 676/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:20:50.229918 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d2984-398b-40d1-b960-aba8a0772377 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:50.230473 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d2984-398b-40d1-b960-aba8a0772377 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:50.230473 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d2984-398b-40d1-b960-aba8a0772377 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:50.231779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 688/1364] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:50.237093 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d76b8-511b-4992-a529-1e63aabd1cfd None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:50.237617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d76b8-511b-4992-a529-1e63aabd1cfd None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:50.237757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d76b8-511b-4992-a529-1e63aabd1cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:50.323563 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-b54d76b8-511b-4992-a529-1e63aabd1cfd None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:50.324846 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b54d76b8-511b-4992-a529-1e63aabd1cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:50.430952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:50.440565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 677/1365] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:20:50.482992 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07f2db-b4a1-4c0f-ba40-ed77bc3b89a8 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:50.483279 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07f2db-b4a1-4c0f-ba40-ed77bc3b89a8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:50.483792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07f2db-b4a1-4c0f-ba40-ed77bc3b89a8 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:50.485330 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 689/1366] 10.222.0.26 () {54 vars in 961 bytes} [Tue Jul 12 03:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:50.491544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f1ae0-d042-4119-9d12-18034be7131e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:50.492052 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f1ae0-d042-4119-9d12-18034be7131e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:50.492299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f1ae0-d042-4119-9d12-18034be7131e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:50.571426 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6b8f1ae0-d042-4119-9d12-18034be7131e None None] MFA Rules not processed for user `0c43d9d0a6264b19a843077a4669ce70`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:50.572647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6b8f1ae0-d042-4119-9d12-18034be7131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:50.710853 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 678/1367] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Jul 12 03:20:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:50.719142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07f2db-b4a1-4c0f-ba40-ed77bc3b89a8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:20:50.720962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9a07f2db-b4a1-4c0f-ba40-ed77bc3b89a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:50.887303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07f2db-b4a1-4c0f-ba40-ed77bc3b89a8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:20:50.908824 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:51.008707 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa9508-78a9-4024-8e4b-aec70f9418e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:20:51.009420 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa9508-78a9-4024-8e4b-aec70f9418e6 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:51.009799 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa9508-78a9-4024-8e4b-aec70f9418e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:51.010176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa9508-78a9-4024-8e4b-aec70f9418e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:51.011902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6caa9508-78a9-4024-8e4b-aec70f9418e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:51.106952 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa9508-78a9-4024-8e4b-aec70f9418e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:20:51.108799 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa9508-78a9-4024-8e4b-aec70f9418e6 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:20:51.128614 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 690/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:20:52.235695 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12352673-66c3-477f-a79a-2506f292d5ee None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:52.236326 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12352673-66c3-477f-a79a-2506f292d5ee None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:52.236326 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12352673-66c3-477f-a79a-2506f292d5ee None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:52.237940 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 679/1369] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:52.243041 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669a2b9-8ca0-485b-8199-a5c88cafdf8f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:52.243484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669a2b9-8ca0-485b-8199-a5c88cafdf8f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:52.243607 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669a2b9-8ca0-485b-8199-a5c88cafdf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:52.275056 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:52.315504 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6669a2b9-8ca0-485b-8199-a5c88cafdf8f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:52.316779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6669a2b9-8ca0-485b-8199-a5c88cafdf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:52.421752 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 691/1370] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:52.772386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde050e-c41a-410c-a78d-653a135c168f None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:52.772704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde050e-c41a-410c-a78d-653a135c168f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:52.772880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde050e-c41a-410c-a78d-653a135c168f None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:52.778224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 680/1371] 10.222.0.26 () {54 vars in 963 bytes} [Tue Jul 12 03:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:52.781008 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af40413-162b-48a5-960e-4ff355724443 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:52.781498 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af40413-162b-48a5-960e-4ff355724443 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:52.781892 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af40413-162b-48a5-960e-4ff355724443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:52.864755 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8af40413-162b-48a5-960e-4ff355724443 None None] MFA Rules not processed for user `99605c4dd01f48e39a3e29a74114506d`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:52.866214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8af40413-162b-48a5-960e-4ff355724443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:52.916964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:52.949866 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 692/1372] 10.222.0.26 () {58 vars in 1060 bytes} [Tue Jul 12 03:20:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:52.957682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde050e-c41a-410c-a78d-653a135c168f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:20:52.959341 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fcde050e-c41a-410c-a78d-653a135c168f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:53.015056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:53.073756 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde050e-c41a-410c-a78d-653a135c168f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:20:53.153979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652203d-83ef-4d46-ae49-ba3a5b1f63be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:20:53.154809 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652203d-83ef-4d46-ae49-ba3a5b1f63be service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:53.155170 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652203d-83ef-4d46-ae49-ba3a5b1f63be service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:53.155540 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652203d-83ef-4d46-ae49-ba3a5b1f63be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:53.157292 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5652203d-83ef-4d46-ae49-ba3a5b1f63be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:53.235382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b58c1-57a8-4126-84f5-e4d3dc77f736 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:53.235731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b58c1-57a8-4126-84f5-e4d3dc77f736 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:53.235951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b58c1-57a8-4126-84f5-e4d3dc77f736 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:53.237789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 693/1373] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:20:53.242829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aab2c9-5240-4658-b3c4-fb8f82fd36fb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:53.243216 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aab2c9-5240-4658-b3c4-fb8f82fd36fb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:53.243773 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aab2c9-5240-4658-b3c4-fb8f82fd36fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:53.266922 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:53.283432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652203d-83ef-4d46-ae49-ba3a5b1f63be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:20:53.285710 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652203d-83ef-4d46-ae49-ba3a5b1f63be service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:20:53.306906 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 681/1374] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:20:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:20:53.321577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-07aab2c9-5240-4658-b3c4-fb8f82fd36fb None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:53.322830 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-07aab2c9-5240-4658-b3c4-fb8f82fd36fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:53.441327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 694/1375] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:53.482088 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652203d-83ef-4d46-ae49-ba3a5b1f63be service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:20:53.484083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5652203d-83ef-4d46-ae49-ba3a5b1f63be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:53.621709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652203d-83ef-4d46-ae49-ba3a5b1f63be service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:20:53.742982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:53.755859 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acfeb0-14df-44ec-b335-41c969de9dca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:20:53.756526 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acfeb0-14df-44ec-b335-41c969de9dca service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:53.756824 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acfeb0-14df-44ec-b335-41c969de9dca service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:53.757101 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acfeb0-14df-44ec-b335-41c969de9dca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:53.758770 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-92acfeb0-14df-44ec-b335-41c969de9dca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:53.852708 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acfeb0-14df-44ec-b335-41c969de9dca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:20:53.854324 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acfeb0-14df-44ec-b335-41c969de9dca service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:20:53.873301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 682/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:20:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:20:55.970588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316d956-7937-48ee-ba32-37094dfc9038 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:55.971130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316d956-7937-48ee-ba32-37094dfc9038 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:55.971130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316d956-7937-48ee-ba32-37094dfc9038 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:55.972471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 695/1377] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:55.977861 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d48dd-bcb3-44b0-b457-2c43b14a8afe None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:55.978311 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d48dd-bcb3-44b0-b457-2c43b14a8afe None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:55.978535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d48dd-bcb3-44b0-b457-2c43b14a8afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:56.047171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-074d48dd-bcb3-44b0-b457-2c43b14a8afe None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:56.048381 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-074d48dd-bcb3-44b0-b457-2c43b14a8afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:56.110458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:56.149925 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 683/1378] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:56.195239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316d956-7937-48ee-ba32-37094dfc9038 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:20:56.197203 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4316d956-7937-48ee-ba32-37094dfc9038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:56.268648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:56.366027 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316d956-7937-48ee-ba32-37094dfc9038 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:20:56.480891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5c4f8-b1cc-4cf2-9f21-f3ced991ab00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:20:56.481540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5c4f8-b1cc-4cf2-9f21-f3ced991ab00 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:56.481811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5c4f8-b1cc-4cf2-9f21-f3ced991ab00 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:56.482082 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5c4f8-b1cc-4cf2-9f21-f3ced991ab00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:56.483700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-63c5c4f8-b1cc-4cf2-9f21-f3ced991ab00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:56.508002 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:56.595039 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5c4f8-b1cc-4cf2-9f21-f3ced991ab00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:20:56.596795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5c4f8-b1cc-4cf2-9f21-f3ced991ab00 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:20:56.627113 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 696/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:20:58.710830 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dcdf3-9451-4c89-bf21-8fa1b67cda6a None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:58.711285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dcdf3-9451-4c89-bf21-8fa1b67cda6a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:58.711391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dcdf3-9451-4c89-bf21-8fa1b67cda6a None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:58.713192 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 684/1380] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:20:58.718498 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1df51d-ab56-45e7-9095-7fc586287c51 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:58.718940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1df51d-ab56-45e7-9095-7fc586287c51 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:58.719021 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1df51d-ab56-45e7-9095-7fc586287c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:58.797206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-eb1df51d-ab56-45e7-9095-7fc586287c51 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:20:58.798571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-eb1df51d-ab56-45e7-9095-7fc586287c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:58.892259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:58.906067 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 697/1381] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:20:58.951490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dcdf3-9451-4c89-bf21-8fa1b67cda6a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:20:58.952983 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bb0dcdf3-9451-4c89-bf21-8fa1b67cda6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:59.110695 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dcdf3-9451-4c89-bf21-8fa1b67cda6a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:20:59.161486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:20:59.230448 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d592e67-e005-4ef9-9be6-e4735edfaeb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:20:59.231081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d592e67-e005-4ef9-9be6-e4735edfaeb3 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:20:59.231372 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d592e67-e005-4ef9-9be6-e4735edfaeb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:20:59.231634 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d592e67-e005-4ef9-9be6-e4735edfaeb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:20:59.233281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7d592e67-e005-4ef9-9be6-e4735edfaeb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:20:59.328667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d592e67-e005-4ef9-9be6-e4735edfaeb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:20:59.330396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d592e67-e005-4ef9-9be6-e4735edfaeb3 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:20:59.349771 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 685/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:01.463405 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f36ded-c85a-44da-972d-a810def06446 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:01.464434 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f36ded-c85a-44da-972d-a810def06446 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:01.464775 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f36ded-c85a-44da-972d-a810def06446 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:01.466346 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 698/1383] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:21:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:01.472383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66762e6c-0691-410d-b991-cea9b430a8c5 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:01.472899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66762e6c-0691-410d-b991-cea9b430a8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:01.473035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66762e6c-0691-410d-b991-cea9b430a8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:01.551580 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-66762e6c-0691-410d-b991-cea9b430a8c5 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:01.552857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-66762e6c-0691-410d-b991-cea9b430a8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:01.554959 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:01.664396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 686/1384] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:21:01.710720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f36ded-c85a-44da-972d-a810def06446 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:01.712783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-82f36ded-c85a-44da-972d-a810def06446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:01.885428 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f36ded-c85a-44da-972d-a810def06446 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:01.966250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:02.023789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3537dd1-cca1-4ae4-86ab-54bc0d67d23f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:02.024484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3537dd1-cca1-4ae4-86ab-54bc0d67d23f service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:02.024854 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3537dd1-cca1-4ae4-86ab-54bc0d67d23f service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:02.025083 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3537dd1-cca1-4ae4-86ab-54bc0d67d23f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:02.026795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d3537dd1-cca1-4ae4-86ab-54bc0d67d23f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:02.121719 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3537dd1-cca1-4ae4-86ab-54bc0d67d23f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:02.123432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3537dd1-cca1-4ae4-86ab-54bc0d67d23f service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:02.142228 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 699/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:04.305479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e670d57-1b70-44d8-bb79-c5f0c1e845f5 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:04.306033 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e670d57-1b70-44d8-bb79-c5f0c1e845f5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:04.306129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e670d57-1b70-44d8-bb79-c5f0c1e845f5 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:04.308005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 687/1386] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:21:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:04.314099 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f815b-aa72-43fa-ab0a-e181c1458cfb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:04.314617 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f815b-aa72-43fa-ab0a-e181c1458cfb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:04.314725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f815b-aa72-43fa-ab0a-e181c1458cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:04.395974 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-901f815b-aa72-43fa-ab0a-e181c1458cfb None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:04.397390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-901f815b-aa72-43fa-ab0a-e181c1458cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:04.425024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:04.503660 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 700/1387] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:04.549635 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e670d57-1b70-44d8-bb79-c5f0c1e845f5 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:04.551608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4e670d57-1b70-44d8-bb79-c5f0c1e845f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:04.698338 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:04.720169 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e670d57-1b70-44d8-bb79-c5f0c1e845f5 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:04.845238 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcbdfa-1ca6-4c36-a869-3a01a4bc6cd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:04.845917 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcbdfa-1ca6-4c36-a869-3a01a4bc6cd1 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:04.846207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcbdfa-1ca6-4c36-a869-3a01a4bc6cd1 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:04.846488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcbdfa-1ca6-4c36-a869-3a01a4bc6cd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:04.848249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6afcbdfa-1ca6-4c36-a869-3a01a4bc6cd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:04.949358 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcbdfa-1ca6-4c36-a869-3a01a4bc6cd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:04.950852 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcbdfa-1ca6-4c36-a869-3a01a4bc6cd1 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:04.955893 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:04.974348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 688/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:21:07.118068 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb622-4f04-4432-ba97-6f6d96fe1643 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:07.118677 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb622-4f04-4432-ba97-6f6d96fe1643 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:07.118677 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb622-4f04-4432-ba97-6f6d96fe1643 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:07.120112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 701/1389] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:07.125697 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faa9c2-364d-470c-bd4c-2fe50e5b4134 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:07.126111 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faa9c2-364d-470c-bd4c-2fe50e5b4134 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:07.126271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faa9c2-364d-470c-bd4c-2fe50e5b4134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:07.195159 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-57faa9c2-364d-470c-bd4c-2fe50e5b4134 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:07.196383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-57faa9c2-364d-470c-bd4c-2fe50e5b4134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:07.295781 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 689/1390] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:07.342832 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eb622-4f04-4432-ba97-6f6d96fe1643 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:07.345711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-186eb622-4f04-4432-ba97-6f6d96fe1643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:07.499540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eb622-4f04-4432-ba97-6f6d96fe1643 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:07.509337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:07.619441 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58622c-cd8c-46a5-8f2c-4f9e2ad71315 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:07.620149 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58622c-cd8c-46a5-8f2c-4f9e2ad71315 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:07.620421 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58622c-cd8c-46a5-8f2c-4f9e2ad71315 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:07.620705 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58622c-cd8c-46a5-8f2c-4f9e2ad71315 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:07.622352 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1b58622c-cd8c-46a5-8f2c-4f9e2ad71315 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:07.720598 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58622c-cd8c-46a5-8f2c-4f9e2ad71315 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:07.722237 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58622c-cd8c-46a5-8f2c-4f9e2ad71315 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:07.741236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 702/1391] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:08.319508 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ac04b-8f3c-4b41-b0ad-d67a1d841ae5 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:08.320082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ac04b-8f3c-4b41-b0ad-d67a1d841ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:08.320082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ac04b-8f3c-4b41-b0ad-d67a1d841ae5 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:08.321519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 690/1392] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:08.326841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b39e9a-6f47-43fc-a3da-14a1772781b8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:08.327329 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b39e9a-6f47-43fc-a3da-14a1772781b8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:08.327430 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b39e9a-6f47-43fc-a3da-14a1772781b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:08.342417 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:08.396905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f1b39e9a-6f47-43fc-a3da-14a1772781b8 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:08.398099 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f1b39e9a-6f47-43fc-a3da-14a1772781b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:08.495800 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 703/1393] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:08.551870 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1ed7f-8641-44ae-9f1f-20563d24000c None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:08.552238 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1ed7f-8641-44ae-9f1f-20563d24000c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:08.552607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1ed7f-8641-44ae-9f1f-20563d24000c None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:08.554063 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 691/1394] 10.222.0.26 () {54 vars in 962 bytes} [Tue Jul 12 03:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:08.559082 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82a977-591d-4097-b2e9-7eff30a5144d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:08.559493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82a977-591d-4097-b2e9-7eff30a5144d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:08.559834 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82a977-591d-4097-b2e9-7eff30a5144d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:08.637478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2d82a977-591d-4097-b2e9-7eff30a5144d None None] MFA Rules not processed for user `97fe9d04ccb445208f3783a8b55cd31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:08.638592 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2d82a977-591d-4097-b2e9-7eff30a5144d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:08.673011 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:08.721970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 704/1395] 10.222.0.26 () {58 vars in 1059 bytes} [Tue Jul 12 03:21:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:08.730166 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1ed7f-8641-44ae-9f1f-20563d24000c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:08.731686 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d0f1ed7f-8641-44ae-9f1f-20563d24000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:08.806572 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:08.840493 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1ed7f-8641-44ae-9f1f-20563d24000c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:08.920487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fca0e-f883-48b2-89eb-e87aece1861a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97fe9d04ccb445208f3783a8b55cd31e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:08.921086 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fca0e-f883-48b2-89eb-e87aece1861a service glance] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:08.921364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fca0e-f883-48b2-89eb-e87aece1861a service glance] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:08.921624 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fca0e-f883-48b2-89eb-e87aece1861a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:08.923555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-219fca0e-f883-48b2-89eb-e87aece1861a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:09.035303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fca0e-f883-48b2-89eb-e87aece1861a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:09.036795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fca0e-f883-48b2-89eb-e87aece1861a service glance] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:09.053239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:09.056559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 692/1396] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:09.811547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d18c1-6014-4951-adaf-c2b299b350b0 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:09.812011 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d18c1-6014-4951-adaf-c2b299b350b0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:09.812103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d18c1-6014-4951-adaf-c2b299b350b0 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:09.813841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 705/1397] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:09.819609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c558e-310a-477a-bce2-15942537f710 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:09.820039 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c558e-310a-477a-bce2-15942537f710 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:09.820190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c558e-310a-477a-bce2-15942537f710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:09.822743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6221c7e-da21-4c32-89f8-99a3ce826115 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:09.823104 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6221c7e-da21-4c32-89f8-99a3ce826115 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:09.823411 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6221c7e-da21-4c32-89f8-99a3ce826115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:09.886166 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-482c558e-310a-477a-bce2-15942537f710 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:09.887389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-482c558e-310a-477a-bce2-15942537f710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:09.893660 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f6221c7e-da21-4c32-89f8-99a3ce826115 None None] MFA Rules not processed for user `e23aea853cce44698b19d6bc087093c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:09.894882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f6221c7e-da21-4c32-89f8-99a3ce826115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:09.982397 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 706/1398] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 03:21:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:21:09.987482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 693/1399] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:10.028047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a33c7-da74-4d12-a2df-1de5350752dc None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:10.028335 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a33c7-da74-4d12-a2df-1de5350752dc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:10.028806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a33c7-da74-4d12-a2df-1de5350752dc None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:10.030342 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 707/1400] 10.222.0.26 () {54 vars in 942 bytes} [Tue Jul 12 03:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:10.031520 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c558e-310a-477a-bce2-15942537f710 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:10.032807 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-482c558e-310a-477a-bce2-15942537f710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:10.036473 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd31a1-7882-4a9f-9b2f-6a4a4bb8f377 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:10.036790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd31a1-7882-4a9f-9b2f-6a4a4bb8f377 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:10.037065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd31a1-7882-4a9f-9b2f-6a4a4bb8f377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:10.095763 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:10.109987 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:10.127232 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-badd31a1-7882-4a9f-9b2f-6a4a4bb8f377 None None] MFA Rules not processed for user `ffc4cbd87dd249868cfb704535774126`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:10.128452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-badd31a1-7882-4a9f-9b2f-6a4a4bb8f377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:10.151578 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c558e-310a-477a-bce2-15942537f710 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:10.237316 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 708/1401] 10.222.0.26 () {58 vars in 1039 bytes} [Tue Jul 12 03:21:10 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:10.246985 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd31a1-7882-4a9f-9b2f-6a4a4bb8f377 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:10.258487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd31a1-7882-4a9f-9b2f-6a4a4bb8f377 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:10.267953 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603ce3f-04a9-4d77-a6a9-2cea164f8e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:10.268685 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603ce3f-04a9-4d77-a6a9-2cea164f8e71 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:10.268965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603ce3f-04a9-4d77-a6a9-2cea164f8e71 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:10.269235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603ce3f-04a9-4d77-a6a9-2cea164f8e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:10.271119 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1603ce3f-04a9-4d77-a6a9-2cea164f8e71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:10.347295 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:10.359969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:10.363985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603ce3f-04a9-4d77-a6a9-2cea164f8e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:10.365684 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603ce3f-04a9-4d77-a6a9-2cea164f8e71 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:10.366338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c298e62-37bb-44fc-bf53-c295e416cc02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc4cbd87dd249868cfb704535774126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:10.367127 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c298e62-37bb-44fc-bf53-c295e416cc02 service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:10.367424 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c298e62-37bb-44fc-bf53-c295e416cc02 service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:10.367703 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c298e62-37bb-44fc-bf53-c295e416cc02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:10.369487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4c298e62-37bb-44fc-bf53-c295e416cc02 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:10.384457 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 694/1402] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:10.455700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c298e62-37bb-44fc-bf53-c295e416cc02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:10.457691 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c298e62-37bb-44fc-bf53-c295e416cc02 service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:10.467475 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 709/1403] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 03:21:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 03:21:12.452898 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f016205-0649-4bd9-86e6-ab970e149598 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:12.453879 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f016205-0649-4bd9-86e6-ab970e149598 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:12.454153 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f016205-0649-4bd9-86e6-ab970e149598 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:12.455543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 695/1404] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:12.460926 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8e92d-79d7-4540-97eb-38a2b95c288f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:12.461345 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8e92d-79d7-4540-97eb-38a2b95c288f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:12.461345 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8e92d-79d7-4540-97eb-38a2b95c288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:12.527425 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e6c8e92d-79d7-4540-97eb-38a2b95c288f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:12.528684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e6c8e92d-79d7-4540-97eb-38a2b95c288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:12.616655 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:12.636724 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 710/1405] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:12.681018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f016205-0649-4bd9-86e6-ab970e149598 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:12.682545 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6f016205-0649-4bd9-86e6-ab970e149598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:12.868422 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f016205-0649-4bd9-86e6-ab970e149598 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:12.932611 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:13.004720 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e9cee-a222-4ea9-b800-b27a21b86851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:13.005463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e9cee-a222-4ea9-b800-b27a21b86851 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:13.005894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e9cee-a222-4ea9-b800-b27a21b86851 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:13.006179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e9cee-a222-4ea9-b800-b27a21b86851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:13.007834 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f12e9cee-a222-4ea9-b800-b27a21b86851 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:13.113850 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e9cee-a222-4ea9-b800-b27a21b86851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:13.115433 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e9cee-a222-4ea9-b800-b27a21b86851 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:13.134848 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 696/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:15.251473 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee43280-f2b3-475f-9305-5658c2b983b4 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:15.252161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee43280-f2b3-475f-9305-5658c2b983b4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:15.252464 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee43280-f2b3-475f-9305-5658c2b983b4 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:15.254534 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 711/1407] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:21:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:15.260322 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9961b1-1cf3-4635-90bc-92a114ee5943 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:15.260843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9961b1-1cf3-4635-90bc-92a114ee5943 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:15.260936 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9961b1-1cf3-4635-90bc-92a114ee5943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:15.341544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-1a9961b1-1cf3-4635-90bc-92a114ee5943 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:15.342815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1a9961b1-1cf3-4635-90bc-92a114ee5943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:15.352810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:15.471604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 697/1408] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:15.520873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee43280-f2b3-475f-9305-5658c2b983b4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:15.523823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2ee43280-f2b3-475f-9305-5658c2b983b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:15.726164 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee43280-f2b3-475f-9305-5658c2b983b4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:15.812381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:15.879109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bdce0-6ece-4862-a23d-a532778c89ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:15.879109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bdce0-6ece-4862-a23d-a532778c89ec service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:15.879109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bdce0-6ece-4862-a23d-a532778c89ec service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:15.879109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bdce0-6ece-4862-a23d-a532778c89ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:15.882240 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-566bdce0-6ece-4862-a23d-a532778c89ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:16.026712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bdce0-6ece-4862-a23d-a532778c89ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:16.028462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bdce0-6ece-4862-a23d-a532778c89ec service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:16.050540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 712/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:25.471178 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=39 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:26.047542 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=67 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:32.714187 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b2b6-5005-4de6-9ef6-27b938fda915 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:32.714673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b2b6-5005-4de6-9ef6-27b938fda915 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:32.714673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b2b6-5005-4de6-9ef6-27b938fda915 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:32.716684 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 698/1410] 10.222.0.26 () {54 vars in 918 bytes} [Tue Jul 12 03:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:32.721803 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730adf5-4ec2-4b24-9213-d455351be743 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:32.722283 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730adf5-4ec2-4b24-9213-d455351be743 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:32.722375 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730adf5-4ec2-4b24-9213-d455351be743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:32.805611 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2730adf5-4ec2-4b24-9213-d455351be743 None None] MFA Rules not processed for user `361ad35021eb43cca46d9b66e6f24ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:32.806891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2730adf5-4ec2-4b24-9213-d455351be743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:32.930197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 713/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Jul 12 03:21:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:32.944743 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81442725-e34c-4020-a505-b12c0206343c None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:32.945023 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81442725-e34c-4020-a505-b12c0206343c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:32.945317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81442725-e34c-4020-a505-b12c0206343c None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:32.946685 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 699/1412] 10.222.0.26 () {54 vars in 918 bytes} [Tue Jul 12 03:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:32.951451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533f402-e88c-48d4-a1b0-551aba4cd7c0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:32.951710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533f402-e88c-48d4-a1b0-551aba4cd7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:32.951986 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533f402-e88c-48d4-a1b0-551aba4cd7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:33.028750 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:33.032096 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8533f402-e88c-48d4-a1b0-551aba4cd7c0 None None] MFA Rules not processed for user `0c43d9d0a6264b19a843077a4669ce70`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:33.034148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8533f402-e88c-48d4-a1b0-551aba4cd7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:33.162161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 714/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Jul 12 03:21:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:35.653706 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318d2b8-6acb-4011-915f-12a04f01a362 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:35.654296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318d2b8-6acb-4011-915f-12a04f01a362 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:35.654296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318d2b8-6acb-4011-915f-12a04f01a362 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:35.656430 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 700/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 03:21:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:35.664480 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa36fd6-5a0c-4578-855f-30b59c04473a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:35.664904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa36fd6-5a0c-4578-855f-30b59c04473a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:35.665059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa36fd6-5a0c-4578-855f-30b59c04473a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:35.734378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6fa36fd6-5a0c-4578-855f-30b59c04473a None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:35.735594 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6fa36fd6-5a0c-4578-855f-30b59c04473a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:35.805650 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:35.851889 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 715/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 03:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:35.899294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318d2b8-6acb-4011-915f-12a04f01a362 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:35.900985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2318d2b8-6acb-4011-915f-12a04f01a362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:36.063148 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318d2b8-6acb-4011-915f-12a04f01a362 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:36.141775 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:36.190486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d205f69-b31e-4b55-baa9-2c6a8eb69d57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:36.191132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d205f69-b31e-4b55-baa9-2c6a8eb69d57 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:36.191407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d205f69-b31e-4b55-baa9-2c6a8eb69d57 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:36.191675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d205f69-b31e-4b55-baa9-2c6a8eb69d57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:36.193356 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2d205f69-b31e-4b55-baa9-2c6a8eb69d57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:36.294716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d205f69-b31e-4b55-baa9-2c6a8eb69d57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:36.296220 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d205f69-b31e-4b55-baa9-2c6a8eb69d57 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:36.315656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 701/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:37.215382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a617d-ff86-49f9-972b-a81cf52158bb None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:37.216268 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a617d-ff86-49f9-972b-a81cf52158bb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:37.216268 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a617d-ff86-49f9-972b-a81cf52158bb None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:37.218555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 03:21:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:37.226016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44606779-f3be-4189-a074-1c0f56108685 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:37.226458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44606779-f3be-4189-a074-1c0f56108685 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:37.226560 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44606779-f3be-4189-a074-1c0f56108685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:37.302800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-44606779-f3be-4189-a074-1c0f56108685 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:37.304242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-44606779-f3be-4189-a074-1c0f56108685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:37.331837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:37.420196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 03:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:21:37.570702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a617d-ff86-49f9-972b-a81cf52158bb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:37.573131 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8e3a617d-ff86-49f9-972b-a81cf52158bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:37.741591 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a617d-ff86-49f9-972b-a81cf52158bb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:37.782153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:37.856839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317281bd-19ad-4c07-b59d-90374ae69665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:37.857486 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317281bd-19ad-4c07-b59d-90374ae69665 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:37.857758 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317281bd-19ad-4c07-b59d-90374ae69665 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:37.858025 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317281bd-19ad-4c07-b59d-90374ae69665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:37.859654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-317281bd-19ad-4c07-b59d-90374ae69665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:37.976063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317281bd-19ad-4c07-b59d-90374ae69665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:37.977733 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317281bd-19ad-4c07-b59d-90374ae69665 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:38.000835 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 717/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:38.889860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc11751-1b72-4228-9923-47d9e0ca9bbb None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:38.890761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc11751-1b72-4228-9923-47d9e0ca9bbb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:38.890761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc11751-1b72-4228-9923-47d9e0ca9bbb None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:38.893017 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 03:21:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:38.898573 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c076f4-1c26-4d67-bcf1-c104f75fe2ed None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:38.899047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c076f4-1c26-4d67-bcf1-c104f75fe2ed None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:38.899147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c076f4-1c26-4d67-bcf1-c104f75fe2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:38.961985 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:38.986403 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-03c076f4-1c26-4d67-bcf1-c104f75fe2ed None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:38.987626 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-03c076f4-1c26-4d67-bcf1-c104f75fe2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:39.089729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 03:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:39.246215 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc11751-1b72-4228-9923-47d9e0ca9bbb None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:39.248504 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8fc11751-1b72-4228-9923-47d9e0ca9bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:39.410371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc11751-1b72-4228-9923-47d9e0ca9bbb None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:39.422903 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:39.535600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f956f9e-4c33-48ae-81f3-71d71862fa68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:39.541800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f956f9e-4c33-48ae-81f3-71d71862fa68 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:39.542088 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f956f9e-4c33-48ae-81f3-71d71862fa68 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:39.542368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f956f9e-4c33-48ae-81f3-71d71862fa68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:39.544076 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0f956f9e-4c33-48ae-81f3-71d71862fa68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:39.659915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f956f9e-4c33-48ae-81f3-71d71862fa68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:39.661579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f956f9e-4c33-48ae-81f3-71d71862fa68 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:39.682426 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 704/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:40.555481 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c714d06-779a-4a67-a06e-3521cd1e4715 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:40.556089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c714d06-779a-4a67-a06e-3521cd1e4715 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:40.556089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c714d06-779a-4a67-a06e-3521cd1e4715 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:40.557399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 03:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:40.563836 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ec8aa-3984-460a-aaaf-c2adf4fe0447 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:40.564506 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ec8aa-3984-460a-aaaf-c2adf4fe0447 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:40.564672 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ec8aa-3984-460a-aaaf-c2adf4fe0447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:40.586197 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:40.648984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-145ec8aa-3984-460a-aaaf-c2adf4fe0447 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:40.650229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-145ec8aa-3984-460a-aaaf-c2adf4fe0447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:40.754353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 03:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:40.910576 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c714d06-779a-4a67-a06e-3521cd1e4715 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:40.912970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3c714d06-779a-4a67-a06e-3521cd1e4715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:41.042300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:41.081351 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c714d06-779a-4a67-a06e-3521cd1e4715 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:41.220824 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada286e9-84cf-49d6-a9cb-66a255439738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:41.221421 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada286e9-84cf-49d6-a9cb-66a255439738 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:41.221712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada286e9-84cf-49d6-a9cb-66a255439738 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:41.221978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada286e9-84cf-49d6-a9cb-66a255439738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:41.223646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ada286e9-84cf-49d6-a9cb-66a255439738 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:41.305651 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:41.319685 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada286e9-84cf-49d6-a9cb-66a255439738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:41.321359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada286e9-84cf-49d6-a9cb-66a255439738 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:41.339495 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 720/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:42.215788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66035a-891c-42e4-8e8c-6288d3083cd5 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:42.216745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66035a-891c-42e4-8e8c-6288d3083cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:42.216745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66035a-891c-42e4-8e8c-6288d3083cd5 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:42.218914 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 03:21:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:42.224809 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcaa0d-4ec3-4b71-ba5f-894bb957cd2f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:42.225516 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcaa0d-4ec3-4b71-ba5f-894bb957cd2f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:42.225659 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcaa0d-4ec3-4b71-ba5f-894bb957cd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:42.307436 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a8fcaa0d-4ec3-4b71-ba5f-894bb957cd2f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:42.308688 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a8fcaa0d-4ec3-4b71-ba5f-894bb957cd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:42.411052 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 03:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:42.564818 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66035a-891c-42e4-8e8c-6288d3083cd5 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:42.567234 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0f66035a-891c-42e4-8e8c-6288d3083cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:42.662126 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:42.734234 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66035a-891c-42e4-8e8c-6288d3083cd5 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:42.853263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41322ea-b948-44f5-91aa-76bf91efff73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:42.853830 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41322ea-b948-44f5-91aa-76bf91efff73 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:42.854111 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41322ea-b948-44f5-91aa-76bf91efff73 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:42.854381 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41322ea-b948-44f5-91aa-76bf91efff73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:42.856018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c41322ea-b948-44f5-91aa-76bf91efff73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:42.906230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:42.949288 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41322ea-b948-44f5-91aa-76bf91efff73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:42.950900 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41322ea-b948-44f5-91aa-76bf91efff73 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:42.970619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 707/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:43.773416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ac782-9585-4b93-aabb-f3d33effed2a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:43.774286 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ac782-9585-4b93-aabb-f3d33effed2a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:43.774286 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ac782-9585-4b93-aabb-f3d33effed2a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:43.776508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 03:21:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:43.784700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98872b66-4a9f-43c8-997d-85ff9e08427c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:43.785143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98872b66-4a9f-43c8-997d-85ff9e08427c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:43.785267 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98872b66-4a9f-43c8-997d-85ff9e08427c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:43.865769 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-98872b66-4a9f-43c8-997d-85ff9e08427c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:43.867151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-98872b66-4a9f-43c8-997d-85ff9e08427c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:43.970602 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 03:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:44.120103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ac782-9585-4b93-aabb-f3d33effed2a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:44.121647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-712ac782-9585-4b93-aabb-f3d33effed2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:44.174258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:44.274299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ac782-9585-4b93-aabb-f3d33effed2a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:44.390786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff884ae9-eadc-456b-99df-687b18ee4b4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:44.391434 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff884ae9-eadc-456b-99df-687b18ee4b4c service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:44.391708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff884ae9-eadc-456b-99df-687b18ee4b4c service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:44.391975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff884ae9-eadc-456b-99df-687b18ee4b4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:44.393608 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ff884ae9-eadc-456b-99df-687b18ee4b4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:44.400631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:44.488373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff884ae9-eadc-456b-99df-687b18ee4b4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:44.490012 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff884ae9-eadc-456b-99df-687b18ee4b4c service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:44.509338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 723/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:45.318343 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832dbe-15a0-45f3-9b1a-bea0fda22dd9 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:45.319004 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832dbe-15a0-45f3-9b1a-bea0fda22dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:45.319004 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832dbe-15a0-45f3-9b1a-bea0fda22dd9 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:45.320273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 03:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:45.326328 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3720330-1e44-4cb6-b7da-1de8429bb521 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:45.327058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3720330-1e44-4cb6-b7da-1de8429bb521 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:45.327170 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3720330-1e44-4cb6-b7da-1de8429bb521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:45.412725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c3720330-1e44-4cb6-b7da-1de8429bb521 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:45.414157 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c3720330-1e44-4cb6-b7da-1de8429bb521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:45.488158 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:45.530766 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 03:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:45.680479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc832dbe-15a0-45f3-9b1a-bea0fda22dd9 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:45.682057 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bc832dbe-15a0-45f3-9b1a-bea0fda22dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:45.706385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:45.843352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc832dbe-15a0-45f3-9b1a-bea0fda22dd9 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:45.937475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:45.968255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac40771-0043-4274-8261-fb94e6fc8e69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:45.969111 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac40771-0043-4274-8261-fb94e6fc8e69 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:45.969442 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac40771-0043-4274-8261-fb94e6fc8e69 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:45.969696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac40771-0043-4274-8261-fb94e6fc8e69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:45.971401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-eac40771-0043-4274-8261-fb94e6fc8e69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:46.072400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac40771-0043-4274-8261-fb94e6fc8e69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:46.074054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac40771-0043-4274-8261-fb94e6fc8e69 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:46.092739 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 710/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:46.904405 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e4eb6-3c0d-47bb-a76e-d7754ae10bef None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:46.905354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e4eb6-3c0d-47bb-a76e-d7754ae10bef None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:46.905523 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e4eb6-3c0d-47bb-a76e-d7754ae10bef None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:46.907701 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 03:21:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:46.915168 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef6e3-47b9-4560-9427-a815cd0cf66c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:46.915593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef6e3-47b9-4560-9427-a815cd0cf66c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:46.915731 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef6e3-47b9-4560-9427-a815cd0cf66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:47.003134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-7b9ef6e3-47b9-4560-9427-a815cd0cf66c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:47.004409 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7b9ef6e3-47b9-4560-9427-a815cd0cf66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:47.056065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:47.115189 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 03:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:47.268217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e4eb6-3c0d-47bb-a76e-d7754ae10bef None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:47.270492 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-685e4eb6-3c0d-47bb-a76e-d7754ae10bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:47.445654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e4eb6-3c0d-47bb-a76e-d7754ae10bef None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:47.501941 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:47.563576 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e9310-27de-4536-8308-e723718ebd68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:47.564221 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e9310-27de-4536-8308-e723718ebd68 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:47.564505 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e9310-27de-4536-8308-e723718ebd68 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:47.564803 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e9310-27de-4536-8308-e723718ebd68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:47.566431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c55e9310-27de-4536-8308-e723718ebd68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:47.671304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e9310-27de-4536-8308-e723718ebd68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:47.672977 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e9310-27de-4536-8308-e723718ebd68 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:47.693943 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 726/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:48.506467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227becae-3209-464d-9016-d4f2a5e6d853 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:48.507532 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227becae-3209-464d-9016-d4f2a5e6d853 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:48.507532 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227becae-3209-464d-9016-d4f2a5e6d853 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:48.508412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 03:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:48.513597 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e9806-49f8-4590-a961-ac6e92f0c901 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:48.514052 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e9806-49f8-4590-a961-ac6e92f0c901 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:48.514156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e9806-49f8-4590-a961-ac6e92f0c901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:48.593122 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d80e9806-49f8-4590-a961-ac6e92f0c901 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:48.594330 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d80e9806-49f8-4590-a961-ac6e92f0c901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:48.596297 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:48.701369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 03:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:48.857863 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227becae-3209-464d-9016-d4f2a5e6d853 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:48.860211 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-227becae-3209-464d-9016-d4f2a5e6d853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:49.042446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227becae-3209-464d-9016-d4f2a5e6d853 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:49.076564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:49.165278 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f788874-7ad8-43ba-8298-e6aca79d2d3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:49.165932 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f788874-7ad8-43ba-8298-e6aca79d2d3f service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:49.166209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f788874-7ad8-43ba-8298-e6aca79d2d3f service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:49.166468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f788874-7ad8-43ba-8298-e6aca79d2d3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:49.168120 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5f788874-7ad8-43ba-8298-e6aca79d2d3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:49.276151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f788874-7ad8-43ba-8298-e6aca79d2d3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:49.278764 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f788874-7ad8-43ba-8298-e6aca79d2d3f service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:49.306068 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 713/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:51.252788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be143e32-bb93-4246-9708-5cf85c6b245f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:51.253348 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be143e32-bb93-4246-9708-5cf85c6b245f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:51.253348 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be143e32-bb93-4246-9708-5cf85c6b245f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:51.254726 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 03:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:51.260911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bc6e-55a2-4508-b3d9-aa7440aa7cbc None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:51.261373 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bc6e-55a2-4508-b3d9-aa7440aa7cbc None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:51.261477 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bc6e-55a2-4508-b3d9-aa7440aa7cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:51.311336 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:51.339771 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-87e4bc6e-55a2-4508-b3d9-aa7440aa7cbc None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:51.341361 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-87e4bc6e-55a2-4508-b3d9-aa7440aa7cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:51.441708 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 03:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:51.486623 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be143e32-bb93-4246-9708-5cf85c6b245f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:51.489140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-be143e32-bb93-4246-9708-5cf85c6b245f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:51.603035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be143e32-bb93-4246-9708-5cf85c6b245f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:51.640585 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:51.686852 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12641600-428c-4f45-b5c6-7aea22f9466d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:51.687535 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12641600-428c-4f45-b5c6-7aea22f9466d service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:51.687811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12641600-428c-4f45-b5c6-7aea22f9466d service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:51.688082 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12641600-428c-4f45-b5c6-7aea22f9466d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:51.689801 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-12641600-428c-4f45-b5c6-7aea22f9466d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:51.814856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12641600-428c-4f45-b5c6-7aea22f9466d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:51.816336 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12641600-428c-4f45-b5c6-7aea22f9466d service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:51.835625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 729/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:53.974729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3c099-492d-4e66-885b-0242739d41d8 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:53.975550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3c099-492d-4e66-885b-0242739d41d8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:53.975550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3c099-492d-4e66-885b-0242739d41d8 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:53.978680 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 03:21:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:53.984346 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a2399-b64d-4610-8d9a-ce062bab8edf None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:53.984881 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a2399-b64d-4610-8d9a-ce062bab8edf None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:53.984987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a2399-b64d-4610-8d9a-ce062bab8edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:54.051289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-045a2399-b64d-4610-8d9a-ce062bab8edf None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:54.052484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-045a2399-b64d-4610-8d9a-ce062bab8edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:54.065771 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:54.153032 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 03:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:54.191739 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3c099-492d-4e66-885b-0242739d41d8 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:54.194234 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e7c3c099-492d-4e66-885b-0242739d41d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:54.315696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3c099-492d-4e66-885b-0242739d41d8 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:54.328557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:54.405902 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992ea7b-fad4-451f-81d8-d092c2650abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:54.406817 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992ea7b-fad4-451f-81d8-d092c2650abd service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:54.407176 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992ea7b-fad4-451f-81d8-d092c2650abd service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:54.407527 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992ea7b-fad4-451f-81d8-d092c2650abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:54.410094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1992ea7b-fad4-451f-81d8-d092c2650abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:54.535034 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992ea7b-fad4-451f-81d8-d092c2650abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:54.536472 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992ea7b-fad4-451f-81d8-d092c2650abd service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:54.554643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 716/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:56.890667 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e441f-5119-4489-905c-7c83af27a390 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:56.891229 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e441f-5119-4489-905c-7c83af27a390 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:56.891229 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e441f-5119-4489-905c-7c83af27a390 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:56.892641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 03:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:56.899528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4472ba-3044-4f3b-b3bb-b5457f858a38 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:56.900249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4472ba-3044-4f3b-b3bb-b5457f858a38 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:56.900432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4472ba-3044-4f3b-b3bb-b5457f858a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:56.962810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:56.984441 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-1f4472ba-3044-4f3b-b3bb-b5457f858a38 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:56.985736 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1f4472ba-3044-4f3b-b3bb-b5457f858a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:57.102534 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 03:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:57.145497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e441f-5119-4489-905c-7c83af27a390 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:57.147979 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b86e441f-5119-4489-905c-7c83af27a390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:57.268742 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e441f-5119-4489-905c-7c83af27a390 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:21:57.321350 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:57.362514 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7fb77-e102-4ee8-9ea8-e5d353c6b611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:21:57.363155 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7fb77-e102-4ee8-9ea8-e5d353c6b611 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:57.363427 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7fb77-e102-4ee8-9ea8-e5d353c6b611 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:57.363700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7fb77-e102-4ee8-9ea8-e5d353c6b611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:57.365394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f6e7fb77-e102-4ee8-9ea8-e5d353c6b611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:57.482866 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7fb77-e102-4ee8-9ea8-e5d353c6b611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:21:57.484293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7fb77-e102-4ee8-9ea8-e5d353c6b611 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:21:57.502857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 732/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:21:59.642046 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea791-12e6-4859-8e38-b7acc2a4a5d5 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:59.642976 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea791-12e6-4859-8e38-b7acc2a4a5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:59.642976 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea791-12e6-4859-8e38-b7acc2a4a5d5 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:59.645197 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 03:21:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:21:59.650907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73c8f0-f522-438a-9b15-b15db2bf9f2e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:21:59.651352 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73c8f0-f522-438a-9b15-b15db2bf9f2e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:21:59.651469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73c8f0-f522-438a-9b15-b15db2bf9f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:21:59.719823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9e73c8f0-f522-438a-9b15-b15db2bf9f2e None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:21:59.721078 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9e73c8f0-f522-438a-9b15-b15db2bf9f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:21:59.745708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:21:59.836416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 03:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:21:59.888112 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ea791-12e6-4859-8e38-b7acc2a4a5d5 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:21:59.889704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b38ea791-12e6-4859-8e38-b7acc2a4a5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:00.003859 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ea791-12e6-4859-8e38-b7acc2a4a5d5 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:22:00.024926 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:00.095264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69fb60-7bc2-4b0f-8b7e-b5ada8caa91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:22:00.095911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69fb60-7bc2-4b0f-8b7e-b5ada8caa91b service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:00.096189 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69fb60-7bc2-4b0f-8b7e-b5ada8caa91b service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:00.096457 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69fb60-7bc2-4b0f-8b7e-b5ada8caa91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:00.098137 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bb69fb60-7bc2-4b0f-8b7e-b5ada8caa91b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:00.213232 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69fb60-7bc2-4b0f-8b7e-b5ada8caa91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:22:00.214667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69fb60-7bc2-4b0f-8b7e-b5ada8caa91b service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:22:00.233892 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 719/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:21:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:22:02.305368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f60daf-a15b-451d-9f93-16c6617843b8 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:02.306167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f60daf-a15b-451d-9f93-16c6617843b8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:02.306167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f60daf-a15b-451d-9f93-16c6617843b8 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:02.308424 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 03:22:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:22:02.314807 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd1989-30cd-4fa5-b6f9-0c34cc095e3a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:02.315294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd1989-30cd-4fa5-b6f9-0c34cc095e3a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:02.315411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd1989-30cd-4fa5-b6f9-0c34cc095e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:02.381537 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:02.384656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5abd1989-30cd-4fa5-b6f9-0c34cc095e3a None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:22:02.386522 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5abd1989-30cd-4fa5-b6f9-0c34cc095e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:02.496635 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 03:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:22:02.539836 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f60daf-a15b-451d-9f93-16c6617843b8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:22:02.541455 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c6f60daf-a15b-451d-9f93-16c6617843b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:02.654005 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f60daf-a15b-451d-9f93-16c6617843b8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:22:02.706881 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:02.732684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72ad4c-941c-4180-8320-692919312aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:22:02.733326 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72ad4c-941c-4180-8320-692919312aaf service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:02.733601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72ad4c-941c-4180-8320-692919312aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:02.733888 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72ad4c-941c-4180-8320-692919312aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:02.735514 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2c72ad4c-941c-4180-8320-692919312aaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:02.862726 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72ad4c-941c-4180-8320-692919312aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:22:02.864173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72ad4c-941c-4180-8320-692919312aaf service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:22:02.882280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 735/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:22:04.921648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc779a-38df-45d2-914b-56cf740fed3d None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:04.922232 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc779a-38df-45d2-914b-56cf740fed3d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:04.922232 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc779a-38df-45d2-914b-56cf740fed3d None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:04.924356 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 03:22:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:22:04.932140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17dfcb-1f91-473d-914d-856768190f9a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:04.932637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17dfcb-1f91-473d-914d-856768190f9a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:04.932740 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17dfcb-1f91-473d-914d-856768190f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:05.001615 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7c17dfcb-1f91-473d-914d-856768190f9a None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:22:05.002738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7c17dfcb-1f91-473d-914d-856768190f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:05.038606 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:05.112914 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 03:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:22:05.151735 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc779a-38df-45d2-914b-56cf740fed3d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:22:05.153310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1dcc779a-38df-45d2-914b-56cf740fed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:05.277327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc779a-38df-45d2-914b-56cf740fed3d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:22:05.306475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:05.357667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9baf29-9078-4628-b914-997973197fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:22:05.358315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9baf29-9078-4628-b914-997973197fbb service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:05.358591 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9baf29-9078-4628-b914-997973197fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:05.358864 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9baf29-9078-4628-b914-997973197fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:05.360498 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4d9baf29-9078-4628-b914-997973197fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:05.484043 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9baf29-9078-4628-b914-997973197fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:22:05.485523 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9baf29-9078-4628-b914-997973197fbb service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:22:05.505855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 722/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:22:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:22:07.569769 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3ccd1-0d26-4d62-a0e0-8f71e38fab59 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:07.570766 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3ccd1-0d26-4d62-a0e0-8f71e38fab59 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:07.570766 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3ccd1-0d26-4d62-a0e0-8f71e38fab59 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:07.572347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 03:22:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:22:07.578748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c44ec-dbc3-44b5-b1da-3278b5138a7b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:07.579200 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c44ec-dbc3-44b5-b1da-3278b5138a7b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:07.579312 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c44ec-dbc3-44b5-b1da-3278b5138a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:07.656441 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-408c44ec-dbc3-44b5-b1da-3278b5138a7b None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:22:07.657700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-408c44ec-dbc3-44b5-b1da-3278b5138a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:07.666417 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:07.761778 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 03:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:22:07.799101 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3ccd1-0d26-4d62-a0e0-8f71e38fab59 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:22:07.800803 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4dc3ccd1-0d26-4d62-a0e0-8f71e38fab59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:07.909478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3ccd1-0d26-4d62-a0e0-8f71e38fab59 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:22:07.971240 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:07.990076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37525cc1-b141-43df-888f-02ec1bdbc7ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:22:07.990732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37525cc1-b141-43df-888f-02ec1bdbc7ca service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:07.991007 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37525cc1-b141-43df-888f-02ec1bdbc7ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:07.991272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37525cc1-b141-43df-888f-02ec1bdbc7ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:07.993450 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-37525cc1-b141-43df-888f-02ec1bdbc7ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:08.111846 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37525cc1-b141-43df-888f-02ec1bdbc7ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:22:08.113314 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37525cc1-b141-43df-888f-02ec1bdbc7ca service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:22:08.132197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 738/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:22:10.175954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2f6b5-d51f-4d5d-a990-6e058b592b89 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:10.176904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2f6b5-d51f-4d5d-a990-6e058b592b89 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:10.176904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2f6b5-d51f-4d5d-a990-6e058b592b89 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:10.179091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 03:22:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:22:10.185115 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a5086-22e7-47b5-82c1-af2d5ea1b1ea None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:10.185552 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a5086-22e7-47b5-82c1-af2d5ea1b1ea None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:10.185647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a5086-22e7-47b5-82c1-af2d5ea1b1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:10.254149 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-015a5086-22e7-47b5-82c1-af2d5ea1b1ea None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:22:10.255361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-015a5086-22e7-47b5-82c1-af2d5ea1b1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:10.295771 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:10.365109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 03:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:22:10.404340 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2f6b5-d51f-4d5d-a990-6e058b592b89 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:22:10.405948 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f0a2f6b5-d51f-4d5d-a990-6e058b592b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:10.515981 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2f6b5-d51f-4d5d-a990-6e058b592b89 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:22:10.555380 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:10.595716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c261acf-b7cf-4ebc-898e-ec1153f47cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:22:10.596365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c261acf-b7cf-4ebc-898e-ec1153f47cbf service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:10.596676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c261acf-b7cf-4ebc-898e-ec1153f47cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:10.596945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c261acf-b7cf-4ebc-898e-ec1153f47cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:10.598568 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9c261acf-b7cf-4ebc-898e-ec1153f47cbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:10.713405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c261acf-b7cf-4ebc-898e-ec1153f47cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:22:10.714861 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c261acf-b7cf-4ebc-898e-ec1153f47cbf service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:22:10.735065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 725/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:22:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:22:12.769395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce3f19-3efc-4abc-8523-b9e2d56d4389 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:12.769989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce3f19-3efc-4abc-8523-b9e2d56d4389 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:12.769989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce3f19-3efc-4abc-8523-b9e2d56d4389 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:12.771315 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 03:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:22:12.783334 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950acb4c-9151-496f-8401-e5660bb3f82a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:12.784069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950acb4c-9151-496f-8401-e5660bb3f82a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:12.784274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950acb4c-9151-496f-8401-e5660bb3f82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:12.857828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-950acb4c-9151-496f-8401-e5660bb3f82a None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:22:12.859041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-950acb4c-9151-496f-8401-e5660bb3f82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:12.884891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:12.973951 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 03:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:22:13.012112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce3f19-3efc-4abc-8523-b9e2d56d4389 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:22:13.013710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-51ce3f19-3efc-4abc-8523-b9e2d56d4389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:13.126361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce3f19-3efc-4abc-8523-b9e2d56d4389 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:22:13.196704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:13.204135 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf8722-6fe0-4f6b-8c20-261e43d1f615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:22:13.204810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf8722-6fe0-4f6b-8c20-261e43d1f615 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:13.205086 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf8722-6fe0-4f6b-8c20-261e43d1f615 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:13.205355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf8722-6fe0-4f6b-8c20-261e43d1f615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:13.206972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d4bf8722-6fe0-4f6b-8c20-261e43d1f615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:13.321515 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf8722-6fe0-4f6b-8c20-261e43d1f615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:22:13.322960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf8722-6fe0-4f6b-8c20-261e43d1f615 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:22:13.341242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 741/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:22:15.379283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af7cd0-c4ee-4b55-81ec-4e8a9b1b8bd1 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:15.380092 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af7cd0-c4ee-4b55-81ec-4e8a9b1b8bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:15.380092 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af7cd0-c4ee-4b55-81ec-4e8a9b1b8bd1 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:15.382266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 03:22:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:22:15.390597 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98a0f9-3adc-4280-889d-8158a672f6b0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:15.391040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98a0f9-3adc-4280-889d-8158a672f6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:15.391216 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98a0f9-3adc-4280-889d-8158a672f6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:15.466631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-fd98a0f9-3adc-4280-889d-8158a672f6b0 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:22:15.468148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fd98a0f9-3adc-4280-889d-8158a672f6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:15.520689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:15.574725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 03:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:22:15.618173 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af7cd0-c4ee-4b55-81ec-4e8a9b1b8bd1 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:22:15.619718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-88af7cd0-c4ee-4b55-81ec-4e8a9b1b8bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:15.733073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af7cd0-c4ee-4b55-81ec-4e8a9b1b8bd1 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:22:15.783507 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:15.811802 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0757cf-5c6c-4e5d-b7a4-6241ff7d76ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:22:15.812454 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0757cf-5c6c-4e5d-b7a4-6241ff7d76ee service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:15.812760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0757cf-5c6c-4e5d-b7a4-6241ff7d76ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:15.813030 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0757cf-5c6c-4e5d-b7a4-6241ff7d76ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:15.814665 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4c0757cf-5c6c-4e5d-b7a4-6241ff7d76ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:15.949864 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0757cf-5c6c-4e5d-b7a4-6241ff7d76ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:22:15.951295 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0757cf-5c6c-4e5d-b7a4-6241ff7d76ee service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:22:15.971132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 728/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:22:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:22:25.572624 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=22 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:25.975568 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=66 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:35.767974 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9bac5-5c33-4cd8-b8d5-617fc19bfb70 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:35.768561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9bac5-5c33-4cd8-b8d5-617fc19bfb70 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:35.768830 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9bac5-5c33-4cd8-b8d5-617fc19bfb70 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:35.770954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 743/1471] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:22:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:22:35.778147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067657c3-688b-4743-9760-8015e53891fe None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:35.778618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067657c3-688b-4743-9760-8015e53891fe None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:35.778720 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067657c3-688b-4743-9760-8015e53891fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:35.867681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-067657c3-688b-4743-9760-8015e53891fe None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:22:35.869266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-067657c3-688b-4743-9760-8015e53891fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:35.984209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 729/1472] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:22:36.072605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65786e0b-d24c-4b04-840b-590503d03992 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:36.073007 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65786e0b-d24c-4b04-840b-590503d03992 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:36.073417 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65786e0b-d24c-4b04-840b-590503d03992 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:36.075601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 744/1473] 10.222.0.26 () {54 vars in 962 bytes} [Tue Jul 12 03:22:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:22:36.081146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b11833-b544-4f2d-b73a-818056c0de59 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:36.081485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b11833-b544-4f2d-b73a-818056c0de59 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:36.081789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b11833-b544-4f2d-b73a-818056c0de59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:36.164083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a8b11833-b544-4f2d-b73a-818056c0de59 None None] MFA Rules not processed for user `97fe9d04ccb445208f3783a8b55cd31e`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:22:36.165717 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a8b11833-b544-4f2d-b73a-818056c0de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:36.187386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:36.245105 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 730/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Tue Jul 12 03:22:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:22:36.252835 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65786e0b-d24c-4b04-840b-590503d03992 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:22:36.254351 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-65786e0b-d24c-4b04-840b-590503d03992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:36.361441 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65786e0b-d24c-4b04-840b-590503d03992 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:22:36.437806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae5847-582a-44af-b538-8d4621c836b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97fe9d04ccb445208f3783a8b55cd31e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:22:36.438460 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5847-582a-44af-b538-8d4621c836b1 service glance] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:36.438737 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5847-582a-44af-b538-8d4621c836b1 service glance] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:36.439005 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5847-582a-44af-b538-8d4621c836b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:36.440675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f8ae5847-582a-44af-b538-8d4621c836b1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:36.498034 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:36.557145 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae5847-582a-44af-b538-8d4621c836b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:22:36.558588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae5847-582a-44af-b538-8d4621c836b1 service glance] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:22:36.577622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 745/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:22:38.688313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f89b-e34c-477c-bd24-2184888943af None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:38.688935 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f89b-e34c-477c-bd24-2184888943af None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:38.688935 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f89b-e34c-477c-bd24-2184888943af None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:38.690286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 731/1476] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:22:38.695662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a09f-54b3-44f2-8a3e-d76fd7de846d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:38.696116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a09f-54b3-44f2-8a3e-d76fd7de846d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:38.696212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a09f-54b3-44f2-8a3e-d76fd7de846d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:38.762686 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4764a09f-54b3-44f2-8a3e-d76fd7de846d None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:22:38.763884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4764a09f-54b3-44f2-8a3e-d76fd7de846d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:38.867142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 746/1477] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:22:38.891653 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32f89b-e34c-477c-bd24-2184888943af None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:22:38.894145 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6c32f89b-e34c-477c-bd24-2184888943af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:39.042245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32f89b-e34c-477c-bd24-2184888943af None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:22:39.091293 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:39.137924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b1900-ab02-4638-905e-28936381ced0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:22:39.138585 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b1900-ab02-4638-905e-28936381ced0 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:39.138884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b1900-ab02-4638-905e-28936381ced0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:39.139163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b1900-ab02-4638-905e-28936381ced0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:39.139887 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b1900-ab02-4638-905e-28936381ced0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:22:39.141727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: WARNING py.warnings [None req-062b1900-ab02-4638-905e-28936381ced0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:22:39.141727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: warnings.warn(msg) Jul 12 03:22:39.141727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: Jul 12 03:22:39.142876 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b1900-ab02-4638-905e-28936381ced0 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:22:39.163798 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 732/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Tue Jul 12 03:22:38 2022] GET /identity/v3/projects => generated 2553 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:22:41.219354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb280110-f3cc-4d81-8825-e5c93e823541 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:41.220153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb280110-f3cc-4d81-8825-e5c93e823541 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:41.220376 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb280110-f3cc-4d81-8825-e5c93e823541 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:41.222677 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 747/1479] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:22:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:22:41.230099 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960b617-5051-4f25-86cd-dad6b472b893 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:41.230561 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960b617-5051-4f25-86cd-dad6b472b893 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:41.230688 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960b617-5051-4f25-86cd-dad6b472b893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:41.303093 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3960b617-5051-4f25-86cd-dad6b472b893 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:22:41.304305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3960b617-5051-4f25-86cd-dad6b472b893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:41.407380 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 733/1480] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:22:41.451397 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb280110-f3cc-4d81-8825-e5c93e823541 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:22:41.452933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bb280110-f3cc-4d81-8825-e5c93e823541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:41.463491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:41.611717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb280110-f3cc-4d81-8825-e5c93e823541 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:22:41.698688 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:41.736508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c7ebd-7e12-4bff-9734-e8aa00fe8b2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:22:41.737722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c7ebd-7e12-4bff-9734-e8aa00fe8b2f service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:41.738081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c7ebd-7e12-4bff-9734-e8aa00fe8b2f service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:41.738447 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c7ebd-7e12-4bff-9734-e8aa00fe8b2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:41.741115 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e78c7ebd-7e12-4bff-9734-e8aa00fe8b2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:41.840296 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c7ebd-7e12-4bff-9734-e8aa00fe8b2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:22:41.842795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c7ebd-7e12-4bff-9734-e8aa00fe8b2f service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:22:41.872158 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 748/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:22:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:22:44.076659 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2520df-bed9-4885-bed8-430867e9d6a4 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:44.077217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2520df-bed9-4885-bed8-430867e9d6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:44.077217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2520df-bed9-4885-bed8-430867e9d6a4 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:44.078594 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 734/1482] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:22:44.085010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db2b19-71b2-41bc-821a-010abfa53417 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:44.085775 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db2b19-71b2-41bc-821a-010abfa53417 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:44.085930 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db2b19-71b2-41bc-821a-010abfa53417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:44.159000 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-79db2b19-71b2-41bc-821a-010abfa53417 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:22:44.160230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-79db2b19-71b2-41bc-821a-010abfa53417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:44.208087 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:44.262987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 749/1483] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:22:44.306846 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2520df-bed9-4885-bed8-430867e9d6a4 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:22:44.309265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fd2520df-bed9-4885-bed8-430867e9d6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:44.338677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:44.422543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2520df-bed9-4885-bed8-430867e9d6a4 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:22:44.497298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7e58c-cfae-4994-9cae-c0d3d1eee82a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:22:44.497939 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7e58c-cfae-4994-9cae-c0d3d1eee82a service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:44.498210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7e58c-cfae-4994-9cae-c0d3d1eee82a service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:44.498475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7e58c-cfae-4994-9cae-c0d3d1eee82a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:44.500136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-71f7e58c-cfae-4994-9cae-c0d3d1eee82a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:44.579516 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:44.625400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7e58c-cfae-4994-9cae-c0d3d1eee82a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:22:44.626789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7e58c-cfae-4994-9cae-c0d3d1eee82a service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:22:44.647103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 735/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:22:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:22:46.731837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e845ccc-46c8-46f5-a161-b4631752d09b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:46.732673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e845ccc-46c8-46f5-a161-b4631752d09b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:46.732673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e845ccc-46c8-46f5-a161-b4631752d09b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:46.735015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 750/1485] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:22:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:22:46.742313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ba731-d73b-4ecf-b738-585150a31043 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:46.742789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ba731-d73b-4ecf-b738-585150a31043 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:46.742886 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ba731-d73b-4ecf-b738-585150a31043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:46.807311 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-eb7ba731-d73b-4ecf-b738-585150a31043 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:22:46.808497 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-eb7ba731-d73b-4ecf-b738-585150a31043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:46.921741 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 736/1486] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:22:46.964490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e845ccc-46c8-46f5-a161-b4631752d09b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:22:46.966895 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9e845ccc-46c8-46f5-a161-b4631752d09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:47.090941 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e845ccc-46c8-46f5-a161-b4631752d09b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:22:47.175434 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:47.177710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d26fb5-d4b2-429f-93cb-6e9a4d682659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:22:47.178533 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d26fb5-d4b2-429f-93cb-6e9a4d682659 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:47.178827 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d26fb5-d4b2-429f-93cb-6e9a4d682659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:47.179112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d26fb5-d4b2-429f-93cb-6e9a4d682659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:47.181697 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-44d26fb5-d4b2-429f-93cb-6e9a4d682659 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:47.313628 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d26fb5-d4b2-429f-93cb-6e9a4d682659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:22:47.315077 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d26fb5-d4b2-429f-93cb-6e9a4d682659 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:22:47.334501 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 751/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:22:49.536281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e9dfb-43f7-4dc9-8e3f-ba5b146f3288 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:49.537210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e9dfb-43f7-4dc9-8e3f-ba5b146f3288 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:49.537210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e9dfb-43f7-4dc9-8e3f-ba5b146f3288 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:49.539294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 737/1488] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:22:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:22:49.544722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96829-1b6f-4883-b257-0ce4263f92a5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:49.545163 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96829-1b6f-4883-b257-0ce4263f92a5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:49.545268 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96829-1b6f-4883-b257-0ce4263f92a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:49.613090 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-21f96829-1b6f-4883-b257-0ce4263f92a5 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:22:49.614285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-21f96829-1b6f-4883-b257-0ce4263f92a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:49.668164 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:49.721494 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 752/1489] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:22:49.762099 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e9dfb-43f7-4dc9-8e3f-ba5b146f3288 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:22:49.764216 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3c0e9dfb-43f7-4dc9-8e3f-ba5b146f3288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:49.810105 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:49.886413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e9dfb-43f7-4dc9-8e3f-ba5b146f3288 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:22:49.964419 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487eea4-9d5b-42e7-8555-f7fb320539c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:22:49.965103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487eea4-9d5b-42e7-8555-f7fb320539c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:49.965386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487eea4-9d5b-42e7-8555-f7fb320539c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:49.965654 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487eea4-9d5b-42e7-8555-f7fb320539c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:49.967305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0487eea4-9d5b-42e7-8555-f7fb320539c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:50.060881 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:50.090370 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487eea4-9d5b-42e7-8555-f7fb320539c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:22:50.091819 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487eea4-9d5b-42e7-8555-f7fb320539c0 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:22:50.111058 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 738/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:22:52.331204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941914a3-6eaf-4cf2-a2c4-4088b289653c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:52.331996 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941914a3-6eaf-4cf2-a2c4-4088b289653c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:52.332094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941914a3-6eaf-4cf2-a2c4-4088b289653c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:52.334295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 753/1491] 10.222.0.26 () {54 vars in 926 bytes} [Tue Jul 12 03:22:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:22:52.340868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b60bae-9793-4272-bcbe-be113e65ef32 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:52.341618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b60bae-9793-4272-bcbe-be113e65ef32 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:52.341795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b60bae-9793-4272-bcbe-be113e65ef32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:52.410819 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-03b60bae-9793-4272-bcbe-be113e65ef32 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:22:52.412071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-03b60bae-9793-4272-bcbe-be113e65ef32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:52.509847 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 739/1492] 10.222.0.26 () {58 vars in 1023 bytes} [Tue Jul 12 03:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:22:52.551694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941914a3-6eaf-4cf2-a2c4-4088b289653c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:22:52.553241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-941914a3-6eaf-4cf2-a2c4-4088b289653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:52.666761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941914a3-6eaf-4cf2-a2c4-4088b289653c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:22:52.748777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49cd93-8b75-4412-9bc2-05257a384201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:22:52.749655 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49cd93-8b75-4412-9bc2-05257a384201 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:22:52.749995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49cd93-8b75-4412-9bc2-05257a384201 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:22:52.750346 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49cd93-8b75-4412-9bc2-05257a384201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:22:52.753063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0b49cd93-8b75-4412-9bc2-05257a384201 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:22:52.769581 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:22:52.880605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49cd93-8b75-4412-9bc2-05257a384201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:22:52.882048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49cd93-8b75-4412-9bc2-05257a384201 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:22:52.902639 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 754/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:23:02.507905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=82 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:23:02.899257 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=50 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:24:27.283070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3da92-0bc9-4ec9-9591-6800633e39a3 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:24:27.283727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3da92-0bc9-4ec9-9591-6800633e39a3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:24:27.283727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3da92-0bc9-4ec9-9591-6800633e39a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:24:27.369533 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-eba3da92-0bc9-4ec9-9591-6800633e39a3 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:24:27.370735 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-eba3da92-0bc9-4ec9-9591-6800633e39a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:24:27.476186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 740/1494] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:24:27.484350 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6996ab-09df-4e7a-a616-285e03f1b0ab None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:24:27.485064 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6996ab-09df-4e7a-a616-285e03f1b0ab None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:24:27.485064 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6996ab-09df-4e7a-a616-285e03f1b0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:24:27.560365 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3f6996ab-09df-4e7a-a616-285e03f1b0ab None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:24:27.561631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3f6996ab-09df-4e7a-a616-285e03f1b0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:24:27.670046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 755/1495] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:24:27.675859 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3da92-0bc9-4ec9-9591-6800633e39a3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:24:27.677354 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-eba3da92-0bc9-4ec9-9591-6800633e39a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:24:27.693391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3da92-0bc9-4ec9-9591-6800633e39a3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:24:27.760909 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:24:27.798309 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60567ff3-0761-4b53-865f-3a6847ddd177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:24:27.798977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60567ff3-0761-4b53-865f-3a6847ddd177 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:24:27.799251 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60567ff3-0761-4b53-865f-3a6847ddd177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:24:27.799524 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60567ff3-0761-4b53-865f-3a6847ddd177 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:24:27.800258 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60567ff3-0761-4b53-865f-3a6847ddd177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:24:27.800651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60567ff3-0761-4b53-865f-3a6847ddd177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:24:27.801694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: WARNING py.warnings [None req-60567ff3-0761-4b53-865f-3a6847ddd177 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:24:27.801694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: warnings.warn(msg) Jul 12 03:24:27.801694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: Jul 12 03:24:27.802603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60567ff3-0761-4b53-865f-3a6847ddd177 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:24:27.814323 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 741/1496] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:24:27.822777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6996ab-09df-4e7a-a616-285e03f1b0ab None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:24:27.833140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6996ab-09df-4e7a-a616-285e03f1b0ab None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:24:27.901260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:24:27.936640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20b58e-7edc-4b5e-92d6-7152e0e7f2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:24:27.937333 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20b58e-7edc-4b5e-92d6-7152e0e7f2aa admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:24:27.937613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20b58e-7edc-4b5e-92d6-7152e0e7f2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:24:27.937888 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20b58e-7edc-4b5e-92d6-7152e0e7f2aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:24:27.938594 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20b58e-7edc-4b5e-92d6-7152e0e7f2aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:24:27.940412 dv-cinder-847730-4-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-ea20b58e-7edc-4b5e-92d6-7152e0e7f2aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:24:27.940412 dv-cinder-847730-4-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 12 03:24:27.940412 dv-cinder-847730-4-smb devstack@keystone.service[80398]: Jul 12 03:24:27.941668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20b58e-7edc-4b5e-92d6-7152e0e7f2aa admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:24:28.006492 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 756/1497] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:24:27 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:24:28.011256 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60567ff3-0761-4b53-865f-3a6847ddd177 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:24:28.012808 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-60567ff3-0761-4b53-865f-3a6847ddd177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:24:28.046787 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60567ff3-0761-4b53-865f-3a6847ddd177 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:24:28.151541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6be6e3-f175-47e5-a246-e5ea1b66a00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:24:28.152222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6be6e3-f175-47e5-a246-e5ea1b66a00e admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:24:28.152547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6be6e3-f175-47e5-a246-e5ea1b66a00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:24:28.152815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6be6e3-f175-47e5-a246-e5ea1b66a00e admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:24:28.153528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6be6e3-f175-47e5-a246-e5ea1b66a00e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:24:28.154572 dv-cinder-847730-4-smb devstack@keystone.service[80397]: WARNING py.warnings [None req-1f6be6e3-f175-47e5-a246-e5ea1b66a00e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:24:28.154572 dv-cinder-847730-4-smb devstack@keystone.service[80397]: warnings.warn(msg) Jul 12 03:24:28.154572 dv-cinder-847730-4-smb devstack@keystone.service[80397]: Jul 12 03:24:28.156308 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6be6e3-f175-47e5-a246-e5ea1b66a00e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:24:28.199830 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 742/1498] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:24:28 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:24:28.204983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20b58e-7edc-4b5e-92d6-7152e0e7f2aa admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:24:28.206550 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ea20b58e-7edc-4b5e-92d6-7152e0e7f2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:24:28.275158 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20b58e-7edc-4b5e-92d6-7152e0e7f2aa admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:24:28.362937 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:24:28.374089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b8ffc-0b44-4fad-8edb-1340c07c6eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:24:28.374748 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b8ffc-0b44-4fad-8edb-1340c07c6eab admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:24:28.375024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b8ffc-0b44-4fad-8edb-1340c07c6eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:24:28.375289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b8ffc-0b44-4fad-8edb-1340c07c6eab admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:24:28.376014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b8ffc-0b44-4fad-8edb-1340c07c6eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:24:28.377063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-7f5b8ffc-0b44-4fad-8edb-1340c07c6eab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:24:28.377063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 12 03:24:28.377063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: Jul 12 03:24:28.377971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b8ffc-0b44-4fad-8edb-1340c07c6eab admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:24:28.390568 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 757/1499] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:24:28.394941 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6be6e3-f175-47e5-a246-e5ea1b66a00e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:24:28.396500 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1f6be6e3-f175-47e5-a246-e5ea1b66a00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:24:28.408222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6be6e3-f175-47e5-a246-e5ea1b66a00e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:24:28.435339 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:24:28.509476 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b63972-27c1-47dc-8de8-268ef444e9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:24:28.510132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b63972-27c1-47dc-8de8-268ef444e9ce admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:24:28.510404 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b63972-27c1-47dc-8de8-268ef444e9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:24:28.510673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b63972-27c1-47dc-8de8-268ef444e9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:24:28.511394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b63972-27c1-47dc-8de8-268ef444e9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:24:28.512403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: WARNING py.warnings [None req-f0b63972-27c1-47dc-8de8-268ef444e9ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:24:28.512403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: warnings.warn(msg) Jul 12 03:24:28.512403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: Jul 12 03:24:28.513319 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b63972-27c1-47dc-8de8-268ef444e9ce admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:24:28.526489 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 743/1500] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:24:28.530994 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b8ffc-0b44-4fad-8edb-1340c07c6eab admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:24:28.533096 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7f5b8ffc-0b44-4fad-8edb-1340c07c6eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:24:28.580138 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b8ffc-0b44-4fad-8edb-1340c07c6eab admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:24:28.688474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5908bdf-5adc-40bd-b60b-0e9c5df19312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:24:28.689403 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5908bdf-5adc-40bd-b60b-0e9c5df19312 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:24:28.689678 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5908bdf-5adc-40bd-b60b-0e9c5df19312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:24:28.689944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5908bdf-5adc-40bd-b60b-0e9c5df19312 admin admin] PATH_INFO: `/v3/projects/3daaadc953004dacaf547468c4caeed7/users/a0ee2ee12b204c4c8ddc3747b20163c3/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:24:28.713563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5908bdf-5adc-40bd-b60b-0e9c5df19312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3daaadc953004dacaf547468c4caeed7, user_id=a0ee2ee12b204c4c8ddc3747b20163c3, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:24:28.714614 dv-cinder-847730-4-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-c5908bdf-5adc-40bd-b60b-0e9c5df19312 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:24:28.714614 dv-cinder-847730-4-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 12 03:24:28.714614 dv-cinder-847730-4-smb devstack@keystone.service[80398]: Jul 12 03:24:28.716563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5908bdf-5adc-40bd-b60b-0e9c5df19312 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:24:28.745020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 758/1501] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:24:28 2022] PUT /identity/v3/projects/3daaadc953004dacaf547468c4caeed7/users/a0ee2ee12b204c4c8ddc3747b20163c3/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:24:28.757350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b2efd-83b3-4b4f-a589-0d8b5c9d2c5a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:24:28.757609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b2efd-83b3-4b4f-a589-0d8b5c9d2c5a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:24:28.757915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b2efd-83b3-4b4f-a589-0d8b5c9d2c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:24:28.813131 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3f4b2efd-83b3-4b4f-a589-0d8b5c9d2c5a None None] MFA Rules not processed for user `a0ee2ee12b204c4c8ddc3747b20163c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:24:28.814327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3f4b2efd-83b3-4b4f-a589-0d8b5c9d2c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:24:28.896927 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 744/1502] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:24:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:24:28.910839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556ced7-d293-46ae-9d2d-7fc752ec05b7 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:24:28.911124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556ced7-d293-46ae-9d2d-7fc752ec05b7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:24:28.911389 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556ced7-d293-46ae-9d2d-7fc752ec05b7 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:24:28.912804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 759/1503] 10.222.0.26 () {54 vars in 963 bytes} [Tue Jul 12 03:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:24:28.917742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86155a-4257-4f39-8560-d0d28885e379 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:24:28.918024 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86155a-4257-4f39-8560-d0d28885e379 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:24:28.918296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86155a-4257-4f39-8560-d0d28885e379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:24:28.949886 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:24:29.117578 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-dd86155a-4257-4f39-8560-d0d28885e379 None None] MFA Rules not processed for user `99605c4dd01f48e39a3e29a74114506d`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:24:29.118724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-dd86155a-4257-4f39-8560-d0d28885e379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:24:29.205309 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 745/1504] 10.222.0.26 () {58 vars in 1060 bytes} [Tue Jul 12 03:24:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:24:29.213374 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556ced7-d293-46ae-9d2d-7fc752ec05b7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:24:29.214881 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7556ced7-d293-46ae-9d2d-7fc752ec05b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:24:29.267509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:24:29.322224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556ced7-d293-46ae-9d2d-7fc752ec05b7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:24:29.400354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979bbf9-26d0-4338-87e5-fd1af70210e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:24:29.400980 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979bbf9-26d0-4338-87e5-fd1af70210e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:24:29.401265 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979bbf9-26d0-4338-87e5-fd1af70210e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:24:29.401543 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979bbf9-26d0-4338-87e5-fd1af70210e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:24:29.403201 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4979bbf9-26d0-4338-87e5-fd1af70210e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:24:29.513851 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979bbf9-26d0-4338-87e5-fd1af70210e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:24:29.515361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979bbf9-26d0-4338-87e5-fd1af70210e5 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:24:29.518869 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:24:29.534233 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 760/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:24:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:24:29.576106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23567-4597-4d46-97ea-954e8febcd98 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:24:29.576664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23567-4597-4d46-97ea-954e8febcd98 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:24:29.576780 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23567-4597-4d46-97ea-954e8febcd98 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:24:29.578136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 746/1506] 10.222.0.26 () {52 vars in 829 bytes} [Tue Jul 12 03:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 03:24:29.581948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979bbf9-26d0-4338-87e5-fd1af70210e5 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:24:29.583160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4979bbf9-26d0-4338-87e5-fd1af70210e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:24:29.812087 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979bbf9-26d0-4338-87e5-fd1af70210e5 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:24:29.911580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46c822-af64-44a6-a065-cb6e5041eef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:24:29.912507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46c822-af64-44a6-a065-cb6e5041eef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:24:29.912895 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46c822-af64-44a6-a065-cb6e5041eef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:24:29.913153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46c822-af64-44a6-a065-cb6e5041eef3 admin admin] PATH_INFO: `/v3/users/a0ee2ee12b204c4c8ddc3747b20163c3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:24:29.926281 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46c822-af64-44a6-a065-cb6e5041eef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ee2ee12b204c4c8ddc3747b20163c3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:24:29.927341 dv-cinder-847730-4-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-7b46c822-af64-44a6-a065-cb6e5041eef3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:24:29.927341 dv-cinder-847730-4-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 12 03:24:29.927341 dv-cinder-847730-4-smb devstack@keystone.service[80398]: Jul 12 03:24:29.928556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46c822-af64-44a6-a065-cb6e5041eef3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:24:29.942110 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:24:30.009562 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7b46c822-af64-44a6-a065-cb6e5041eef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ee2ee12b204c4c8ddc3747b20163c3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:24:30.020177 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7b46c822-af64-44a6-a065-cb6e5041eef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ee2ee12b204c4c8ddc3747b20163c3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:24:30.033009 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7b46c822-af64-44a6-a065-cb6e5041eef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ee2ee12b204c4c8ddc3747b20163c3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:24:30.033449 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7b46c822-af64-44a6-a065-cb6e5041eef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ee2ee12b204c4c8ddc3747b20163c3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:24:30.053360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7b46c822-af64-44a6-a065-cb6e5041eef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ee2ee12b204c4c8ddc3747b20163c3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:24:30.059159 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 761/1507] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:24:29 2022] DELETE /identity/v3/users/a0ee2ee12b204c4c8ddc3747b20163c3 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:24:30.064226 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd95519-80ba-4377-87d3-12b436995ed4 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:24:30.064505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd95519-80ba-4377-87d3-12b436995ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:24:30.064807 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd95519-80ba-4377-87d3-12b436995ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:24:30.127048 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3cd95519-80ba-4377-87d3-12b436995ed4 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:24:30.128274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3cd95519-80ba-4377-87d3-12b436995ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:24:30.218588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:24:30.238879 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 747/1508] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:24:30.250941 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46c822-af64-44a6-a065-cb6e5041eef3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:24:30.252169 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7b46c822-af64-44a6-a065-cb6e5041eef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:24:30.366415 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46c822-af64-44a6-a065-cb6e5041eef3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:24:30.423656 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:24:30.445331 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fad261-222f-4273-b165-1f8e72f58bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:24:30.445995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fad261-222f-4273-b165-1f8e72f58bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:24:30.446267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fad261-222f-4273-b165-1f8e72f58bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:24:30.446538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fad261-222f-4273-b165-1f8e72f58bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:24:30.448177 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b3fad261-222f-4273-b165-1f8e72f58bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:24:30.564461 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fad261-222f-4273-b165-1f8e72f58bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:24:30.566014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fad261-222f-4273-b165-1f8e72f58bd6 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:24:30.588062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 762/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:24:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:24:30.949575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd95519-80ba-4377-87d3-12b436995ed4 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:24:30.950870 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3cd95519-80ba-4377-87d3-12b436995ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:24:30.963743 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd95519-80ba-4377-87d3-12b436995ed4 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:24:31.070233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beff633-690f-4e04-b0aa-ba9db93ad796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:24:31.071017 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beff633-690f-4e04-b0aa-ba9db93ad796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:24:31.071292 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beff633-690f-4e04-b0aa-ba9db93ad796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:24:31.071562 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beff633-690f-4e04-b0aa-ba9db93ad796 admin admin] PATH_INFO: `/v3/projects/3daaadc953004dacaf547468c4caeed7` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:24:31.082579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beff633-690f-4e04-b0aa-ba9db93ad796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3daaadc953004dacaf547468c4caeed7)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:24:31.083616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: WARNING py.warnings [None req-9beff633-690f-4e04-b0aa-ba9db93ad796 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:24:31.083616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: warnings.warn(msg) Jul 12 03:24:31.083616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: Jul 12 03:24:31.084849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beff633-690f-4e04-b0aa-ba9db93ad796 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:24:31.145555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9beff633-690f-4e04-b0aa-ba9db93ad796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3daaadc953004dacaf547468c4caeed7', 'request_id': 'req-9beff633-690f-4e04-b0aa-ba9db93ad796'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:24:31.158881 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9beff633-690f-4e04-b0aa-ba9db93ad796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3daaadc953004dacaf547468c4caeed7', 'request_id': 'req-9beff633-690f-4e04-b0aa-ba9db93ad796'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:24:31.165742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9beff633-690f-4e04-b0aa-ba9db93ad796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3daaadc953004dacaf547468c4caeed7', 'request_id': 'req-9beff633-690f-4e04-b0aa-ba9db93ad796'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:24:31.195016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9beff633-690f-4e04-b0aa-ba9db93ad796 admin admin] The token cache is being invalidate because project 3daaadc953004dacaf547468c4caeed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:24:31.195304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9beff633-690f-4e04-b0aa-ba9db93ad796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:24:31.195845 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9beff633-690f-4e04-b0aa-ba9db93ad796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:24:31.197293 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 748/1510] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:24:30 2022] DELETE /identity/v3/projects/3daaadc953004dacaf547468c4caeed7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:24:40.585510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=62 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:24:41.193003 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:26:15.012154 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846bc23-7ef6-40ff-a932-3de0ea14a3e5 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:15.012781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846bc23-7ef6-40ff-a932-3de0ea14a3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:15.012781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846bc23-7ef6-40ff-a932-3de0ea14a3e5 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:15.014207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 763/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 03:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:26:15.020365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95f2c7-be18-4db9-b6e8-95bbdf15e848 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:15.021191 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95f2c7-be18-4db9-b6e8-95bbdf15e848 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:15.021335 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95f2c7-be18-4db9-b6e8-95bbdf15e848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:15.116670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-fe95f2c7-be18-4db9-b6e8-95bbdf15e848 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:26:15.117860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fe95f2c7-be18-4db9-b6e8-95bbdf15e848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:26:15.231754 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 749/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 03:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:26:15.390736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846bc23-7ef6-40ff-a932-3de0ea14a3e5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:26:15.392897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f846bc23-7ef6-40ff-a932-3de0ea14a3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:26:15.526193 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846bc23-7ef6-40ff-a932-3de0ea14a3e5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:26:15.532752 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085a5be-4ed3-42ce-b570-b9f9c24ebada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:26:15.533394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085a5be-4ed3-42ce-b570-b9f9c24ebada service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:15.533677 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085a5be-4ed3-42ce-b570-b9f9c24ebada service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:15.533951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085a5be-4ed3-42ce-b570-b9f9c24ebada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:15.542639 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085a5be-4ed3-42ce-b570-b9f9c24ebada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:26:15.544352 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085a5be-4ed3-42ce-b570-b9f9c24ebada service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:26:15.554598 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 764/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:26:16.387195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a4fb1-6275-4fc9-a8c6-6a8179d538de None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:16.388140 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a4fb1-6275-4fc9-a8c6-6a8179d538de None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:16.388140 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a4fb1-6275-4fc9-a8c6-6a8179d538de None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:16.390437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 750/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 03:26:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:26:16.398659 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b7947-556e-482d-8218-d6ead8fa3423 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:16.399718 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b7947-556e-482d-8218-d6ead8fa3423 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:16.399718 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b7947-556e-482d-8218-d6ead8fa3423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:16.421163 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5d5b7947-556e-482d-8218-d6ead8fa3423 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:26:16.422358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5d5b7947-556e-482d-8218-d6ead8fa3423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:26:16.432155 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 765/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 03:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:26:16.587586 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a4fb1-6275-4fc9-a8c6-6a8179d538de None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:26:16.612222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a4fb1-6275-4fc9-a8c6-6a8179d538de None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:26:16.618998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b654e60-ba1e-4f8b-ace7-54f03856809d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:26:16.619637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b654e60-ba1e-4f8b-ace7-54f03856809d service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:16.619916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b654e60-ba1e-4f8b-ace7-54f03856809d service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:16.620187 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b654e60-ba1e-4f8b-ace7-54f03856809d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:16.629375 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b654e60-ba1e-4f8b-ace7-54f03856809d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:26:16.630995 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b654e60-ba1e-4f8b-ace7-54f03856809d service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:26:16.642218 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 751/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:26:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:26:17.082680 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26894f7-49f1-4505-988a-e77d5bf47b62 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:17.082931 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26894f7-49f1-4505-988a-e77d5bf47b62 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:17.083236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26894f7-49f1-4505-988a-e77d5bf47b62 None None] PATH_INFO: `/v3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:17.084739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 766/1517] 10.222.0.30 () {54 vars in 925 bytes} [Tue Jul 12 03:26:17 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:26:17.092056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc3986-324e-4d67-86ac-a08ff981b02d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:17.092342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc3986-324e-4d67-86ac-a08ff981b02d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:17.092666 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc3986-324e-4d67-86ac-a08ff981b02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:17.154058 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-86cc3986-324e-4d67-86ac-a08ff981b02d None None] MFA Rules not processed for user `361ad35021eb43cca46d9b66e6f24ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:26:17.155250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-86cc3986-324e-4d67-86ac-a08ff981b02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:26:17.180728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:26:17.242927 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 752/1518] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Jul 12 03:26:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:26:21.138984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac729c3-7428-4901-9430-6c3ad73c3df6 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:21.139548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac729c3-7428-4901-9430-6c3ad73c3df6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:21.139548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac729c3-7428-4901-9430-6c3ad73c3df6 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:21.140940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 767/1519] 10.222.0.26 () {54 vars in 960 bytes} [Tue Jul 12 03:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:26:21.147333 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80900d96-fc9d-477e-a1e9-528726e69bc8 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:21.148044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80900d96-fc9d-477e-a1e9-528726e69bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:21.148156 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80900d96-fc9d-477e-a1e9-528726e69bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:21.177733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-80900d96-fc9d-477e-a1e9-528726e69bc8 None None] MFA Rules not processed for user `361ad35021eb43cca46d9b66e6f24ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:26:21.178932 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-80900d96-fc9d-477e-a1e9-528726e69bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:26:21.189336 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 753/1520] 10.222.0.26 () {58 vars in 1057 bytes} [Tue Jul 12 03:26:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:26:21.197583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac729c3-7428-4901-9430-6c3ad73c3df6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:26:21.215139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac729c3-7428-4901-9430-6c3ad73c3df6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:26:21.221111 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3345f-3df9-428c-a061-1aa8319117cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '361ad35021eb43cca46d9b66e6f24ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:26:21.221815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3345f-3df9-428c-a061-1aa8319117cb service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:21.222093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3345f-3df9-428c-a061-1aa8319117cb service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:21.222357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3345f-3df9-428c-a061-1aa8319117cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:21.231290 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3345f-3df9-428c-a061-1aa8319117cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:26:21.232896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3345f-3df9-428c-a061-1aa8319117cb service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:26:21.243290 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 768/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:26:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:26:27.881057 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b87d0-b32c-4574-b612-fcec4d96a011 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:27.881620 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b87d0-b32c-4574-b612-fcec4d96a011 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:27.881620 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b87d0-b32c-4574-b612-fcec4d96a011 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:27.882970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 03:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:26:27.889056 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c802d-cfc5-4ef8-8a23-01ec5e83b664 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:27.889790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c802d-cfc5-4ef8-8a23-01ec5e83b664 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:27.889978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c802d-cfc5-4ef8-8a23-01ec5e83b664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:27.911970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b17c802d-cfc5-4ef8-8a23-01ec5e83b664 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:26:27.913187 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b17c802d-cfc5-4ef8-8a23-01ec5e83b664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:26:27.922876 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 03:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:26:28.088024 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b87d0-b32c-4574-b612-fcec4d96a011 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:26:28.103011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b87d0-b32c-4574-b612-fcec4d96a011 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:26:28.108244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218743a6-8234-495e-88f8-e40b6044187e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:26:28.108907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218743a6-8234-495e-88f8-e40b6044187e service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:28.109188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218743a6-8234-495e-88f8-e40b6044187e service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:28.109460 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218743a6-8234-495e-88f8-e40b6044187e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:28.117531 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218743a6-8234-495e-88f8-e40b6044187e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:26:28.119118 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218743a6-8234-495e-88f8-e40b6044187e service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:26:28.128657 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 755/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:26:28.969053 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee99d2-8ac0-4ae5-90e2-24d4a9d692ad None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:28.969872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee99d2-8ac0-4ae5-90e2-24d4a9d692ad None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:28.969872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee99d2-8ac0-4ae5-90e2-24d4a9d692ad None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:28.971627 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 770/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 03:26:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:26:28.977129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7c82-7508-48fc-8cda-94a708e5ad00 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:28.977559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7c82-7508-48fc-8cda-94a708e5ad00 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:28.977679 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7c82-7508-48fc-8cda-94a708e5ad00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:28.998065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-499c7c82-7508-48fc-8cda-94a708e5ad00 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:26:28.999265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-499c7c82-7508-48fc-8cda-94a708e5ad00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:26:29.008448 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 756/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 03:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:26:29.158807 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee99d2-8ac0-4ae5-90e2-24d4a9d692ad None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:26:29.180181 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee99d2-8ac0-4ae5-90e2-24d4a9d692ad None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:26:29.186328 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eff953-a297-4f9d-b5a1-a5bb198179f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:26:29.186970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eff953-a297-4f9d-b5a1-a5bb198179f5 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:29.187252 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eff953-a297-4f9d-b5a1-a5bb198179f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:29.187525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eff953-a297-4f9d-b5a1-a5bb198179f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:29.196198 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eff953-a297-4f9d-b5a1-a5bb198179f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:26:29.197822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eff953-a297-4f9d-b5a1-a5bb198179f5 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:26:29.207640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 771/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:26:33.069047 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9e7a4-bf54-4dec-a3c5-b587765bdae9 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:33.069955 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9e7a4-bf54-4dec-a3c5-b587765bdae9 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:33.069955 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9e7a4-bf54-4dec-a3c5-b587765bdae9 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:33.072073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 03:26:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:26:33.077461 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8edc8e-fda4-4c3f-8282-88c59d3f27b5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:33.077919 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8edc8e-fda4-4c3f-8282-88c59d3f27b5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:33.078014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8edc8e-fda4-4c3f-8282-88c59d3f27b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:33.096603 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5f8edc8e-fda4-4c3f-8282-88c59d3f27b5 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:26:33.098129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5f8edc8e-fda4-4c3f-8282-88c59d3f27b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:26:33.106501 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 03:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:26:33.180678 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9e7a4-bf54-4dec-a3c5-b587765bdae9 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:26:33.182952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-01f9e7a4-bf54-4dec-a3c5-b587765bdae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:26:33.280008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9e7a4-bf54-4dec-a3c5-b587765bdae9 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:26:33.284151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13170f7-e5e3-42d3-bcb6-667003aa2054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:26:33.284831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13170f7-e5e3-42d3-bcb6-667003aa2054 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:33.285114 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13170f7-e5e3-42d3-bcb6-667003aa2054 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:33.285384 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13170f7-e5e3-42d3-bcb6-667003aa2054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:33.295228 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13170f7-e5e3-42d3-bcb6-667003aa2054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:26:33.296714 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13170f7-e5e3-42d3-bcb6-667003aa2054 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:26:33.306729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 758/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:26:35.280657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5850a90-6ed1-4d02-8616-7ccdb2536144 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:35.281160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5850a90-6ed1-4d02-8616-7ccdb2536144 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:35.281160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5850a90-6ed1-4d02-8616-7ccdb2536144 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:35.282583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 03:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:26:35.288968 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8842480-2672-4e1d-9bf6-a84cda62c91f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:35.289604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8842480-2672-4e1d-9bf6-a84cda62c91f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:35.289717 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8842480-2672-4e1d-9bf6-a84cda62c91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:35.310180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f8842480-2672-4e1d-9bf6-a84cda62c91f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:26:35.311357 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f8842480-2672-4e1d-9bf6-a84cda62c91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:26:35.319847 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 03:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:26:35.355835 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5850a90-6ed1-4d02-8616-7ccdb2536144 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:26:35.357812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d5850a90-6ed1-4d02-8616-7ccdb2536144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:26:35.372992 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5850a90-6ed1-4d02-8616-7ccdb2536144 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:26:35.377265 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e9544-8820-4b5e-bc6f-f3558533969a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:26:35.377905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e9544-8820-4b5e-bc6f-f3558533969a service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:35.378186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e9544-8820-4b5e-bc6f-f3558533969a service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:35.378461 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e9544-8820-4b5e-bc6f-f3558533969a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:35.388135 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e9544-8820-4b5e-bc6f-f3558533969a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:26:35.389633 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e9544-8820-4b5e-bc6f-f3558533969a service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:26:35.399681 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 774/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:26:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:26:38.937550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c60b2-1af5-494d-88c3-1fcb79d5bac1 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:38.938549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c60b2-1af5-494d-88c3-1fcb79d5bac1 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:38.938549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c60b2-1af5-494d-88c3-1fcb79d5bac1 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:38.940874 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 03:26:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:26:38.948921 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2413f9-7f28-49e3-8c52-fb5dc2e19fec None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:38.949716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2413f9-7f28-49e3-8c52-fb5dc2e19fec None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:38.949877 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2413f9-7f28-49e3-8c52-fb5dc2e19fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:38.973166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5d2413f9-7f28-49e3-8c52-fb5dc2e19fec None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:26:38.974300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5d2413f9-7f28-49e3-8c52-fb5dc2e19fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:26:38.983558 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 03:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:26:39.285326 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c60b2-1af5-494d-88c3-1fcb79d5bac1 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:26:39.287433 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b47c60b2-1af5-494d-88c3-1fcb79d5bac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:26:39.355647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:26:39.370856 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c60b2-1af5-494d-88c3-1fcb79d5bac1 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:26:39.374691 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca442c23-a98e-4a05-b18c-db1473e26f62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:26:39.375325 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca442c23-a98e-4a05-b18c-db1473e26f62 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:39.375606 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca442c23-a98e-4a05-b18c-db1473e26f62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:39.375882 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca442c23-a98e-4a05-b18c-db1473e26f62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:39.385505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca442c23-a98e-4a05-b18c-db1473e26f62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:26:39.386941 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca442c23-a98e-4a05-b18c-db1473e26f62 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:26:39.396512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 761/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:26:41.447125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce95af7-406c-413e-9f2e-0b5804384d07 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:41.448084 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce95af7-406c-413e-9f2e-0b5804384d07 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:41.448084 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce95af7-406c-413e-9f2e-0b5804384d07 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:41.450245 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 03:26:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:26:41.458949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164d16a-cd1b-4a84-b0bf-12f9781765b0 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:41.459404 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164d16a-cd1b-4a84-b0bf-12f9781765b0 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:41.459596 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164d16a-cd1b-4a84-b0bf-12f9781765b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:41.487915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3164d16a-cd1b-4a84-b0bf-12f9781765b0 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:26:41.489142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3164d16a-cd1b-4a84-b0bf-12f9781765b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:26:41.497879 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 03:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:26:41.803773 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce95af7-406c-413e-9f2e-0b5804384d07 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:26:41.805750 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8ce95af7-406c-413e-9f2e-0b5804384d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:26:41.814273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=84 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:26:41.821353 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce95af7-406c-413e-9f2e-0b5804384d07 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:26:41.828178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4accea4-e7ff-4add-8818-c166e1b8b9fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:26:41.829225 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4accea4-e7ff-4add-8818-c166e1b8b9fb service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:26:41.829634 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4accea4-e7ff-4add-8818-c166e1b8b9fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:26:41.830626 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4accea4-e7ff-4add-8818-c166e1b8b9fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:26:41.846077 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4accea4-e7ff-4add-8818-c166e1b8b9fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:26:41.847830 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4accea4-e7ff-4add-8818-c166e1b8b9fb service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:26:41.857734 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 777/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:26:51.482608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=11 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:26:51.853399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:13.947601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9906a-0607-4b73-86a6-3696bc98c496 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:13.948311 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9906a-0607-4b73-86a6-3696bc98c496 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:13.948311 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9906a-0607-4b73-86a6-3696bc98c496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:13.976083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-fba9906a-0607-4b73-86a6-3696bc98c496 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:13.977314 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fba9906a-0607-4b73-86a6-3696bc98c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:13.988778 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 763/1540] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:13.993185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3baca0-e079-45bd-a2b4-e2262fa4f7aa None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:13.994177 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3baca0-e079-45bd-a2b4-e2262fa4f7aa None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:13.994679 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3baca0-e079-45bd-a2b4-e2262fa4f7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:13.997919 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea19b90-ea23-48d7-8ac2-76659a5a363d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:13.998215 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea19b90-ea23-48d7-8ac2-76659a5a363d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:13.998499 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea19b90-ea23-48d7-8ac2-76659a5a363d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.022741 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9ea19b90-ea23-48d7-8ac2-76659a5a363d None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:14.023885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9ea19b90-ea23-48d7-8ac2-76659a5a363d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:14.024577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ac3baca0-e079-45bd-a2b4-e2262fa4f7aa None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:14.025978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ac3baca0-e079-45bd-a2b4-e2262fa4f7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:14.037240 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 764/1541] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:14.042024 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea19b90-ea23-48d7-8ac2-76659a5a363d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:14.044961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 778/1542] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:14.054433 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e154323-4d49-4b2f-9d76-b6f666b4e7db None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.055059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e154323-4d49-4b2f-9d76-b6f666b4e7db None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.055960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e154323-4d49-4b2f-9d76-b6f666b4e7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.058870 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea19b90-ea23-48d7-8ac2-76659a5a363d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:14.072614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e374389-f2aa-477a-9840-a1ff6793e5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:14.072614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e374389-f2aa-477a-9840-a1ff6793e5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.072614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e374389-f2aa-477a-9840-a1ff6793e5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.072614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e374389-f2aa-477a-9840-a1ff6793e5a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.073207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e374389-f2aa-477a-9840-a1ff6793e5a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:28:14.073207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e374389-f2aa-477a-9840-a1ff6793e5a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:14.073207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e374389-f2aa-477a-9840-a1ff6793e5a1 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:14.093951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3e154323-4d49-4b2f-9d76-b6f666b4e7db None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:14.095955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3e154323-4d49-4b2f-9d76-b6f666b4e7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:14.100093 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 765/1543] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:28:14.109252 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e374389-f2aa-477a-9840-a1ff6793e5a1 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:14.116730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 779/1544] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:28:14.121989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e154323-4d49-4b2f-9d76-b6f666b4e7db None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:14.129440 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e374389-f2aa-477a-9840-a1ff6793e5a1 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:14.135511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e154323-4d49-4b2f-9d76-b6f666b4e7db None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:14.135670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666180a-a910-48f3-8fc5-e0a444643135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:14.135670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666180a-a910-48f3-8fc5-e0a444643135 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.135670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666180a-a910-48f3-8fc5-e0a444643135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.135670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666180a-a910-48f3-8fc5-e0a444643135 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.136181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666180a-a910-48f3-8fc5-e0a444643135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:14.147854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: WARNING py.warnings [None req-e666180a-a910-48f3-8fc5-e0a444643135 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:28:14.147854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: warnings.warn(msg) Jul 12 03:28:14.147854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: Jul 12 03:28:14.149164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666180a-a910-48f3-8fc5-e0a444643135 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:14.158268 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b773900-d0df-4497-aa16-6e14c77ed10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:14.159259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b773900-d0df-4497-aa16-6e14c77ed10b admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.159748 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b773900-d0df-4497-aa16-6e14c77ed10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.160228 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b773900-d0df-4497-aa16-6e14c77ed10b admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.161358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b773900-d0df-4497-aa16-6e14c77ed10b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:28:14.162023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b773900-d0df-4497-aa16-6e14c77ed10b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:14.163324 dv-cinder-847730-4-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-2b773900-d0df-4497-aa16-6e14c77ed10b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:28:14.163324 dv-cinder-847730-4-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 12 03:28:14.163324 dv-cinder-847730-4-smb devstack@keystone.service[80398]: Jul 12 03:28:14.164589 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b773900-d0df-4497-aa16-6e14c77ed10b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:14.182004 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 780/1545] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:28:14.190016 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b773900-d0df-4497-aa16-6e14c77ed10b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:14.205890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b773900-d0df-4497-aa16-6e14c77ed10b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:14.215185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 766/1546] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:14 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:28:14.219422 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666180a-a910-48f3-8fc5-e0a444643135 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:14.220122 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c981429-6cbd-438f-9db9-d8c87bc2fda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:14.221074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c981429-6cbd-438f-9db9-d8c87bc2fda8 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.221908 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c981429-6cbd-438f-9db9-d8c87bc2fda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.222383 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c981429-6cbd-438f-9db9-d8c87bc2fda8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.223481 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c981429-6cbd-438f-9db9-d8c87bc2fda8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:14.226442 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c981429-6cbd-438f-9db9-d8c87bc2fda8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:14.273366 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 781/1547] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:14 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:28:14.277585 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c981429-6cbd-438f-9db9-d8c87bc2fda8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:14.332268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666180a-a910-48f3-8fc5-e0a444643135 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:14.415574 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c981429-6cbd-438f-9db9-d8c87bc2fda8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:14.428505 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b4174-20df-4b4b-b1b4-6c59f714c329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:14.429874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b4174-20df-4b4b-b1b4-6c59f714c329 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.430584 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b4174-20df-4b4b-b1b4-6c59f714c329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.431192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b4174-20df-4b4b-b1b4-6c59f714c329 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.432283 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b4174-20df-4b4b-b1b4-6c59f714c329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:14.434173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-501b4174-20df-4b4b-b1b4-6c59f714c329 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:28:14.434173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 12 03:28:14.434173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: Jul 12 03:28:14.435746 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b4174-20df-4b4b-b1b4-6c59f714c329 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:14.436121 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6264a9f-952f-4293-8d85-db7e56983eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:14.436840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6264a9f-952f-4293-8d85-db7e56983eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.437122 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6264a9f-952f-4293-8d85-db7e56983eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.437392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6264a9f-952f-4293-8d85-db7e56983eb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.438085 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6264a9f-952f-4293-8d85-db7e56983eb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:14.440007 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6264a9f-952f-4293-8d85-db7e56983eb9 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:14.470790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 782/1548] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:14 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:14.476940 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 767/1549] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:14 2022] POST /identity/v3/users => generated 287 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:14.477423 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4cb81-88f8-41a5-a9fb-39e5116c6543 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.477926 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4cb81-88f8-41a5-a9fb-39e5116c6543 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.478251 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6264a9f-952f-4293-8d85-db7e56983eb9 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:14.478804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4cb81-88f8-41a5-a9fb-39e5116c6543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.495539 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6264a9f-952f-4293-8d85-db7e56983eb9 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:14.505962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-55b4cb81-88f8-41a5-a9fb-39e5116c6543 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:14.507498 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-55b4cb81-88f8-41a5-a9fb-39e5116c6543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:14.522328 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aae2db-80ee-4014-8232-8638781c2a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:14.523146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aae2db-80ee-4014-8232-8638781c2a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.523437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aae2db-80ee-4014-8232-8638781c2a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.523713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aae2db-80ee-4014-8232-8638781c2a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.524462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aae2db-80ee-4014-8232-8638781c2a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:14.526132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aae2db-80ee-4014-8232-8638781c2a7d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:14.534392 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 783/1550] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:14.535036 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4cb81-88f8-41a5-a9fb-39e5116c6543 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:14.539366 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 768/1551] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:14.540729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac857f24-ee7b-4014-9681-5c7e45ce8cca None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.541021 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac857f24-ee7b-4014-9681-5c7e45ce8cca None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.541298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac857f24-ee7b-4014-9681-5c7e45ce8cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.556367 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4cb81-88f8-41a5-a9fb-39e5116c6543 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:14.563740 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90081ec9-c873-48ca-b02c-209b5d263c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:14.564880 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90081ec9-c873-48ca-b02c-209b5d263c0e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.565386 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90081ec9-c873-48ca-b02c-209b5d263c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.565882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90081ec9-c873-48ca-b02c-209b5d263c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.567022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90081ec9-c873-48ca-b02c-209b5d263c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:14.569330 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90081ec9-c873-48ca-b02c-209b5d263c0e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:14.580125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ac857f24-ee7b-4014-9681-5c7e45ce8cca None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:14.581781 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ac857f24-ee7b-4014-9681-5c7e45ce8cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:14.582083 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 784/1552] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:14.583634 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6347020-9b64-4f81-8263-10df27adf585 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.583923 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6347020-9b64-4f81-8263-10df27adf585 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.587022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6347020-9b64-4f81-8263-10df27adf585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.603622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 769/1553] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:14.604999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac857f24-ee7b-4014-9681-5c7e45ce8cca None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:14.613725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e6347020-9b64-4f81-8263-10df27adf585 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:14.615006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e6347020-9b64-4f81-8263-10df27adf585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:14.617400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac857f24-ee7b-4014-9681-5c7e45ce8cca None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:14.622146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99164e50-679f-436e-a98a-f7a597e7b036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:14.622838 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99164e50-679f-436e-a98a-f7a597e7b036 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.623118 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99164e50-679f-436e-a98a-f7a597e7b036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.623393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99164e50-679f-436e-a98a-f7a597e7b036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.624094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 785/1554] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:14.624291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99164e50-679f-436e-a98a-f7a597e7b036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:14.629144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456801e-5d3b-4bf2-b01e-5bb346b1f871 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.629144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456801e-5d3b-4bf2-b01e-5bb346b1f871 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.629368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99164e50-679f-436e-a98a-f7a597e7b036 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:14.629454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456801e-5d3b-4bf2-b01e-5bb346b1f871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.637026 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 770/1555] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:14.641331 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b9d01-8d89-4478-9bb3-d6be3f061eb7 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.641627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b9d01-8d89-4478-9bb3-d6be3f061eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.641891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b9d01-8d89-4478-9bb3-d6be3f061eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.649654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2456801e-5d3b-4bf2-b01e-5bb346b1f871 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:14.650751 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2456801e-5d3b-4bf2-b01e-5bb346b1f871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:14.659638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 786/1556] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:14.661311 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-df7b9d01-8d89-4478-9bb3-d6be3f061eb7 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:14.662501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-df7b9d01-8d89-4478-9bb3-d6be3f061eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:14.663941 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456801e-5d3b-4bf2-b01e-5bb346b1f871 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:14.676549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 771/1557] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:14.676549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488110d5-e67f-45f3-aa11-97f615999314 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.676549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488110d5-e67f-45f3-aa11-97f615999314 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.676549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488110d5-e67f-45f3-aa11-97f615999314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.689224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456801e-5d3b-4bf2-b01e-5bb346b1f871 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:14.693169 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:14.697804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab69a6-07e7-47a3-9778-6fa3044fa300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:14.698494 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab69a6-07e7-47a3-9778-6fa3044fa300 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.698777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab69a6-07e7-47a3-9778-6fa3044fa300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.699049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab69a6-07e7-47a3-9778-6fa3044fa300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.699873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab69a6-07e7-47a3-9778-6fa3044fa300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:14.701537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab69a6-07e7-47a3-9778-6fa3044fa300 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:14.703220 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-488110d5-e67f-45f3-aa11-97f615999314 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:14.704804 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-488110d5-e67f-45f3-aa11-97f615999314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:14.714378 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 772/1558] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:14.715662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 787/1559] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:14.717247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60535d58-9108-4298-9729-fd5413b702df None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.717812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60535d58-9108-4298-9729-fd5413b702df None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.718396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60535d58-9108-4298-9729-fd5413b702df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.719385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b685b-b780-4f93-9720-a22db9bbaebd None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.719719 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b685b-b780-4f93-9720-a22db9bbaebd None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.720157 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b685b-b780-4f93-9720-a22db9bbaebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.737455 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-60535d58-9108-4298-9729-fd5413b702df None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:14.738665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-60535d58-9108-4298-9729-fd5413b702df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:14.741206 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ef4b685b-b780-4f93-9720-a22db9bbaebd None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:14.742380 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ef4b685b-b780-4f93-9720-a22db9bbaebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:14.747140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 788/1560] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:14.748138 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60535d58-9108-4298-9729-fd5413b702df None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:14.755181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 773/1561] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:14.756069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b685b-b780-4f93-9720-a22db9bbaebd None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:14.766329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b685b-b780-4f93-9720-a22db9bbaebd None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:14.767532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60535d58-9108-4298-9729-fd5413b702df None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:14.770964 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928339a3-52ce-48cd-9c35-4384866bc822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:14.771616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928339a3-52ce-48cd-9c35-4384866bc822 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.771890 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928339a3-52ce-48cd-9c35-4384866bc822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.772159 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928339a3-52ce-48cd-9c35-4384866bc822 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.772779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c6a29-066f-4634-9ae8-d0f6624da378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:14.772898 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928339a3-52ce-48cd-9c35-4384866bc822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:28:14.773203 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928339a3-52ce-48cd-9c35-4384866bc822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:14.773671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c6a29-066f-4634-9ae8-d0f6624da378 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.773958 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c6a29-066f-4634-9ae8-d0f6624da378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.774218 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c6a29-066f-4634-9ae8-d0f6624da378 admin admin] PATH_INFO: `/v3/projects/96f5b55d00a9462a8da10f95ff58bf9a/users/64d12add4bcf4da08cd5e8d68e13c3a6/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.774785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928339a3-52ce-48cd-9c35-4384866bc822 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:14.788612 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 774/1562] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:28:14.789903 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815050a4-2e1c-496d-a4bc-d64063397715 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.790185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815050a4-2e1c-496d-a4bc-d64063397715 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.790455 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815050a4-2e1c-496d-a4bc-d64063397715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.800063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c6a29-066f-4634-9ae8-d0f6624da378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f5b55d00a9462a8da10f95ff58bf9a, user_id=64d12add4bcf4da08cd5e8d68e13c3a6, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:14.804180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c6a29-066f-4634-9ae8-d0f6624da378 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:14.808851 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-815050a4-2e1c-496d-a4bc-d64063397715 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:14.810245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-815050a4-2e1c-496d-a4bc-d64063397715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:14.818253 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 789/1563] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:14 2022] PUT /identity/v3/projects/96f5b55d00a9462a8da10f95ff58bf9a/users/64d12add4bcf4da08cd5e8d68e13c3a6/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:14.822695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c6a29-066f-4634-9ae8-d0f6624da378 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:14.853765 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:14.871409 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 775/1564] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:14.872218 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815050a4-2e1c-496d-a4bc-d64063397715 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:14.882068 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815050a4-2e1c-496d-a4bc-d64063397715 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:14.887098 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4f75f-18bc-414b-a8f2-22f0a08ca25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:14.888051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4f75f-18bc-414b-a8f2-22f0a08ca25e admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.888331 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4f75f-18bc-414b-a8f2-22f0a08ca25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.888639 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c6a29-066f-4634-9ae8-d0f6624da378 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:14.888762 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4f75f-18bc-414b-a8f2-22f0a08ca25e admin admin] PATH_INFO: `/v3/projects/2015d437f55a4bba86e20eb8414fd30b/users/a2174ff764674e46abba60e181e39dd8/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.893933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a4980-5acf-42e3-9b19-28b7a63c135d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:14.894601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a4980-5acf-42e3-9b19-28b7a63c135d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.894886 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a4980-5acf-42e3-9b19-28b7a63c135d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.895164 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a4980-5acf-42e3-9b19-28b7a63c135d admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.895987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a4980-5acf-42e3-9b19-28b7a63c135d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:28:14.896292 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a4980-5acf-42e3-9b19-28b7a63c135d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:14.898138 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a4980-5acf-42e3-9b19-28b7a63c135d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:14.903300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4f75f-18bc-414b-a8f2-22f0a08ca25e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2015d437f55a4bba86e20eb8414fd30b, user_id=a2174ff764674e46abba60e181e39dd8, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:14.904336 dv-cinder-847730-4-smb devstack@keystone.service[80397]: WARNING py.warnings [None req-23b4f75f-18bc-414b-a8f2-22f0a08ca25e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:28:14.904336 dv-cinder-847730-4-smb devstack@keystone.service[80397]: warnings.warn(msg) Jul 12 03:28:14.904336 dv-cinder-847730-4-smb devstack@keystone.service[80397]: Jul 12 03:28:14.906285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4f75f-18bc-414b-a8f2-22f0a08ca25e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:14.910011 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 790/1565] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:28:14.910803 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a4980-5acf-42e3-9b19-28b7a63c135d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:14.920856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a4980-5acf-42e3-9b19-28b7a63c135d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:14.926505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 776/1566] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:14 2022] PUT /identity/v3/projects/2015d437f55a4bba86e20eb8414fd30b/users/a2174ff764674e46abba60e181e39dd8/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:14.928488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d96b1-f43b-417e-ae4a-1de1ea734161 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.928846 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d96b1-f43b-417e-ae4a-1de1ea734161 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.929134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d96b1-f43b-417e-ae4a-1de1ea734161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.955078 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-194d96b1-f43b-417e-ae4a-1de1ea734161 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:14.956341 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-194d96b1-f43b-417e-ae4a-1de1ea734161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:14.979488 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8479d-e28c-4263-86ed-f642f970c166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:14.980156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8479d-e28c-4263-86ed-f642f970c166 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.980437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8479d-e28c-4263-86ed-f642f970c166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.980747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8479d-e28c-4263-86ed-f642f970c166 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:14.981484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8479d-e28c-4263-86ed-f642f970c166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:28:14.981787 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8479d-e28c-4263-86ed-f642f970c166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:14.983392 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8479d-e28c-4263-86ed-f642f970c166 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:14.997109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 791/1567] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:28:14.998312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd01d3-828a-4746-9de3-5b44de269c93 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:14.998595 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd01d3-828a-4746-9de3-5b44de269c93 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:14.998871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd01d3-828a-4746-9de3-5b44de269c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.016991 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d4cd01d3-828a-4746-9de3-5b44de269c93 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:15.018181 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d4cd01d3-828a-4746-9de3-5b44de269c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:15.021744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 777/1568] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:15.022566 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d96b1-f43b-417e-ae4a-1de1ea734161 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.032588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 792/1569] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:15.032588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880165de-fe78-443f-ada0-cb2735e8ed6d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.032588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880165de-fe78-443f-ada0-cb2735e8ed6d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.032588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880165de-fe78-443f-ada0-cb2735e8ed6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.033203 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d96b1-f43b-417e-ae4a-1de1ea734161 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.038167 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb292e-79b1-4005-9aa4-c0fca1e2e898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.038798 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb292e-79b1-4005-9aa4-c0fca1e2e898 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.039076 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb292e-79b1-4005-9aa4-c0fca1e2e898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.039363 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb292e-79b1-4005-9aa4-c0fca1e2e898 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.040056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb292e-79b1-4005-9aa4-c0fca1e2e898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.042007 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb292e-79b1-4005-9aa4-c0fca1e2e898 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.049695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-880165de-fe78-443f-ada0-cb2735e8ed6d None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:15.051082 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-880165de-fe78-443f-ada0-cb2735e8ed6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:15.060067 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 793/1570] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:15.060973 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880165de-fe78-443f-ada0-cb2735e8ed6d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.072957 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880165de-fe78-443f-ada0-cb2735e8ed6d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.078426 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 778/1571] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:15 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:15.078426 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb292e-79b1-4005-9aa4-c0fca1e2e898 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.111391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:15.133623 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff511f-5a39-4e44-8a01-702a5529c164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.134369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff511f-5a39-4e44-8a01-702a5529c164 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.134657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff511f-5a39-4e44-8a01-702a5529c164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.134924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff511f-5a39-4e44-8a01-702a5529c164 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.135693 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff511f-5a39-4e44-8a01-702a5529c164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:28:15.136016 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff511f-5a39-4e44-8a01-702a5529c164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.137885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff511f-5a39-4e44-8a01-702a5529c164 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.141694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb292e-79b1-4005-9aa4-c0fca1e2e898 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.147783 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a766d5-2bd6-4ab4-8654-4a332ac39718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.148506 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a766d5-2bd6-4ab4-8654-4a332ac39718 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.148803 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a766d5-2bd6-4ab4-8654-4a332ac39718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.149082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a766d5-2bd6-4ab4-8654-4a332ac39718 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.149841 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a766d5-2bd6-4ab4-8654-4a332ac39718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.158405 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 794/1572] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:28:15.158602 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a766d5-2bd6-4ab4-8654-4a332ac39718 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.158704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72833a0a-1629-4247-a3f5-2647a1881d15 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.158704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72833a0a-1629-4247-a3f5-2647a1881d15 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.158704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72833a0a-1629-4247-a3f5-2647a1881d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.181715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-72833a0a-1629-4247-a3f5-2647a1881d15 None None] MFA Rules not processed for user `a2174ff764674e46abba60e181e39dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:15.183207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-72833a0a-1629-4247-a3f5-2647a1881d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:15.184927 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 779/1573] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:15 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:15.185948 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a766d5-2bd6-4ab4-8654-4a332ac39718 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.212526 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:15.247421 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a766d5-2bd6-4ab4-8654-4a332ac39718 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.251933 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc52b5-2f75-4171-b099-5566e1804587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.252085 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 795/1574] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:15.252620 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc52b5-2f75-4171-b099-5566e1804587 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.252862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72833a0a-1629-4247-a3f5-2647a1881d15 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.252981 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc52b5-2f75-4171-b099-5566e1804587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.253229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc52b5-2f75-4171-b099-5566e1804587 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.253849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc52b5-2f75-4171-b099-5566e1804587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.255925 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc52b5-2f75-4171-b099-5566e1804587 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.263495 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72833a0a-1629-4247-a3f5-2647a1881d15 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.268233 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdca1d-412e-4171-92da-e1297f22a4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.268921 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdca1d-412e-4171-92da-e1297f22a4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.269199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdca1d-412e-4171-92da-e1297f22a4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.269472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdca1d-412e-4171-92da-e1297f22a4b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.270294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdca1d-412e-4171-92da-e1297f22a4b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:28:15.270601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdca1d-412e-4171-92da-e1297f22a4b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.272282 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdca1d-412e-4171-92da-e1297f22a4b0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.285463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 796/1575] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:28:15.294354 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 780/1576] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:15 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:15.295002 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc52b5-2f75-4171-b099-5566e1804587 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.295669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de880eea-7136-4443-8d47-0cb920d632b7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.296062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de880eea-7136-4443-8d47-0cb920d632b7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.296370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de880eea-7136-4443-8d47-0cb920d632b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.320211 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-de880eea-7136-4443-8d47-0cb920d632b7 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:15.321477 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-de880eea-7136-4443-8d47-0cb920d632b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:15.351866 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc52b5-2f75-4171-b099-5566e1804587 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.355463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94289aed-2693-41d1-ad92-314c76d3c6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.356104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94289aed-2693-41d1-ad92-314c76d3c6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.356382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94289aed-2693-41d1-ad92-314c76d3c6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.356678 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94289aed-2693-41d1-ad92-314c76d3c6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.381462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 797/1577] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:15.382350 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de880eea-7136-4443-8d47-0cb920d632b7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.392328 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de880eea-7136-4443-8d47-0cb920d632b7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.397414 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1acdf9-725e-4e91-a170-8ee16578775f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.398080 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1acdf9-725e-4e91-a170-8ee16578775f admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.398358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1acdf9-725e-4e91-a170-8ee16578775f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.398629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1acdf9-725e-4e91-a170-8ee16578775f admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.399319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1acdf9-725e-4e91-a170-8ee16578775f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.401328 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1acdf9-725e-4e91-a170-8ee16578775f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.423056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:15.423254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 798/1578] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:15 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:15.424035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1acdf9-725e-4e91-a170-8ee16578775f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.434936 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94289aed-2693-41d1-ad92-314c76d3c6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.436395 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94289aed-2693-41d1-ad92-314c76d3c6b9 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.437539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1acdf9-725e-4e91-a170-8ee16578775f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.442603 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9affcf2-8c80-4668-887b-ca9974fd1f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.443404 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9affcf2-8c80-4668-887b-ca9974fd1f10 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.443680 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9affcf2-8c80-4668-887b-ca9974fd1f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.443948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9affcf2-8c80-4668-887b-ca9974fd1f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.444665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9affcf2-8c80-4668-887b-ca9974fd1f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.446566 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9affcf2-8c80-4668-887b-ca9974fd1f10 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.447039 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 781/1579] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:15.447830 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94289aed-2693-41d1-ad92-314c76d3c6b9 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.457278 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94289aed-2693-41d1-ad92-314c76d3c6b9 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.464258 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bddda-c54b-4947-ac5b-234c37b83aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.464960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bddda-c54b-4947-ac5b-234c37b83aca admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.465266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bddda-c54b-4947-ac5b-234c37b83aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.465552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bddda-c54b-4947-ac5b-234c37b83aca admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.466232 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bddda-c54b-4947-ac5b-234c37b83aca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.468128 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bddda-c54b-4947-ac5b-234c37b83aca admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.477583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 799/1580] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:15 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:15.482855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b28dec-25b6-40ac-a0fd-de2918ac1e96 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.483219 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b28dec-25b6-40ac-a0fd-de2918ac1e96 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.483630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b28dec-25b6-40ac-a0fd-de2918ac1e96 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.489939 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 800/1581] 10.222.0.26 () {54 vars in 961 bytes} [Tue Jul 12 03:28:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:28:15.490753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b28dec-25b6-40ac-a0fd-de2918ac1e96 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.494616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 782/1582] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:15 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:15.494616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bddda-c54b-4947-ac5b-234c37b83aca admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.502684 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bddda-c54b-4947-ac5b-234c37b83aca admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.566847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b28dec-25b6-40ac-a0fd-de2918ac1e96 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.567397 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e6aa2-73af-438f-b257-bda46f88f9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.568270 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e6aa2-73af-438f-b257-bda46f88f9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.568590 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e6aa2-73af-438f-b257-bda46f88f9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.568866 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e6aa2-73af-438f-b257-bda46f88f9c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.569560 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e6aa2-73af-438f-b257-bda46f88f9c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.571622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e6aa2-73af-438f-b257-bda46f88f9c0 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.572177 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a97bb-f92b-4bee-be51-60657ed18fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.572944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a97bb-f92b-4bee-be51-60657ed18fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.573225 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a97bb-f92b-4bee-be51-60657ed18fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.573522 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a97bb-f92b-4bee-be51-60657ed18fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.574241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a97bb-f92b-4bee-be51-60657ed18fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.576252 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a97bb-f92b-4bee-be51-60657ed18fe3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.603595 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 783/1583] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:15 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:15.606777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e6aa2-73af-438f-b257-bda46f88f9c0 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.610746 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:15.616531 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e6aa2-73af-438f-b257-bda46f88f9c0 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.619850 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 801/1584] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:15 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:15.620839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a97bb-f92b-4bee-be51-60657ed18fe3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.623358 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55075bf-5639-4293-9fcc-a881da1b87d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.624285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55075bf-5639-4293-9fcc-a881da1b87d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.624788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55075bf-5639-4293-9fcc-a881da1b87d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.625219 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55075bf-5639-4293-9fcc-a881da1b87d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.626696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55075bf-5639-4293-9fcc-a881da1b87d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:28:15.627282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55075bf-5639-4293-9fcc-a881da1b87d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.630210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55075bf-5639-4293-9fcc-a881da1b87d4 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.657139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 784/1585] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:28:15.657139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55075bf-5639-4293-9fcc-a881da1b87d4 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.666991 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55075bf-5639-4293-9fcc-a881da1b87d4 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.705290 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a97bb-f92b-4bee-be51-60657ed18fe3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.710644 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d29e4b-4850-45e0-b50e-dd41b702f9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.711472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d29e4b-4850-45e0-b50e-dd41b702f9fa admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.711753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d29e4b-4850-45e0-b50e-dd41b702f9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.712019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d29e4b-4850-45e0-b50e-dd41b702f9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.712948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d29e4b-4850-45e0-b50e-dd41b702f9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.714709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d29e4b-4850-45e0-b50e-dd41b702f9fa admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.726886 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 802/1586] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:15.728195 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b07f8-d864-4902-9c60-829627f56561 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.728358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b07f8-d864-4902-9c60-829627f56561 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.728617 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b07f8-d864-4902-9c60-829627f56561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.750880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b0d0f-2ccf-465f-b753-7c209c274f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.752354 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b0d0f-2ccf-465f-b753-7c209c274f91 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.752909 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b0d0f-2ccf-465f-b753-7c209c274f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.753644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b0d0f-2ccf-465f-b753-7c209c274f91 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.754526 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b0d0f-2ccf-465f-b753-7c209c274f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.756745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b0d0f-2ccf-465f-b753-7c209c274f91 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.768045 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cd0b07f8-d864-4902-9c60-829627f56561 None None] MFA Rules not processed for user `0c43d9d0a6264b19a843077a4669ce70`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:15.769775 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cd0b07f8-d864-4902-9c60-829627f56561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:15.781912 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 785/1587] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:15 2022] POST /identity/v3/users => generated 303 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:15.785318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b0d0f-2ccf-465f-b753-7c209c274f91 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.796980 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b0d0f-2ccf-465f-b753-7c209c274f91 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.802300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170e344-f1d2-4038-bf1c-5b2b3394df66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.802990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170e344-f1d2-4038-bf1c-5b2b3394df66 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.803250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170e344-f1d2-4038-bf1c-5b2b3394df66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.803523 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170e344-f1d2-4038-bf1c-5b2b3394df66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.804268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170e344-f1d2-4038-bf1c-5b2b3394df66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.805997 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170e344-f1d2-4038-bf1c-5b2b3394df66 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.817423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 786/1588] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:15.821297 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170e344-f1d2-4038-bf1c-5b2b3394df66 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.832386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170e344-f1d2-4038-bf1c-5b2b3394df66 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.837155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f1432-c4cf-4291-845b-7d8c14a2f2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.837799 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f1432-c4cf-4291-845b-7d8c14a2f2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.838284 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f1432-c4cf-4291-845b-7d8c14a2f2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.838579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f1432-c4cf-4291-845b-7d8c14a2f2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.839384 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f1432-c4cf-4291-845b-7d8c14a2f2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.841079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f1432-c4cf-4291-845b-7d8c14a2f2a6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.853014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 803/1589] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Jul 12 03:28:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:15.853538 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 787/1590] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:15.854485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f1432-c4cf-4291-845b-7d8c14a2f2a6 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.856870 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b07f8-d864-4902-9c60-829627f56561 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.865360 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f1432-c4cf-4291-845b-7d8c14a2f2a6 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.868562 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b07f8-d864-4902-9c60-829627f56561 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.870271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c08df-9eab-4abc-82e0-69bfa677add7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.870964 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c08df-9eab-4abc-82e0-69bfa677add7 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.871202 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c08df-9eab-4abc-82e0-69bfa677add7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.871479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c08df-9eab-4abc-82e0-69bfa677add7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.872298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c08df-9eab-4abc-82e0-69bfa677add7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.873600 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06638326-289d-4856-8f95-39f9d1ffd151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:15.874258 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c08df-9eab-4abc-82e0-69bfa677add7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.874374 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06638326-289d-4856-8f95-39f9d1ffd151 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:15.874556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06638326-289d-4856-8f95-39f9d1ffd151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:15.874801 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06638326-289d-4856-8f95-39f9d1ffd151 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:15.875493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06638326-289d-4856-8f95-39f9d1ffd151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:15.877577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06638326-289d-4856-8f95-39f9d1ffd151 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:15.897069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:15.909293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 804/1591] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:15 2022] POST /identity/v3/users => generated 303 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:15.909293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06638326-289d-4856-8f95-39f9d1ffd151 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.911894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 788/1592] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:15 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:15.913175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c08df-9eab-4abc-82e0-69bfa677add7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:15.925121 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06638326-289d-4856-8f95-39f9d1ffd151 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:15.994769 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:16.003045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c08df-9eab-4abc-82e0-69bfa677add7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:16.003591 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86bc89-929e-4d16-bcba-91bb38fa247e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.004435 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86bc89-929e-4d16-bcba-91bb38fa247e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.004773 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86bc89-929e-4d16-bcba-91bb38fa247e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.005362 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86bc89-929e-4d16-bcba-91bb38fa247e admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.007051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86bc89-929e-4d16-bcba-91bb38fa247e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.009175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86bc89-929e-4d16-bcba-91bb38fa247e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:16.009320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49c148-bb56-406c-858c-2395aa54f112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.010141 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49c148-bb56-406c-858c-2395aa54f112 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.010535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49c148-bb56-406c-858c-2395aa54f112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.010878 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49c148-bb56-406c-858c-2395aa54f112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.011950 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49c148-bb56-406c-858c-2395aa54f112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.014124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49c148-bb56-406c-858c-2395aa54f112 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:16.022685 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 805/1593] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:16.027399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86bc89-929e-4d16-bcba-91bb38fa247e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:16.032244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 789/1594] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:16.032244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49c148-bb56-406c-858c-2395aa54f112 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:16.042152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86bc89-929e-4d16-bcba-91bb38fa247e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:16.042787 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49c148-bb56-406c-858c-2395aa54f112 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:16.048134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedc10b-c2f9-45fd-a375-b8307bb2cc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.048985 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedc10b-c2f9-45fd-a375-b8307bb2cc02 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.049341 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedc10b-c2f9-45fd-a375-b8307bb2cc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.049690 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50b049-6704-464c-97d5-b54401bb41e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.049832 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedc10b-c2f9-45fd-a375-b8307bb2cc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.050620 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedc10b-c2f9-45fd-a375-b8307bb2cc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.051847 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50b049-6704-464c-97d5-b54401bb41e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.052286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50b049-6704-464c-97d5-b54401bb41e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.052679 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedc10b-c2f9-45fd-a375-b8307bb2cc02 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:16.052974 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50b049-6704-464c-97d5-b54401bb41e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.053979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50b049-6704-464c-97d5-b54401bb41e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.055728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50b049-6704-464c-97d5-b54401bb41e9 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:16.065089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 806/1595] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:16.065992 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedc10b-c2f9-45fd-a375-b8307bb2cc02 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:16.073622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 790/1596] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:16.073622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50b049-6704-464c-97d5-b54401bb41e9 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:16.085723 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50b049-6704-464c-97d5-b54401bb41e9 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:16.090675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc7065-6971-4946-8827-cde3a7a722cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.091501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc7065-6971-4946-8827-cde3a7a722cf admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.091872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc7065-6971-4946-8827-cde3a7a722cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.092239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc7065-6971-4946-8827-cde3a7a722cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.093125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc7065-6971-4946-8827-cde3a7a722cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.095246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc7065-6971-4946-8827-cde3a7a722cf admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:16.107368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 791/1597] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:16.108405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc7065-6971-4946-8827-cde3a7a722cf admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:16.118536 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc7065-6971-4946-8827-cde3a7a722cf admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:16.123521 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa93ef-7b70-49cf-89e1-827f91d4bc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.124179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa93ef-7b70-49cf-89e1-827f91d4bc07 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.124548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa93ef-7b70-49cf-89e1-827f91d4bc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.124894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa93ef-7b70-49cf-89e1-827f91d4bc07 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.125733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa93ef-7b70-49cf-89e1-827f91d4bc07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.127799 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa93ef-7b70-49cf-89e1-827f91d4bc07 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:16.149934 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedc10b-c2f9-45fd-a375-b8307bb2cc02 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:16.150359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 792/1598] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:16 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:16.151289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa93ef-7b70-49cf-89e1-827f91d4bc07 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:16.161340 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa93ef-7b70-49cf-89e1-827f91d4bc07 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:16.162199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa20124-483a-44c8-bb03-71a0e6565562 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.162908 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa20124-483a-44c8-bb03-71a0e6565562 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.163236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa20124-483a-44c8-bb03-71a0e6565562 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.163452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa20124-483a-44c8-bb03-71a0e6565562 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.166130 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e88bf-88e5-4ddf-88ac-6d7d8fa19f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.167026 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e88bf-88e5-4ddf-88ac-6d7d8fa19f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.167314 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e88bf-88e5-4ddf-88ac-6d7d8fa19f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.167596 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e88bf-88e5-4ddf-88ac-6d7d8fa19f78 admin admin] PATH_INFO: `/v3/projects/8ddb4f7232324cb59ce0179c4209302a/users/dbfe7a2a6c144b598057e446e426688e/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.185044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e88bf-88e5-4ddf-88ac-6d7d8fa19f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ddb4f7232324cb59ce0179c4209302a, user_id=dbfe7a2a6c144b598057e446e426688e, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.188028 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e88bf-88e5-4ddf-88ac-6d7d8fa19f78 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:16.207053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 793/1599] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:16 2022] PUT /identity/v3/projects/8ddb4f7232324cb59ce0179c4209302a/users/dbfe7a2a6c144b598057e446e426688e/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:16.207053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e88bf-88e5-4ddf-88ac-6d7d8fa19f78 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:16.233792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa20124-483a-44c8-bb03-71a0e6565562 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.235406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa20124-483a-44c8-bb03-71a0e6565562 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:16.246541 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 807/1600] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:16.254113 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa20124-483a-44c8-bb03-71a0e6565562 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:16.266276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa20124-483a-44c8-bb03-71a0e6565562 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:16.283911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e88bf-88e5-4ddf-88ac-6d7d8fa19f78 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:16.296167 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3165e28-4c51-4f9d-a800-0a1c4495fcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.297550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3165e28-4c51-4f9d-a800-0a1c4495fcfe admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.298014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3165e28-4c51-4f9d-a800-0a1c4495fcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.298453 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3165e28-4c51-4f9d-a800-0a1c4495fcfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.299348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3165e28-4c51-4f9d-a800-0a1c4495fcfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.301340 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3165e28-4c51-4f9d-a800-0a1c4495fcfe admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:16.315628 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 794/1601] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:16.316738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3165e28-4c51-4f9d-a800-0a1c4495fcfe admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:16.330862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3165e28-4c51-4f9d-a800-0a1c4495fcfe admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:16.337662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ed433-7153-4ebb-8e3b-45bec044a546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.338794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ed433-7153-4ebb-8e3b-45bec044a546 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.339242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ed433-7153-4ebb-8e3b-45bec044a546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.339689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ed433-7153-4ebb-8e3b-45bec044a546 admin admin] PATH_INFO: `/v3/projects/ef99fada1f25433cadda54b9cf3b9228/users/6e67edcef8454b3fa4565fea949f1781/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.342764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4ca7d-870d-4a9d-b9bf-cb40babf537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.344732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4ca7d-870d-4a9d-b9bf-cb40babf537d admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.345569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4ca7d-870d-4a9d-b9bf-cb40babf537d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.345944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4ca7d-870d-4a9d-b9bf-cb40babf537d admin admin] PATH_INFO: `/v3/projects/4ddbdc81b7564c5aa540ef560e066042/users/d8e90b4b09dd453f9685fb034227a136/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.366223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4ca7d-870d-4a9d-b9bf-cb40babf537d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ddbdc81b7564c5aa540ef560e066042, user_id=d8e90b4b09dd453f9685fb034227a136, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.369340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4ca7d-870d-4a9d-b9bf-cb40babf537d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:16.377538 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ed433-7153-4ebb-8e3b-45bec044a546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef99fada1f25433cadda54b9cf3b9228, user_id=6e67edcef8454b3fa4565fea949f1781, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.380371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ed433-7153-4ebb-8e3b-45bec044a546 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:16.389573 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 808/1602] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:16 2022] PUT /identity/v3/projects/4ddbdc81b7564c5aa540ef560e066042/users/d8e90b4b09dd453f9685fb034227a136/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:16.401780 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4ca7d-870d-4a9d-b9bf-cb40babf537d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:16.408841 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 795/1603] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:16 2022] PUT /identity/v3/projects/ef99fada1f25433cadda54b9cf3b9228/users/6e67edcef8454b3fa4565fea949f1781/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:16.409949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ed433-7153-4ebb-8e3b-45bec044a546 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:16.412472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:16.418719 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:16.511257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ed433-7153-4ebb-8e3b-45bec044a546 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:16.517056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9e069-f1c5-4994-b888-53307e50ba6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.518070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9e069-f1c5-4994-b888-53307e50ba6f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.518354 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9e069-f1c5-4994-b888-53307e50ba6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.518753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9e069-f1c5-4994-b888-53307e50ba6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.519665 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9e069-f1c5-4994-b888-53307e50ba6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.521678 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9e069-f1c5-4994-b888-53307e50ba6f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:16.541904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 796/1604] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:16.542158 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4ca7d-870d-4a9d-b9bf-cb40babf537d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:16.542259 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c8e88-8279-42f4-be8f-6cd58979d4ec None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.542259 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c8e88-8279-42f4-be8f-6cd58979d4ec None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.542259 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c8e88-8279-42f4-be8f-6cd58979d4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.548674 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a7b94-5cfe-461c-b78b-128a44ecf31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.549575 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a7b94-5cfe-461c-b78b-128a44ecf31c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.549956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a7b94-5cfe-461c-b78b-128a44ecf31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.550337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a7b94-5cfe-461c-b78b-128a44ecf31c admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.551177 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a7b94-5cfe-461c-b78b-128a44ecf31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.553273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a7b94-5cfe-461c-b78b-128a44ecf31c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:16.564188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-311c8e88-8279-42f4-be8f-6cd58979d4ec None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:16.565444 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-311c8e88-8279-42f4-be8f-6cd58979d4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:16.568129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 809/1605] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:16.569174 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a7b94-5cfe-461c-b78b-128a44ecf31c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:16.579050 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 797/1606] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:16.580662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3f4ec-babc-4e8a-8eaa-88bddd3f7dbb None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.580949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3f4ec-babc-4e8a-8eaa-88bddd3f7dbb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.581224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3f4ec-babc-4e8a-8eaa-88bddd3f7dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.585499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a7b94-5cfe-461c-b78b-128a44ecf31c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:16.591264 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2fe18-d03a-495b-b6d5-d635391b5a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.592235 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2fe18-d03a-495b-b6d5-d635391b5a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.592587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2fe18-d03a-495b-b6d5-d635391b5a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.592864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2fe18-d03a-495b-b6d5-d635391b5a5c admin admin] PATH_INFO: `/v3/projects/8d78ea14ef49475dbdb5cf1a4d62dbf9/users/70deed39f11c4bc9a738caec6433c687/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.606952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4cb3f4ec-babc-4e8a-8eaa-88bddd3f7dbb None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:16.609031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4cb3f4ec-babc-4e8a-8eaa-88bddd3f7dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:16.614285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2fe18-d03a-495b-b6d5-d635391b5a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d78ea14ef49475dbdb5cf1a4d62dbf9, user_id=70deed39f11c4bc9a738caec6433c687, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.617263 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2fe18-d03a-495b-b6d5-d635391b5a5c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:16.623336 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 798/1607] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:16.629480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0676ff3-fdc7-41f1-b096-5a20af3964f9 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.629896 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0676ff3-fdc7-41f1-b096-5a20af3964f9 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.630463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0676ff3-fdc7-41f1-b096-5a20af3964f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.643677 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 810/1608] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:16 2022] PUT /identity/v3/projects/8d78ea14ef49475dbdb5cf1a4d62dbf9/users/70deed39f11c4bc9a738caec6433c687/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:16.645530 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8db2b2-4c18-4589-9bb3-99bdf4360b99 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.645971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8db2b2-4c18-4589-9bb3-99bdf4360b99 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.646325 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8db2b2-4c18-4589-9bb3-99bdf4360b99 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.648238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 811/1609] 10.222.0.26 () {54 vars in 912 bytes} [Tue Jul 12 03:28:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:28:16.649085 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8db2b2-4c18-4589-9bb3-99bdf4360b99 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:16.662349 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e0676ff3-fdc7-41f1-b096-5a20af3964f9 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:16.663621 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e0676ff3-fdc7-41f1-b096-5a20af3964f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:16.729743 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 799/1610] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:16.730799 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0676ff3-fdc7-41f1-b096-5a20af3964f9 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:16.741394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0676ff3-fdc7-41f1-b096-5a20af3964f9 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:16.746610 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f098fbb-83b5-4683-bad9-296ce0a1deb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.747513 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f098fbb-83b5-4683-bad9-296ce0a1deb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.747787 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f098fbb-83b5-4683-bad9-296ce0a1deb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.748052 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f098fbb-83b5-4683-bad9-296ce0a1deb1 admin admin] PATH_INFO: `/v3/projects/3bf23e3c25634ef3ac4eb3d7b2cbe76e/users/872b6a446a414f23adf24a3fde1b681f/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.752865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8db2b2-4c18-4589-9bb3-99bdf4360b99 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:16.759114 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54d000-af70-4d8e-98db-70c4f0fa7140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.759930 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54d000-af70-4d8e-98db-70c4f0fa7140 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.760304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54d000-af70-4d8e-98db-70c4f0fa7140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.760690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54d000-af70-4d8e-98db-70c4f0fa7140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.761548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54d000-af70-4d8e-98db-70c4f0fa7140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.763201 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54d000-af70-4d8e-98db-70c4f0fa7140 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:16.764337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f098fbb-83b5-4683-bad9-296ce0a1deb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf23e3c25634ef3ac4eb3d7b2cbe76e, user_id=872b6a446a414f23adf24a3fde1b681f, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.767101 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f098fbb-83b5-4683-bad9-296ce0a1deb1 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:16.777058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 812/1611] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:16.780914 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54d000-af70-4d8e-98db-70c4f0fa7140 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:16.788920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 800/1612] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:16 2022] PUT /identity/v3/projects/3bf23e3c25634ef3ac4eb3d7b2cbe76e/users/872b6a446a414f23adf24a3fde1b681f/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:16.789923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f098fbb-83b5-4683-bad9-296ce0a1deb1 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:16.862417 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54d000-af70-4d8e-98db-70c4f0fa7140 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:16.863197 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f098fbb-83b5-4683-bad9-296ce0a1deb1 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:16.868192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8db33e-5056-42aa-9704-24535216f3d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.868620 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cca75-8677-4506-a724-b1d1dd98c38a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:16.869209 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8db33e-5056-42aa-9704-24535216f3d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.869554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8db33e-5056-42aa-9704-24535216f3d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.870333 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cca75-8677-4506-a724-b1d1dd98c38a service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:16.870670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cca75-8677-4506-a724-b1d1dd98c38a service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:16.871014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cca75-8677-4506-a724-b1d1dd98c38a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.871315 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8db33e-5056-42aa-9704-24535216f3d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:16.890303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:16.915797 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:16.982204 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8db33e-5056-42aa-9704-24535216f3d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.983669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8db33e-5056-42aa-9704-24535216f3d8 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:16.990319 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7cca75-8677-4506-a724-b1d1dd98c38a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:16.991787 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7cca75-8677-4506-a724-b1d1dd98c38a service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:17.002887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 813/1613] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:17.004404 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948542-e0a2-4dbe-9064-5bf00fe46de7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:17.005074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948542-e0a2-4dbe-9064-5bf00fe46de7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:17.005074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948542-e0a2-4dbe-9064-5bf00fe46de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:17.009522 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 801/1614] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:17.012017 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492abfa5-1cfb-4f2f-844a-d8a8e39cb91e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:17.012383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492abfa5-1cfb-4f2f-844a-d8a8e39cb91e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:17.012754 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492abfa5-1cfb-4f2f-844a-d8a8e39cb91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:17.023504 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4a948542-e0a2-4dbe-9064-5bf00fe46de7 None None] MFA Rules not processed for user `0c43d9d0a6264b19a843077a4669ce70`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:17.024823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4a948542-e0a2-4dbe-9064-5bf00fe46de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:17.087767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-492abfa5-1cfb-4f2f-844a-d8a8e39cb91e None None] MFA Rules not processed for user `70deed39f11c4bc9a738caec6433c687`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:17.090290 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-492abfa5-1cfb-4f2f-844a-d8a8e39cb91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:17.098378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 814/1615] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 03:28:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:17.099501 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a948542-e0a2-4dbe-9064-5bf00fe46de7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:17.113573 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a948542-e0a2-4dbe-9064-5bf00fe46de7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:17.124482 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f01b05-df74-4fe1-942c-511e130b36fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:17.125185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f01b05-df74-4fe1-942c-511e130b36fa service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:17.125465 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f01b05-df74-4fe1-942c-511e130b36fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:17.125739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f01b05-df74-4fe1-942c-511e130b36fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:17.147229 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f01b05-df74-4fe1-942c-511e130b36fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:17.149588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f01b05-df74-4fe1-942c-511e130b36fa service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:17.174207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 815/1616] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:17.175055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f01b05-df74-4fe1-942c-511e130b36fa service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:17.185015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f01b05-df74-4fe1-942c-511e130b36fa service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:17.190780 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5deee24-6aae-448b-8c45-6250c922ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:17.191820 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deee24-6aae-448b-8c45-6250c922ceba admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:17.192837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deee24-6aae-448b-8c45-6250c922ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:17.193161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deee24-6aae-448b-8c45-6250c922ceba admin admin] PATH_INFO: `/v3/projects/c83c2d3b7b45407fbf5a261d0a664aff/users/8dadeae8e29240cda515f3d1257df0bf/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:17.212504 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5deee24-6aae-448b-8c45-6250c922ceba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c83c2d3b7b45407fbf5a261d0a664aff, user_id=8dadeae8e29240cda515f3d1257df0bf, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:17.215699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5deee24-6aae-448b-8c45-6250c922ceba admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:17.239627 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 816/1617] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:17 2022] PUT /identity/v3/projects/c83c2d3b7b45407fbf5a261d0a664aff/users/8dadeae8e29240cda515f3d1257df0bf/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:17.241960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9f811-12f9-434c-9912-ea4bcdbc5c40 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:17.243130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9f811-12f9-434c-9912-ea4bcdbc5c40 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:17.244507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9f811-12f9-434c-9912-ea4bcdbc5c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:17.248453 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 802/1618] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:17.250784 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492abfa5-1cfb-4f2f-844a-d8a8e39cb91e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:17.269033 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-dcf9f811-12f9-434c-9912-ea4bcdbc5c40 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:17.270362 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dcf9f811-12f9-434c-9912-ea4bcdbc5c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:17.356100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492abfa5-1cfb-4f2f-844a-d8a8e39cb91e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:17.388388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 817/1619] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:17.388388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9f811-12f9-434c-9912-ea4bcdbc5c40 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:17.403382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9f811-12f9-434c-9912-ea4bcdbc5c40 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:17.410669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c3a5f-6bc5-4c5a-8c67-b19f23c4ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:17.411680 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c3a5f-6bc5-4c5a-8c67-b19f23c4ff65 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:17.412106 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c3a5f-6bc5-4c5a-8c67-b19f23c4ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:17.412978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c3a5f-6bc5-4c5a-8c67-b19f23c4ff65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:17.414404 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c3a5f-6bc5-4c5a-8c67-b19f23c4ff65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:17.417494 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c3a5f-6bc5-4c5a-8c67-b19f23c4ff65 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:17.439164 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:17.447640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9746552-1c71-4bf9-9a2b-7582270d5494 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:17.448329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9746552-1c71-4bf9-9a2b-7582270d5494 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:17.448661 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9746552-1c71-4bf9-9a2b-7582270d5494 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:17.448938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9746552-1c71-4bf9-9a2b-7582270d5494 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:17.462217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 818/1620] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:17 2022] POST /identity/v3/projects => generated 405 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:17.463823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31150d3b-2ff8-4cf5-98ec-63aa228395f9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:17.464907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31150d3b-2ff8-4cf5-98ec-63aa228395f9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:17.465132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31150d3b-2ff8-4cf5-98ec-63aa228395f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:17.474184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:17.504794 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-31150d3b-2ff8-4cf5-98ec-63aa228395f9 None None] MFA Rules not processed for user `8dadeae8e29240cda515f3d1257df0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:17.507040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-31150d3b-2ff8-4cf5-98ec-63aa228395f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:17.689376 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 819/1621] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:17.689376 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31150d3b-2ff8-4cf5-98ec-63aa228395f9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:17.695774 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9746552-1c71-4bf9-9a2b-7582270d5494 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:17.695774 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9746552-1c71-4bf9-9a2b-7582270d5494 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:17.717847 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 803/1622] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:17.719396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9746552-1c71-4bf9-9a2b-7582270d5494 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:17.734111 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9746552-1c71-4bf9-9a2b-7582270d5494 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:17.780788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31150d3b-2ff8-4cf5-98ec-63aa228395f9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:17.792693 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69930fe-4821-4e38-83d5-255989a1a165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:17.793422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69930fe-4821-4e38-83d5-255989a1a165 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:17.795255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69930fe-4821-4e38-83d5-255989a1a165 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:17.795590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69930fe-4821-4e38-83d5-255989a1a165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:17.867793 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154f69f-0a92-4c96-b779-b6d3a3ef64d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:17.868491 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154f69f-0a92-4c96-b779-b6d3a3ef64d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:17.868795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154f69f-0a92-4c96-b779-b6d3a3ef64d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:17.869061 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154f69f-0a92-4c96-b779-b6d3a3ef64d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:17.869755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154f69f-0a92-4c96-b779-b6d3a3ef64d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:17.877530 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154f69f-0a92-4c96-b779-b6d3a3ef64d3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:17.920071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 804/1623] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:17 2022] POST /identity/v3/users => generated 309 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:17.921331 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154f69f-0a92-4c96-b779-b6d3a3ef64d3 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:17.926561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69930fe-4821-4e38-83d5-255989a1a165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:17.928532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69930fe-4821-4e38-83d5-255989a1a165 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:17.941586 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 820/1624] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:17.942848 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69930fe-4821-4e38-83d5-255989a1a165 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:17.950514 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154f69f-0a92-4c96-b779-b6d3a3ef64d3 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:17.957491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69930fe-4821-4e38-83d5-255989a1a165 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:17.964080 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314edee-c75f-46b7-98f1-f77fb9b20b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:17.964947 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314edee-c75f-46b7-98f1-f77fb9b20b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:17.965414 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee9274-e645-46fb-a954-13e84be87434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:17.965668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314edee-c75f-46b7-98f1-f77fb9b20b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:17.966002 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee9274-e645-46fb-a954-13e84be87434 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:17.966129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314edee-c75f-46b7-98f1-f77fb9b20b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:17.966290 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee9274-e645-46fb-a954-13e84be87434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:17.966572 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee9274-e645-46fb-a954-13e84be87434 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:17.967368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314edee-c75f-46b7-98f1-f77fb9b20b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:17.967905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee9274-e645-46fb-a954-13e84be87434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:17.969239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314edee-c75f-46b7-98f1-f77fb9b20b0b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:17.971982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee9274-e645-46fb-a954-13e84be87434 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:17.997858 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 821/1625] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:18.001848 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314edee-c75f-46b7-98f1-f77fb9b20b0b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:18.025846 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314edee-c75f-46b7-98f1-f77fb9b20b0b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:18.035580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cc824-faa6-4052-a750-7cc0e439fe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:18.036841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cc824-faa6-4052-a750-7cc0e439fe7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:18.037637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cc824-faa6-4052-a750-7cc0e439fe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:18.038163 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cc824-faa6-4052-a750-7cc0e439fe7e admin admin] PATH_INFO: `/v3/projects/c56a5518721b43a488bb0d1063402281/users/1985ba4ff523483e83ad1474cb7a6745/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:18.042835 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 805/1626] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:17 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:18.043911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee9274-e645-46fb-a954-13e84be87434 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:18.080960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13cc824-faa6-4052-a750-7cc0e439fe7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56a5518721b43a488bb0d1063402281, user_id=1985ba4ff523483e83ad1474cb7a6745, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:18.089244 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13cc824-faa6-4052-a750-7cc0e439fe7e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:18.117877 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:18.128896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 822/1627] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:18 2022] PUT /identity/v3/projects/c56a5518721b43a488bb0d1063402281/users/1985ba4ff523483e83ad1474cb7a6745/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:18.138959 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cc824-faa6-4052-a750-7cc0e439fe7e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:18.230106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee9274-e645-46fb-a954-13e84be87434 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:18.254888 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:18.352688 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cc824-faa6-4052-a750-7cc0e439fe7e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:18.365211 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c3926-cfaf-469a-b935-be75a87fee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:18.368173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c3926-cfaf-469a-b935-be75a87fee33 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:18.369223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c3926-cfaf-469a-b935-be75a87fee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:18.369816 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c3926-cfaf-469a-b935-be75a87fee33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:18.373333 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c3926-cfaf-469a-b935-be75a87fee33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:18.376874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c3926-cfaf-469a-b935-be75a87fee33 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:18.389826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d22625-26d8-4665-9ca8-f995ee81c38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:18.395536 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d22625-26d8-4665-9ca8-f995ee81c38e admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:18.397477 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d22625-26d8-4665-9ca8-f995ee81c38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:18.397955 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d22625-26d8-4665-9ca8-f995ee81c38e admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:18.399348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d22625-26d8-4665-9ca8-f995ee81c38e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:18.419877 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d22625-26d8-4665-9ca8-f995ee81c38e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:18.420052 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 823/1628] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:18.423642 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c3926-cfaf-469a-b935-be75a87fee33 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:18.434980 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c3926-cfaf-469a-b935-be75a87fee33 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:18.440429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6145d-8fbf-4bda-afcc-b5498e67287f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:18.441503 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6145d-8fbf-4bda-afcc-b5498e67287f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:18.442189 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6145d-8fbf-4bda-afcc-b5498e67287f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:18.442189 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6145d-8fbf-4bda-afcc-b5498e67287f admin admin] PATH_INFO: `/v3/projects/c56a5518721b43a488bb0d1063402281/users/1985ba4ff523483e83ad1474cb7a6745/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:18.444463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6145d-8fbf-4bda-afcc-b5498e67287f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56a5518721b43a488bb0d1063402281, user_id=1985ba4ff523483e83ad1474cb7a6745, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:18.447690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6145d-8fbf-4bda-afcc-b5498e67287f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:18.472384 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 824/1629] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:18 2022] PUT /identity/v3/projects/c56a5518721b43a488bb0d1063402281/users/1985ba4ff523483e83ad1474cb7a6745/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:18.474800 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1872e3-d06e-4b86-842f-daedbe284ee3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:18.475095 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1872e3-d06e-4b86-842f-daedbe284ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:18.475372 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1872e3-d06e-4b86-842f-daedbe284ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:18.490949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 806/1630] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:18 2022] POST /identity/v3/users => generated 295 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:18.495959 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d22625-26d8-4665-9ca8-f995ee81c38e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:18.509426 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bc1872e3-d06e-4b86-842f-daedbe284ee3 None None] MFA Rules not processed for user `1985ba4ff523483e83ad1474cb7a6745`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:18.511221 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bc1872e3-d06e-4b86-842f-daedbe284ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:18.518516 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d22625-26d8-4665-9ca8-f995ee81c38e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:18.624148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 825/1631] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:18.640360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1872e3-d06e-4b86-842f-daedbe284ee3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:18.674202 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f8833-53b0-4bd2-87b2-261ec9482b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:18.675437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f8833-53b0-4bd2-87b2-261ec9482b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:18.675729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f8833-53b0-4bd2-87b2-261ec9482b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:18.676007 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f8833-53b0-4bd2-87b2-261ec9482b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:18.678546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f8833-53b0-4bd2-87b2-261ec9482b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:18.687147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f8833-53b0-4bd2-87b2-261ec9482b42 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:18.724573 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1872e3-d06e-4b86-842f-daedbe284ee3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:18.729463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a3dfd-7053-496e-ba02-ef2c9e5906dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:18.730327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a3dfd-7053-496e-ba02-ef2c9e5906dd service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:18.730699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a3dfd-7053-496e-ba02-ef2c9e5906dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:18.731066 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a3dfd-7053-496e-ba02-ef2c9e5906dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:18.739726 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 807/1632] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:18.741660 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f8833-53b0-4bd2-87b2-261ec9482b42 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:18.746198 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a3dfd-7053-496e-ba02-ef2c9e5906dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:18.748776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a3dfd-7053-496e-ba02-ef2c9e5906dd service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:18.766239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f8833-53b0-4bd2-87b2-261ec9482b42 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:18.782391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1ee65-96fe-4477-bdb1-b69f5dc598d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:18.783352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1ee65-96fe-4477-bdb1-b69f5dc598d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:18.783680 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1ee65-96fe-4477-bdb1-b69f5dc598d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:18.784769 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1ee65-96fe-4477-bdb1-b69f5dc598d8 admin admin] PATH_INFO: `/v3/projects/3b9199f003ed47eea214a6c893e81fa4/users/ccd2f5e3de49454cb20faa365f3fa719/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:18.793753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 826/1633] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:18 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:28:18.826893 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1ee65-96fe-4477-bdb1-b69f5dc598d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9199f003ed47eea214a6c893e81fa4, user_id=ccd2f5e3de49454cb20faa365f3fa719, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:18.829674 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1ee65-96fe-4477-bdb1-b69f5dc598d8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:18.875439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 808/1634] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:18 2022] PUT /identity/v3/projects/3b9199f003ed47eea214a6c893e81fa4/users/ccd2f5e3de49454cb20faa365f3fa719/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:18.876602 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a3dfd-7053-496e-ba02-ef2c9e5906dd service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:18.892619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a3dfd-7053-496e-ba02-ef2c9e5906dd service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:18.907305 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:19.017696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e9058-3e3f-416f-ac5b-1c809133dde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:19.019056 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e9058-3e3f-416f-ac5b-1c809133dde3 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:19.019344 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e9058-3e3f-416f-ac5b-1c809133dde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:19.019621 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e9058-3e3f-416f-ac5b-1c809133dde3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:19.021620 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e9058-3e3f-416f-ac5b-1c809133dde3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:19.023484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e9058-3e3f-416f-ac5b-1c809133dde3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:19.048057 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 827/1635] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:19.052798 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1ee65-96fe-4477-bdb1-b69f5dc598d8 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:19.067643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1ee65-96fe-4477-bdb1-b69f5dc598d8 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:19.083106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4c05f-4d46-42e8-b3f1-bb5d0fcc0885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:19.084375 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4c05f-4d46-42e8-b3f1-bb5d0fcc0885 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:19.085761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4c05f-4d46-42e8-b3f1-bb5d0fcc0885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:19.086046 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4c05f-4d46-42e8-b3f1-bb5d0fcc0885 admin admin] PATH_INFO: `/v3/projects/3b9199f003ed47eea214a6c893e81fa4/users/ccd2f5e3de49454cb20faa365f3fa719/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:19.088334 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4c05f-4d46-42e8-b3f1-bb5d0fcc0885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9199f003ed47eea214a6c893e81fa4, user_id=ccd2f5e3de49454cb20faa365f3fa719, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:19.092277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4c05f-4d46-42e8-b3f1-bb5d0fcc0885 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:19.109715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 809/1636] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:19 2022] PUT /identity/v3/projects/3b9199f003ed47eea214a6c893e81fa4/users/ccd2f5e3de49454cb20faa365f3fa719/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:19.119981 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20641f6-01d8-4d86-aec0-ac8e3be28018 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:19.120103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20641f6-01d8-4d86-aec0-ac8e3be28018 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:19.120374 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20641f6-01d8-4d86-aec0-ac8e3be28018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:19.181672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c20641f6-01d8-4d86-aec0-ac8e3be28018 None None] MFA Rules not processed for user `ccd2f5e3de49454cb20faa365f3fa719`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:19.182693 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c20641f6-01d8-4d86-aec0-ac8e3be28018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:19.250308 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4c05f-4d46-42e8-b3f1-bb5d0fcc0885 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:19.342872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 828/1637] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:19.356557 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20641f6-01d8-4d86-aec0-ac8e3be28018 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:19.443138 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4c05f-4d46-42e8-b3f1-bb5d0fcc0885 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:19.460582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2878b-d3bb-48e4-ac15-529171b4976e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:19.464421 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2878b-d3bb-48e4-ac15-529171b4976e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:19.465050 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2878b-d3bb-48e4-ac15-529171b4976e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:19.465596 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2878b-d3bb-48e4-ac15-529171b4976e admin admin] PATH_INFO: `/v3/users/70deed39f11c4bc9a738caec6433c687` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:19.477958 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20641f6-01d8-4d86-aec0-ac8e3be28018 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:19.495181 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70874a98-016c-475b-b4e8-b7d74cef2c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:19.496059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70874a98-016c-475b-b4e8-b7d74cef2c31 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:19.496551 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70874a98-016c-475b-b4e8-b7d74cef2c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:19.496916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70874a98-016c-475b-b4e8-b7d74cef2c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:19.503948 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2878b-d3bb-48e4-ac15-529171b4976e admin admin] RBAC: Authorizing `identity:delete_user(user_id=70deed39f11c4bc9a738caec6433c687)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:19.509917 dv-cinder-847730-4-smb devstack@keystone.service[80397]: WARNING py.warnings [None req-51d2878b-d3bb-48e4-ac15-529171b4976e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:28:19.509917 dv-cinder-847730-4-smb devstack@keystone.service[80397]: warnings.warn(msg) Jul 12 03:28:19.509917 dv-cinder-847730-4-smb devstack@keystone.service[80397]: Jul 12 03:28:19.511602 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2878b-d3bb-48e4-ac15-529171b4976e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:19.522065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:19.610950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:19.628113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-51d2878b-d3bb-48e4-ac15-529171b4976e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70deed39f11c4bc9a738caec6433c687'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:19.639323 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70874a98-016c-475b-b4e8-b7d74cef2c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:19.641996 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70874a98-016c-475b-b4e8-b7d74cef2c31 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:19.644907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-51d2878b-d3bb-48e4-ac15-529171b4976e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70deed39f11c4bc9a738caec6433c687'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:19.657392 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 829/1638] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:28:19.658954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa88005-8f5c-46ec-956c-f7cfefb15915 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:19.659245 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa88005-8f5c-46ec-956c-f7cfefb15915 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:19.659528 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa88005-8f5c-46ec-956c-f7cfefb15915 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:19.661472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 830/1639] 10.222.0.26 () {54 vars in 961 bytes} [Tue Jul 12 03:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:28:19.668143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93954cf-2d8a-4ef8-98b4-86d967336c41 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:19.669221 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93954cf-2d8a-4ef8-98b4-86d967336c41 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:19.669221 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93954cf-2d8a-4ef8-98b4-86d967336c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:19.691780 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-51d2878b-d3bb-48e4-ac15-529171b4976e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70deed39f11c4bc9a738caec6433c687'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:19.692916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-51d2878b-d3bb-48e4-ac15-529171b4976e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70deed39f11c4bc9a738caec6433c687'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:19.693323 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e93954cf-2d8a-4ef8-98b4-86d967336c41 None None] MFA Rules not processed for user `0c43d9d0a6264b19a843077a4669ce70`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:19.694590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e93954cf-2d8a-4ef8-98b4-86d967336c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:19.723544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-51d2878b-d3bb-48e4-ac15-529171b4976e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70deed39f11c4bc9a738caec6433c687'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:19.758374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 810/1640] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:28:19 2022] DELETE /identity/v3/users/70deed39f11c4bc9a738caec6433c687 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:28:19.760247 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeffe7-81e6-46d2-b59a-47ec8b5852fe None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:19.760706 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeffe7-81e6-46d2-b59a-47ec8b5852fe None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:19.761245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeffe7-81e6-46d2-b59a-47ec8b5852fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:19.785250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a4eeffe7-81e6-46d2-b59a-47ec8b5852fe None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:19.787701 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a4eeffe7-81e6-46d2-b59a-47ec8b5852fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:19.855193 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 831/1641] 10.222.0.26 () {58 vars in 1058 bytes} [Tue Jul 12 03:28:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:19.857958 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec18e7c-f8e5-4ddd-b674-ac8cfe4d69bf None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:19.858247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec18e7c-f8e5-4ddd-b674-ac8cfe4d69bf None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:19.858521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec18e7c-f8e5-4ddd-b674-ac8cfe4d69bf None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:19.862858 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 832/1642] 10.222.0.26 () {54 vars in 912 bytes} [Tue Jul 12 03:28:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:28:19.873287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de096-0ba4-441b-940b-7724e77626e1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:19.873640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de096-0ba4-441b-940b-7724e77626e1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:19.873829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de096-0ba4-441b-940b-7724e77626e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:19.913891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 811/1643] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:19.918711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-142de096-0ba4-441b-940b-7724e77626e1 None None] MFA Rules not processed for user `0c43d9d0a6264b19a843077a4669ce70`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:19.920531 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-142de096-0ba4-441b-940b-7724e77626e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:20.050961 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeffe7-81e6-46d2-b59a-47ec8b5852fe None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:20.054222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a4eeffe7-81e6-46d2-b59a-47ec8b5852fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:20.063704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 833/1644] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 03:28:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:20.073650 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142de096-0ba4-441b-940b-7724e77626e1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:20.075862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-142de096-0ba4-441b-940b-7724e77626e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:20.219357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142de096-0ba4-441b-940b-7724e77626e1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:20.226860 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27844f13-d0d1-440a-8df7-4ac7bd8e23f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:20.227539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27844f13-d0d1-440a-8df7-4ac7bd8e23f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:20.227852 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27844f13-d0d1-440a-8df7-4ac7bd8e23f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:20.229427 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27844f13-d0d1-440a-8df7-4ac7bd8e23f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:20.251885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeffe7-81e6-46d2-b59a-47ec8b5852fe None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:20.256072 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af4a50-81dd-411e-a2c3-7f4f0416e76f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:20.256883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af4a50-81dd-411e-a2c3-7f4f0416e76f service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:20.257262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af4a50-81dd-411e-a2c3-7f4f0416e76f service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:20.258011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af4a50-81dd-411e-a2c3-7f4f0416e76f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:20.263748 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27844f13-d0d1-440a-8df7-4ac7bd8e23f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:20.265347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27844f13-d0d1-440a-8df7-4ac7bd8e23f4 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:20.269244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af4a50-81dd-411e-a2c3-7f4f0416e76f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:20.271365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af4a50-81dd-411e-a2c3-7f4f0416e76f service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:20.292570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 812/1645] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:20.302322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 834/1646] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:21.922406 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af4a50-81dd-411e-a2c3-7f4f0416e76f service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:21.922406 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-53af4a50-81dd-411e-a2c3-7f4f0416e76f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:21.922406 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af4a50-81dd-411e-a2c3-7f4f0416e76f service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:21.931897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c926de-fedb-4810-a782-be618719aa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:21.931897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c926de-fedb-4810-a782-be618719aa31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:21.931897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c926de-fedb-4810-a782-be618719aa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:21.931897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c926de-fedb-4810-a782-be618719aa31 admin admin] PATH_INFO: `/v3/users/a2174ff764674e46abba60e181e39dd8` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:21.940607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c926de-fedb-4810-a782-be618719aa31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2174ff764674e46abba60e181e39dd8)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:21.940607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c926de-fedb-4810-a782-be618719aa31 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:21.955122 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27844f13-d0d1-440a-8df7-4ac7bd8e23f4 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:21.958652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-27844f13-d0d1-440a-8df7-4ac7bd8e23f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:21.989988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:21.995120 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27844f13-d0d1-440a-8df7-4ac7bd8e23f4 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:22.011022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c220e-af04-4021-97a0-c2f6f5ed2824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:22.011951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c220e-af04-4021-97a0-c2f6f5ed2824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:22.012234 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c220e-af04-4021-97a0-c2f6f5ed2824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:22.013043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c220e-af04-4021-97a0-c2f6f5ed2824 admin admin] PATH_INFO: `/v3/projects/8d78ea14ef49475dbdb5cf1a4d62dbf9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:22.019503 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c220e-af04-4021-97a0-c2f6f5ed2824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d78ea14ef49475dbdb5cf1a4d62dbf9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:22.020832 dv-cinder-847730-4-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-674c220e-af04-4021-97a0-c2f6f5ed2824 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:28:22.020832 dv-cinder-847730-4-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 12 03:28:22.020832 dv-cinder-847730-4-smb devstack@keystone.service[80398]: Jul 12 03:28:22.023391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c220e-af04-4021-97a0-c2f6f5ed2824 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:22.039235 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:22.068552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-52c926de-fedb-4810-a782-be618719aa31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2174ff764674e46abba60e181e39dd8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:22.088843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-52c926de-fedb-4810-a782-be618719aa31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2174ff764674e46abba60e181e39dd8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:22.137899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-52c926de-fedb-4810-a782-be618719aa31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2174ff764674e46abba60e181e39dd8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:22.141257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-52c926de-fedb-4810-a782-be618719aa31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2174ff764674e46abba60e181e39dd8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:22.157656 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-674c220e-af04-4021-97a0-c2f6f5ed2824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d78ea14ef49475dbdb5cf1a4d62dbf9', 'request_id': 'req-674c220e-af04-4021-97a0-c2f6f5ed2824'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:22.172208 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-52c926de-fedb-4810-a782-be618719aa31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2174ff764674e46abba60e181e39dd8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:22.179603 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-674c220e-af04-4021-97a0-c2f6f5ed2824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d78ea14ef49475dbdb5cf1a4d62dbf9', 'request_id': 'req-674c220e-af04-4021-97a0-c2f6f5ed2824'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:22.198744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-674c220e-af04-4021-97a0-c2f6f5ed2824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d78ea14ef49475dbdb5cf1a4d62dbf9', 'request_id': 'req-674c220e-af04-4021-97a0-c2f6f5ed2824'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:22.203735 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 813/1647] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:28:21 2022] DELETE /identity/v3/users/a2174ff764674e46abba60e181e39dd8 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:22.213590 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaddc5-f0f3-4f8b-9e7a-209cb4245aaa None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:22.214337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaddc5-f0f3-4f8b-9e7a-209cb4245aaa None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:22.216454 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaddc5-f0f3-4f8b-9e7a-209cb4245aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:22.265293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-674c220e-af04-4021-97a0-c2f6f5ed2824 admin admin] The token cache is being invalidate because project 8d78ea14ef49475dbdb5cf1a4d62dbf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:28:22.265690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-674c220e-af04-4021-97a0-c2f6f5ed2824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:22.267720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-674c220e-af04-4021-97a0-c2f6f5ed2824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:22.271571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 835/1648] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:28:21 2022] DELETE /identity/v3/projects/8d78ea14ef49475dbdb5cf1a4d62dbf9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:22.275696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c220e-af04-4021-97a0-c2f6f5ed2824 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:22.281048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-674c220e-af04-4021-97a0-c2f6f5ed2824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:22.321226 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-24aaddc5-f0f3-4f8b-9e7a-209cb4245aaa None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:22.328249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-24aaddc5-f0f3-4f8b-9e7a-209cb4245aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:22.447172 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c220e-af04-4021-97a0-c2f6f5ed2824 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:22.553108 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 814/1649] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:22.599618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc959c-aa95-4925-89f4-047c754fbc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:22.609742 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc959c-aa95-4925-89f4-047c754fbc8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:22.610377 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc959c-aa95-4925-89f4-047c754fbc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:22.611091 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc959c-aa95-4925-89f4-047c754fbc8a admin admin] PATH_INFO: `/v3/users/1985ba4ff523483e83ad1474cb7a6745` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:22.614290 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc959c-aa95-4925-89f4-047c754fbc8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1985ba4ff523483e83ad1474cb7a6745)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:22.617606 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc959c-aa95-4925-89f4-047c754fbc8a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:22.665294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaddc5-f0f3-4f8b-9e7a-209cb4245aaa None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:22.666962 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-24aaddc5-f0f3-4f8b-9e7a-209cb4245aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:22.713520 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:22.719700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4bc959c-aa95-4925-89f4-047c754fbc8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1985ba4ff523483e83ad1474cb7a6745'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:22.738882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4bc959c-aa95-4925-89f4-047c754fbc8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1985ba4ff523483e83ad1474cb7a6745'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:22.758143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4bc959c-aa95-4925-89f4-047c754fbc8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1985ba4ff523483e83ad1474cb7a6745'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:22.765702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4bc959c-aa95-4925-89f4-047c754fbc8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1985ba4ff523483e83ad1474cb7a6745'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:22.843274 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4bc959c-aa95-4925-89f4-047c754fbc8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1985ba4ff523483e83ad1474cb7a6745'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:22.862185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 836/1650] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:28:22 2022] DELETE /identity/v3/users/1985ba4ff523483e83ad1474cb7a6745 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:28:22.899156 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaddc5-f0f3-4f8b-9e7a-209cb4245aaa None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:23.086834 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e26ac-5897-4702-ae0e-bb002fcb35c8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:23.087946 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e26ac-5897-4702-ae0e-bb002fcb35c8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:23.088394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e26ac-5897-4702-ae0e-bb002fcb35c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:23.130109 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82042f52-4971-44b1-a822-8f40b127345d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:23.131506 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82042f52-4971-44b1-a822-8f40b127345d service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:23.131963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82042f52-4971-44b1-a822-8f40b127345d service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:23.132403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82042f52-4971-44b1-a822-8f40b127345d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:23.138218 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-82042f52-4971-44b1-a822-8f40b127345d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:23.170296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:23.182096 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2d4e26ac-5897-4702-ae0e-bb002fcb35c8 None None] MFA Rules not processed for user `872b6a446a414f23adf24a3fde1b681f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:23.193062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2d4e26ac-5897-4702-ae0e-bb002fcb35c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:23.347712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82042f52-4971-44b1-a822-8f40b127345d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:23.350549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82042f52-4971-44b1-a822-8f40b127345d service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:23.383093 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 815/1651] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:28:23.423315 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 837/1652] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:23 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:23.428267 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82042f52-4971-44b1-a822-8f40b127345d service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:23.429959 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-82042f52-4971-44b1-a822-8f40b127345d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:23.454833 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82042f52-4971-44b1-a822-8f40b127345d service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:23.475114 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16274013-4d22-4189-85b7-8682bc36ffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:23.476149 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16274013-4d22-4189-85b7-8682bc36ffcf admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:23.476732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16274013-4d22-4189-85b7-8682bc36ffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:23.477200 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16274013-4d22-4189-85b7-8682bc36ffcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:23.478134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16274013-4d22-4189-85b7-8682bc36ffcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:23.481300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16274013-4d22-4189-85b7-8682bc36ffcf admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:23.554535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 816/1653] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:23 2022] POST /identity/v3/projects => generated 403 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:23.555462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e26ac-5897-4702-ae0e-bb002fcb35c8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:23.585794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16274013-4d22-4189-85b7-8682bc36ffcf admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:23.586044 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e26ac-5897-4702-ae0e-bb002fcb35c8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:23.593381 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-16274013-4d22-4189-85b7-8682bc36ffcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:23.741252 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a3cad-94aa-46d5-96ef-80d6f7adcca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:23.742096 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a3cad-94aa-46d5-96ef-80d6f7adcca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:23.742484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a3cad-94aa-46d5-96ef-80d6f7adcca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:23.742854 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a3cad-94aa-46d5-96ef-80d6f7adcca8 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:23.743659 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a3cad-94aa-46d5-96ef-80d6f7adcca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:23.745774 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a3cad-94aa-46d5-96ef-80d6f7adcca8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:23.772943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16274013-4d22-4189-85b7-8682bc36ffcf admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:23.779935 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fcc56-4d61-4d60-81a9-9b4f7ab49931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:23.781622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fcc56-4d61-4d60-81a9-9b4f7ab49931 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:23.782081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fcc56-4d61-4d60-81a9-9b4f7ab49931 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:23.783062 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fcc56-4d61-4d60-81a9-9b4f7ab49931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:23.786003 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d08fcc56-4d61-4d60-81a9-9b4f7ab49931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:23.798451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 838/1654] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:23 2022] POST /identity/v3/users => generated 308 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:28:23.799749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a3cad-94aa-46d5-96ef-80d6f7adcca8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:23.817083 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a3cad-94aa-46d5-96ef-80d6f7adcca8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:23.837385 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca669676-89e4-4c22-b7af-353aafebf9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:23.838222 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca669676-89e4-4c22-b7af-353aafebf9cb admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:23.838610 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca669676-89e4-4c22-b7af-353aafebf9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:23.838980 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca669676-89e4-4c22-b7af-353aafebf9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:23.842206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca669676-89e4-4c22-b7af-353aafebf9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:23.844121 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca669676-89e4-4c22-b7af-353aafebf9cb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:23.881392 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 839/1655] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:23.883142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca669676-89e4-4c22-b7af-353aafebf9cb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:23.898841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca669676-89e4-4c22-b7af-353aafebf9cb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:23.913457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be6fe3-dd05-4b59-b81c-e4a870682a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:23.914529 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be6fe3-dd05-4b59-b81c-e4a870682a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:23.914846 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be6fe3-dd05-4b59-b81c-e4a870682a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:23.915245 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be6fe3-dd05-4b59-b81c-e4a870682a11 admin admin] PATH_INFO: `/v3/projects/67ee8181156d4ea1977bcc0df1788769/users/3cf2b98d95a246d2ab0bb4e84e59516a/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:23.958412 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be6fe3-dd05-4b59-b81c-e4a870682a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ee8181156d4ea1977bcc0df1788769, user_id=3cf2b98d95a246d2ab0bb4e84e59516a, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:23.961432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be6fe3-dd05-4b59-b81c-e4a870682a11 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:23.985835 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 840/1656] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:23 2022] PUT /identity/v3/projects/67ee8181156d4ea1977bcc0df1788769/users/3cf2b98d95a246d2ab0bb4e84e59516a/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:23.989811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be6fe3-dd05-4b59-b81c-e4a870682a11 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:24.008818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:24.021739 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fcc56-4d61-4d60-81a9-9b4f7ab49931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:24.027451 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fcc56-4d61-4d60-81a9-9b4f7ab49931 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:24.071554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 817/1657] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:24.101427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fcc56-4d61-4d60-81a9-9b4f7ab49931 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:24.104665 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d08fcc56-4d61-4d60-81a9-9b4f7ab49931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:24.135735 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fcc56-4d61-4d60-81a9-9b4f7ab49931 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:24.208386 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be6fe3-dd05-4b59-b81c-e4a870682a11 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:24.220458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:24.223186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e532a5-5139-4dd8-8607-e6e091a37052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:24.223916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e532a5-5139-4dd8-8607-e6e091a37052 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:24.224344 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e532a5-5139-4dd8-8607-e6e091a37052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:24.235369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e532a5-5139-4dd8-8607-e6e091a37052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:24.236478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e532a5-5139-4dd8-8607-e6e091a37052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:24.238698 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e532a5-5139-4dd8-8607-e6e091a37052 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:24.275813 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 841/1658] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:24.280034 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e532a5-5139-4dd8-8607-e6e091a37052 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:24.296570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e532a5-5139-4dd8-8607-e6e091a37052 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:24.309676 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ae498-993b-47be-877f-4e54e0d9992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:24.311097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ae498-993b-47be-877f-4e54e0d9992a admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:24.311556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ae498-993b-47be-877f-4e54e0d9992a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:24.312026 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ae498-993b-47be-877f-4e54e0d9992a admin admin] PATH_INFO: `/v3/projects/67ee8181156d4ea1977bcc0df1788769/users/3cf2b98d95a246d2ab0bb4e84e59516a/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:24.314509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ae498-993b-47be-877f-4e54e0d9992a admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ee8181156d4ea1977bcc0df1788769, user_id=3cf2b98d95a246d2ab0bb4e84e59516a, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:24.318532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ae498-993b-47be-877f-4e54e0d9992a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:24.350008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8291ddc-d4d2-4ff7-88e3-2bd1491450a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:24.350833 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8291ddc-d4d2-4ff7-88e3-2bd1491450a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:24.351111 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8291ddc-d4d2-4ff7-88e3-2bd1491450a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:24.358291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8291ddc-d4d2-4ff7-88e3-2bd1491450a2 admin admin] PATH_INFO: `/v3/projects/c56a5518721b43a488bb0d1063402281` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:24.359845 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8291ddc-d4d2-4ff7-88e3-2bd1491450a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c56a5518721b43a488bb0d1063402281)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:24.361806 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8291ddc-d4d2-4ff7-88e3-2bd1491450a2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:24.366384 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 842/1659] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:24 2022] PUT /identity/v3/projects/67ee8181156d4ea1977bcc0df1788769/users/3cf2b98d95a246d2ab0bb4e84e59516a/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:28:24.474143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f8291ddc-d4d2-4ff7-88e3-2bd1491450a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c56a5518721b43a488bb0d1063402281', 'request_id': 'req-f8291ddc-d4d2-4ff7-88e3-2bd1491450a2'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:24.489250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f8291ddc-d4d2-4ff7-88e3-2bd1491450a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c56a5518721b43a488bb0d1063402281', 'request_id': 'req-f8291ddc-d4d2-4ff7-88e3-2bd1491450a2'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:24.510853 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f8291ddc-d4d2-4ff7-88e3-2bd1491450a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c56a5518721b43a488bb0d1063402281', 'request_id': 'req-f8291ddc-d4d2-4ff7-88e3-2bd1491450a2'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:24.531052 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f8291ddc-d4d2-4ff7-88e3-2bd1491450a2 admin admin] The token cache is being invalidate because project c56a5518721b43a488bb0d1063402281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:28:24.531577 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f8291ddc-d4d2-4ff7-88e3-2bd1491450a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:24.532394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f8291ddc-d4d2-4ff7-88e3-2bd1491450a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:24.535000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 818/1660] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:28:24 2022] DELETE /identity/v3/projects/c56a5518721b43a488bb0d1063402281 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:28:24.539947 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5775e-d115-4e82-b523-c28c6381b7a0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:24.540267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5775e-d115-4e82-b523-c28c6381b7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:24.540580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5775e-d115-4e82-b523-c28c6381b7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:24.577812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c4a5775e-d115-4e82-b523-c28c6381b7a0 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:24.583236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c4a5775e-d115-4e82-b523-c28c6381b7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:24.827775 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 843/1661] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:24.835905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b446ad7-82e6-43c0-9a2a-f701ab2bb524 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:24.836512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b446ad7-82e6-43c0-9a2a-f701ab2bb524 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:24.837498 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b446ad7-82e6-43c0-9a2a-f701ab2bb524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:24.880989 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-1b446ad7-82e6-43c0-9a2a-f701ab2bb524 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:24.883511 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1b446ad7-82e6-43c0-9a2a-f701ab2bb524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:24.903111 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 819/1662] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:24.907788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5775e-d115-4e82-b523-c28c6381b7a0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:24.920966 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5775e-d115-4e82-b523-c28c6381b7a0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:24.926377 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe8a9b-3fee-4e16-94c3-89c914b4c914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:24.927444 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe8a9b-3fee-4e16-94c3-89c914b4c914 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:24.927811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe8a9b-3fee-4e16-94c3-89c914b4c914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:24.928223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe8a9b-3fee-4e16-94c3-89c914b4c914 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:24.929320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe8a9b-3fee-4e16-94c3-89c914b4c914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:28:24.929690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe8a9b-3fee-4e16-94c3-89c914b4c914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:24.931629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe8a9b-3fee-4e16-94c3-89c914b4c914 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:24.949910 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 844/1663] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:28:24.950620 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b446ad7-82e6-43c0-9a2a-f701ab2bb524 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:24.971828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b446ad7-82e6-43c0-9a2a-f701ab2bb524 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:24.980276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e560481-64f2-44e5-b720-494eb9a3891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:24.981222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560481-64f2-44e5-b720-494eb9a3891e admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:24.982006 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560481-64f2-44e5-b720-494eb9a3891e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:24.982006 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560481-64f2-44e5-b720-494eb9a3891e admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:24.983501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e560481-64f2-44e5-b720-494eb9a3891e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:24.992767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e560481-64f2-44e5-b720-494eb9a3891e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:25.076156 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 820/1664] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:24 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:28:25.080484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe8a9b-3fee-4e16-94c3-89c914b4c914 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:25.102311 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe8a9b-3fee-4e16-94c3-89c914b4c914 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:25.296847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76ac65-db86-4b28-9742-a80b06a83706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:25.297314 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76ac65-db86-4b28-9742-a80b06a83706 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:25.297314 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76ac65-db86-4b28-9742-a80b06a83706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:25.297750 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76ac65-db86-4b28-9742-a80b06a83706 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:25.298284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76ac65-db86-4b28-9742-a80b06a83706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:25.300344 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76ac65-db86-4b28-9742-a80b06a83706 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:25.384607 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 845/1665] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:25 2022] POST /identity/v3/users => generated 290 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:28:25.385498 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e560481-64f2-44e5-b720-494eb9a3891e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:25.416238 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e560481-64f2-44e5-b720-494eb9a3891e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:25.427925 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f88c30-2dbe-4522-bc35-215c05e05464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:25.428673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f88c30-2dbe-4522-bc35-215c05e05464 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:25.429098 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f88c30-2dbe-4522-bc35-215c05e05464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:25.429348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f88c30-2dbe-4522-bc35-215c05e05464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:25.430092 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f88c30-2dbe-4522-bc35-215c05e05464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:25.431805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f88c30-2dbe-4522-bc35-215c05e05464 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:25.455956 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 821/1666] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:28:25.460733 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76ac65-db86-4b28-9742-a80b06a83706 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:25.468729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:25.476890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76ac65-db86-4b28-9742-a80b06a83706 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:25.488258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180c387-6c22-4b56-bdab-b6ededc64484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:25.492260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180c387-6c22-4b56-bdab-b6ededc64484 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:25.492613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180c387-6c22-4b56-bdab-b6ededc64484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:25.492962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180c387-6c22-4b56-bdab-b6ededc64484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:25.496268 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180c387-6c22-4b56-bdab-b6ededc64484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:25.498939 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180c387-6c22-4b56-bdab-b6ededc64484 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:25.537472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 846/1667] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:25.544407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f88c30-2dbe-4522-bc35-215c05e05464 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:25.563388 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f88c30-2dbe-4522-bc35-215c05e05464 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:25.606594 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a994176-13d2-40b6-a779-e50d17e518cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:25.607528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a994176-13d2-40b6-a779-e50d17e518cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:25.607804 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a994176-13d2-40b6-a779-e50d17e518cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:25.608083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a994176-13d2-40b6-a779-e50d17e518cf admin admin] PATH_INFO: `/v3/projects/9b100d47b8b2484abbe9f1090e157c4f/users/cfbb961c9d6d494a84477ce08d43b6f5/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:25.654513 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a994176-13d2-40b6-a779-e50d17e518cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b100d47b8b2484abbe9f1090e157c4f, user_id=cfbb961c9d6d494a84477ce08d43b6f5, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:25.657297 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a994176-13d2-40b6-a779-e50d17e518cf admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:25.698676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 822/1668] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:25 2022] PUT /identity/v3/projects/9b100d47b8b2484abbe9f1090e157c4f/users/cfbb961c9d6d494a84477ce08d43b6f5/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:28:25.712239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cea6a6-be40-4c91-95c6-e7a872767d95 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:25.712580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cea6a6-be40-4c91-95c6-e7a872767d95 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:25.712833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cea6a6-be40-4c91-95c6-e7a872767d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:25.779788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-65cea6a6-be40-4c91-95c6-e7a872767d95 None None] MFA Rules not processed for user `cfbb961c9d6d494a84477ce08d43b6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:25.790718 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-65cea6a6-be40-4c91-95c6-e7a872767d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:25.963675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 847/1669] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:25.970403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a994176-13d2-40b6-a779-e50d17e518cf admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:26.017269 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cea6a6-be40-4c91-95c6-e7a872767d95 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:26.018933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-65cea6a6-be40-4c91-95c6-e7a872767d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:26.173288 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:26.180693 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a994176-13d2-40b6-a779-e50d17e518cf admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:26.200674 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cf878-0188-49e6-ba45-920dd9bd1ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:26.201716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cf878-0188-49e6-ba45-920dd9bd1ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:26.206840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cf878-0188-49e6-ba45-920dd9bd1ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:26.207599 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cf878-0188-49e6-ba45-920dd9bd1ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:26.211668 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154cf878-0188-49e6-ba45-920dd9bd1ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:26.215501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154cf878-0188-49e6-ba45-920dd9bd1ea5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:26.217721 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cea6a6-be40-4c91-95c6-e7a872767d95 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:26.233662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15f312-fd6c-4e3a-89e2-46ebe28dc4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:26.244746 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15f312-fd6c-4e3a-89e2-46ebe28dc4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:26.245490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15f312-fd6c-4e3a-89e2-46ebe28dc4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:26.246377 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15f312-fd6c-4e3a-89e2-46ebe28dc4f6 admin admin] PATH_INFO: `/v3/projects/2015d437f55a4bba86e20eb8414fd30b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:26.251417 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15f312-fd6c-4e3a-89e2-46ebe28dc4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2015d437f55a4bba86e20eb8414fd30b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:26.257325 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15f312-fd6c-4e3a-89e2-46ebe28dc4f6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:26.330222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 823/1670] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:25 2022] POST /identity/v3/projects => generated 379 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:26.333080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cf878-0188-49e6-ba45-920dd9bd1ea5 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:26.409602 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cb15f312-fd6c-4e3a-89e2-46ebe28dc4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2015d437f55a4bba86e20eb8414fd30b', 'request_id': 'req-cb15f312-fd6c-4e3a-89e2-46ebe28dc4f6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:26.430437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cb15f312-fd6c-4e3a-89e2-46ebe28dc4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2015d437f55a4bba86e20eb8414fd30b', 'request_id': 'req-cb15f312-fd6c-4e3a-89e2-46ebe28dc4f6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:26.438556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cb15f312-fd6c-4e3a-89e2-46ebe28dc4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2015d437f55a4bba86e20eb8414fd30b', 'request_id': 'req-cb15f312-fd6c-4e3a-89e2-46ebe28dc4f6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:26.462659 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cb15f312-fd6c-4e3a-89e2-46ebe28dc4f6 admin admin] The token cache is being invalidate because project 2015d437f55a4bba86e20eb8414fd30b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:28:26.466052 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cb15f312-fd6c-4e3a-89e2-46ebe28dc4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:26.467972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cb15f312-fd6c-4e3a-89e2-46ebe28dc4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:26.472141 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 848/1671] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:28:26 2022] DELETE /identity/v3/projects/2015d437f55a4bba86e20eb8414fd30b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:26.477325 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ec4d6-a135-4c8f-9d78-9bd2e8efb100 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:26.477718 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ec4d6-a135-4c8f-9d78-9bd2e8efb100 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:26.479222 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ec4d6-a135-4c8f-9d78-9bd2e8efb100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:26.517027 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-896ec4d6-a135-4c8f-9d78-9bd2e8efb100 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:26.518626 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cf878-0188-49e6-ba45-920dd9bd1ea5 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:26.520724 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-896ec4d6-a135-4c8f-9d78-9bd2e8efb100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:26.564114 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:26.665413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb17da-0d1a-4194-8324-fc2edcc1edeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:26.666234 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb17da-0d1a-4194-8324-fc2edcc1edeb admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:26.666410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb17da-0d1a-4194-8324-fc2edcc1edeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:26.666731 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb17da-0d1a-4194-8324-fc2edcc1edeb admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:26.667384 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb17da-0d1a-4194-8324-fc2edcc1edeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:26.669675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb17da-0d1a-4194-8324-fc2edcc1edeb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:26.698386 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 849/1672] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:26.706388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81313ebb-97a1-4b91-9232-d3b3d0e26111 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:26.706675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81313ebb-97a1-4b91-9232-d3b3d0e26111 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:26.707093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81313ebb-97a1-4b91-9232-d3b3d0e26111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:26.725492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 824/1673] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:26 2022] POST /identity/v3/users => generated 296 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:26.729662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb17da-0d1a-4194-8324-fc2edcc1edeb admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:26.741447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2cfb17da-0d1a-4194-8324-fc2edcc1edeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:26.757081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-81313ebb-97a1-4b91-9232-d3b3d0e26111 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:26.758321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-81313ebb-97a1-4b91-9232-d3b3d0e26111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:26.759649 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb17da-0d1a-4194-8324-fc2edcc1edeb admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:26.765499 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d93056-4c62-4b95-a497-4c048e596246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:26.766195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d93056-4c62-4b95-a497-4c048e596246 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:26.766522 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d93056-4c62-4b95-a497-4c048e596246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:26.766983 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d93056-4c62-4b95-a497-4c048e596246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:26.767872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d93056-4c62-4b95-a497-4c048e596246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:26.771565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d93056-4c62-4b95-a497-4c048e596246 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:26.778196 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 850/1674] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:26.782353 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81313ebb-97a1-4b91-9232-d3b3d0e26111 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:26.788206 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 825/1675] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:28:26.792144 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d93056-4c62-4b95-a497-4c048e596246 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:26.799662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81313ebb-97a1-4b91-9232-d3b3d0e26111 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:26.814143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f7f43-f82e-45c8-9fb4-20ac6248810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:26.814833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f7f43-f82e-45c8-9fb4-20ac6248810d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:26.815538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f7f43-f82e-45c8-9fb4-20ac6248810d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:26.815538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f7f43-f82e-45c8-9fb4-20ac6248810d admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:26.816214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f7f43-f82e-45c8-9fb4-20ac6248810d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:28:26.816610 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f7f43-f82e-45c8-9fb4-20ac6248810d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:26.818051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d93056-4c62-4b95-a497-4c048e596246 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:26.829089 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfbe94-bc24-4299-bef6-602ac3113197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:26.829639 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f7f43-f82e-45c8-9fb4-20ac6248810d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:26.831372 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfbe94-bc24-4299-bef6-602ac3113197 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:26.831656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfbe94-bc24-4299-bef6-602ac3113197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:26.832011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfbe94-bc24-4299-bef6-602ac3113197 admin admin] PATH_INFO: `/v3/projects/ee298cb1258347a7a21dffe28dff1a9d/users/4cbfeb9dd22c4f0699d55742cd365677/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:26.868677 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 851/1676] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:28:26.870285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f7f43-f82e-45c8-9fb4-20ac6248810d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:26.874094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfbe94-bc24-4299-bef6-602ac3113197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee298cb1258347a7a21dffe28dff1a9d, user_id=4cbfeb9dd22c4f0699d55742cd365677, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:26.879527 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfbe94-bc24-4299-bef6-602ac3113197 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:26.890354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f7f43-f82e-45c8-9fb4-20ac6248810d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:26.904765 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8127d-b11f-4942-86ea-d3ac2a6c230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:26.906215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8127d-b11f-4942-86ea-d3ac2a6c230d admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:26.907308 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8127d-b11f-4942-86ea-d3ac2a6c230d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:26.907608 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8127d-b11f-4942-86ea-d3ac2a6c230d admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:26.909305 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8127d-b11f-4942-86ea-d3ac2a6c230d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:26.914312 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 826/1677] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:26 2022] PUT /identity/v3/projects/ee298cb1258347a7a21dffe28dff1a9d/users/4cbfeb9dd22c4f0699d55742cd365677/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:26.914429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8127d-b11f-4942-86ea-d3ac2a6c230d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:26.915382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfbe94-bc24-4299-bef6-602ac3113197 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:26.974778 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 852/1678] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:26 2022] POST /identity/v3/projects => generated 355 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:28:26.977935 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8127d-b11f-4942-86ea-d3ac2a6c230d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:27.023856 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:27.064720 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfbe94-bc24-4299-bef6-602ac3113197 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:27.099500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8127d-b11f-4942-86ea-d3ac2a6c230d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:27.106076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8b16b-7a2a-4673-be91-ff31f12695c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:27.106931 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8b16b-7a2a-4673-be91-ff31f12695c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:27.107716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8b16b-7a2a-4673-be91-ff31f12695c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:27.108099 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8b16b-7a2a-4673-be91-ff31f12695c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:27.109215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8b16b-7a2a-4673-be91-ff31f12695c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:27.112187 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8b16b-7a2a-4673-be91-ff31f12695c7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:27.157546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 853/1679] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:26 2022] POST /identity/v3/users => generated 278 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:27.160770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8b16b-7a2a-4673-be91-ff31f12695c7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:27.188601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8b16b-7a2a-4673-be91-ff31f12695c7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:27.193674 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121634e-ec6b-44a8-89ab-8994d5c6cee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:27.196314 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121634e-ec6b-44a8-89ab-8994d5c6cee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:27.197297 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121634e-ec6b-44a8-89ab-8994d5c6cee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:27.197684 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121634e-ec6b-44a8-89ab-8994d5c6cee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:27.200943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121634e-ec6b-44a8-89ab-8994d5c6cee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:27.205820 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194ec27-2531-4feb-adbd-d141c11ef9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:27.206518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194ec27-2531-4feb-adbd-d141c11ef9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:27.207619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121634e-ec6b-44a8-89ab-8994d5c6cee9 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:27.208652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194ec27-2531-4feb-adbd-d141c11ef9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:27.209031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194ec27-2531-4feb-adbd-d141c11ef9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:27.209793 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194ec27-2531-4feb-adbd-d141c11ef9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:27.213792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194ec27-2531-4feb-adbd-d141c11ef9a9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:27.232870 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 854/1680] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:27.236327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 827/1681] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:27.236617 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194ec27-2531-4feb-adbd-d141c11ef9a9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:27.240312 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121634e-ec6b-44a8-89ab-8994d5c6cee9 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:27.258179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194ec27-2531-4feb-adbd-d141c11ef9a9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:27.262582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121634e-ec6b-44a8-89ab-8994d5c6cee9 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:27.267735 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f77e5-4531-4822-81d1-cfec0f6cbe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:27.269495 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f77e5-4531-4822-81d1-cfec0f6cbe22 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:27.270705 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f77e5-4531-4822-81d1-cfec0f6cbe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:27.271452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedfeab-f8ad-42ec-a3dc-e55411ddef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:27.272433 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedfeab-f8ad-42ec-a3dc-e55411ddef82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:27.272715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedfeab-f8ad-42ec-a3dc-e55411ddef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:27.273137 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedfeab-f8ad-42ec-a3dc-e55411ddef82 admin admin] PATH_INFO: `/v3/projects/ee298cb1258347a7a21dffe28dff1a9d/users/4cbfeb9dd22c4f0699d55742cd365677/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:27.274254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f77e5-4531-4822-81d1-cfec0f6cbe22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:27.278040 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfedfeab-f8ad-42ec-a3dc-e55411ddef82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee298cb1258347a7a21dffe28dff1a9d, user_id=4cbfeb9dd22c4f0699d55742cd365677, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:27.278811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f77e5-4531-4822-81d1-cfec0f6cbe22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:27.281999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f77e5-4531-4822-81d1-cfec0f6cbe22 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:27.286391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfedfeab-f8ad-42ec-a3dc-e55411ddef82 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:27.318895 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 855/1682] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:27.319861 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f77e5-4531-4822-81d1-cfec0f6cbe22 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:27.320755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 828/1683] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:27 2022] PUT /identity/v3/projects/ee298cb1258347a7a21dffe28dff1a9d/users/4cbfeb9dd22c4f0699d55742cd365677/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:28:27.330963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f26cf-cbff-4f0d-9d8a-7196f7ccb698 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:27.331308 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f26cf-cbff-4f0d-9d8a-7196f7ccb698 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:27.331591 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f26cf-cbff-4f0d-9d8a-7196f7ccb698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:27.338912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f77e5-4531-4822-81d1-cfec0f6cbe22 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:27.389055 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-938f26cf-cbff-4f0d-9d8a-7196f7ccb698 None None] MFA Rules not processed for user `4cbfeb9dd22c4f0699d55742cd365677`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:27.393774 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-938f26cf-cbff-4f0d-9d8a-7196f7ccb698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:27.442590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:27.490408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce7957-f343-4239-b4bc-dafea690a39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:27.491245 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce7957-f343-4239-b4bc-dafea690a39a admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:27.491519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce7957-f343-4239-b4bc-dafea690a39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:27.491787 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce7957-f343-4239-b4bc-dafea690a39a admin admin] PATH_INFO: `/v3/projects/a008e4498a3a4eecabd84209f4aead4e/users/f18c5d76d90e4b5db0cf4e3d75acbf3b/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:27.528684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce7957-f343-4239-b4bc-dafea690a39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a008e4498a3a4eecabd84209f4aead4e, user_id=f18c5d76d90e4b5db0cf4e3d75acbf3b, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:27.533787 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce7957-f343-4239-b4bc-dafea690a39a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:27.562690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 856/1684] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:27 2022] PUT /identity/v3/projects/a008e4498a3a4eecabd84209f4aead4e/users/f18c5d76d90e4b5db0cf4e3d75acbf3b/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:27.574221 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156c4a7-d8c7-409d-a2d2-2633e11be3ad None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:27.574755 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156c4a7-d8c7-409d-a2d2-2633e11be3ad None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:27.575484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156c4a7-d8c7-409d-a2d2-2633e11be3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:27.584291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 829/1685] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:27.595465 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f26cf-cbff-4f0d-9d8a-7196f7ccb698 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:27.597700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-938f26cf-cbff-4f0d-9d8a-7196f7ccb698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:27.633976 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b156c4a7-d8c7-409d-a2d2-2633e11be3ad None None] MFA Rules not processed for user `f18c5d76d90e4b5db0cf4e3d75acbf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:27.637289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b156c4a7-d8c7-409d-a2d2-2633e11be3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:27.802287 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f26cf-cbff-4f0d-9d8a-7196f7ccb698 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:27.845580 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:27.915028 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 857/1686] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:27 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:27.917216 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156c4a7-d8c7-409d-a2d2-2633e11be3ad None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:28.000296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e14c63-9e56-4a49-aa3c-76294d257152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:28.002520 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e14c63-9e56-4a49-aa3c-76294d257152 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:28.003043 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e14c63-9e56-4a49-aa3c-76294d257152 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:28.003407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e14c63-9e56-4a49-aa3c-76294d257152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:28.139734 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156c4a7-d8c7-409d-a2d2-2633e11be3ad None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:28.174945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e14c63-9e56-4a49-aa3c-76294d257152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:28.177600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e14c63-9e56-4a49-aa3c-76294d257152 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:28.183350 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14dd58-0b56-4bb7-a352-6d8f8917b733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:28.184148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14dd58-0b56-4bb7-a352-6d8f8917b733 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:28.188229 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14dd58-0b56-4bb7-a352-6d8f8917b733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:28.188557 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14dd58-0b56-4bb7-a352-6d8f8917b733 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:28.189441 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14dd58-0b56-4bb7-a352-6d8f8917b733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:28.193887 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 830/1687] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:28:28.195720 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224fd91-06f5-47d3-9153-2d5ecff1a21f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:28.196199 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224fd91-06f5-47d3-9153-2d5ecff1a21f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:28.196738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224fd91-06f5-47d3-9153-2d5ecff1a21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:28.199768 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14dd58-0b56-4bb7-a352-6d8f8917b733 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:28.256986 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 858/1688] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:27 2022] POST /identity/v3/projects => generated 355 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:28.257971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4224fd91-06f5-47d3-9153-2d5ecff1a21f None None] MFA Rules not processed for user `3cf2b98d95a246d2ab0bb4e84e59516a`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:28.259405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4224fd91-06f5-47d3-9153-2d5ecff1a21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:28.260852 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14dd58-0b56-4bb7-a352-6d8f8917b733 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:28.371104 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:28.405624 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14dd58-0b56-4bb7-a352-6d8f8917b733 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:28.419073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613d29c-bf1e-40b4-be5d-46afe0942708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:28.420108 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613d29c-bf1e-40b4-be5d-46afe0942708 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:28.420579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613d29c-bf1e-40b4-be5d-46afe0942708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:28.420971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613d29c-bf1e-40b4-be5d-46afe0942708 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:28.422067 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613d29c-bf1e-40b4-be5d-46afe0942708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:28.424423 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613d29c-bf1e-40b4-be5d-46afe0942708 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:28.444890 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 831/1689] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:28.444890 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6449e5-4876-4495-8b4c-e7fb0a8320ad None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:28.444890 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6449e5-4876-4495-8b4c-e7fb0a8320ad None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:28.444890 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6449e5-4876-4495-8b4c-e7fb0a8320ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:28.495776 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-1b6449e5-4876-4495-8b4c-e7fb0a8320ad None None] MFA Rules not processed for user `64d12add4bcf4da08cd5e8d68e13c3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:28.497150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1b6449e5-4876-4495-8b4c-e7fb0a8320ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:28.518305 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 859/1690] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:28 2022] POST /identity/v3/users => generated 284 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:28.520595 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613d29c-bf1e-40b4-be5d-46afe0942708 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:28.565334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613d29c-bf1e-40b4-be5d-46afe0942708 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:28.574765 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfb938-40a9-4ef3-84d7-334f2f73cc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:28.578401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfb938-40a9-4ef3-84d7-334f2f73cc5a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:28.578831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfb938-40a9-4ef3-84d7-334f2f73cc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:28.579265 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfb938-40a9-4ef3-84d7-334f2f73cc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:28.584242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfb938-40a9-4ef3-84d7-334f2f73cc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:28.586100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfb938-40a9-4ef3-84d7-334f2f73cc5a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:28.589344 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:28.614539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 860/1691] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:28.615528 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfb938-40a9-4ef3-84d7-334f2f73cc5a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:28.623729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d1bfb938-40a9-4ef3-84d7-334f2f73cc5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:28.661735 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 832/1692] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:28.661735 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6449e5-4876-4495-8b4c-e7fb0a8320ad None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:28.685471 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6449e5-4876-4495-8b4c-e7fb0a8320ad None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:28.694962 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f7826-5854-4683-aa8d-3743634258b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:28.695429 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f7826-5854-4683-aa8d-3743634258b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:28.695702 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f7826-5854-4683-aa8d-3743634258b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:28.696036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f7826-5854-4683-aa8d-3743634258b3 admin admin] PATH_INFO: `/v3/projects/cf8202d1364c4680845ef9553ac8b35c/users/337b9e9ccb50498a839ef7a9fd29349f/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:28.738933 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f7826-5854-4683-aa8d-3743634258b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8202d1364c4680845ef9553ac8b35c, user_id=337b9e9ccb50498a839ef7a9fd29349f, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:28.742267 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f7826-5854-4683-aa8d-3743634258b3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:28.771547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 833/1693] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:28 2022] PUT /identity/v3/projects/cf8202d1364c4680845ef9553ac8b35c/users/337b9e9ccb50498a839ef7a9fd29349f/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:28.772842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41a95c-7c78-4d2c-a744-c95c41ba770f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:28.772842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41a95c-7c78-4d2c-a744-c95c41ba770f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:28.773139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41a95c-7c78-4d2c-a744-c95c41ba770f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:28.779711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfb938-40a9-4ef3-84d7-334f2f73cc5a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:28.813559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3e41a95c-7c78-4d2c-a744-c95c41ba770f None None] MFA Rules not processed for user `64d12add4bcf4da08cd5e8d68e13c3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:28.819849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3e41a95c-7c78-4d2c-a744-c95c41ba770f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:28.907703 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc4cad-0518-4551-8de0-a88989cd01fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:28.908389 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc4cad-0518-4551-8de0-a88989cd01fd service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:28.908698 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc4cad-0518-4551-8de0-a88989cd01fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:28.908972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc4cad-0518-4551-8de0-a88989cd01fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:28.912709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d3cc4cad-0518-4551-8de0-a88989cd01fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:28.944105 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 834/1694] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:28.944105 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41a95c-7c78-4d2c-a744-c95c41ba770f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:29.040995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc4cad-0518-4551-8de0-a88989cd01fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:29.042456 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc4cad-0518-4551-8de0-a88989cd01fd service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:29.062824 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 861/1695] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:29.063756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc4cad-0518-4551-8de0-a88989cd01fd service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:29.073319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d3cc4cad-0518-4551-8de0-a88989cd01fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:29.078589 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41a95c-7c78-4d2c-a744-c95c41ba770f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:29.088465 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7422bd-f60d-4d71-b704-2b9090c2f4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:29.089298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7422bd-f60d-4d71-b704-2b9090c2f4df admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:29.089579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7422bd-f60d-4d71-b704-2b9090c2f4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:29.089851 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7422bd-f60d-4d71-b704-2b9090c2f4df admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:29.090588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7422bd-f60d-4d71-b704-2b9090c2f4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:29.093566 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7422bd-f60d-4d71-b704-2b9090c2f4df admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:29.117505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 835/1696] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:29.124563 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7422bd-f60d-4d71-b704-2b9090c2f4df admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:29.138319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:29.142087 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7422bd-f60d-4d71-b704-2b9090c2f4df admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:29.157619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd9da9-497a-4917-96a6-7d4bbc036957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:29.158800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd9da9-497a-4917-96a6-7d4bbc036957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:29.159228 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd9da9-497a-4917-96a6-7d4bbc036957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:29.159658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd9da9-497a-4917-96a6-7d4bbc036957 admin admin] PATH_INFO: `/v3/projects/cf8202d1364c4680845ef9553ac8b35c/users/337b9e9ccb50498a839ef7a9fd29349f/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:29.165597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd9da9-497a-4917-96a6-7d4bbc036957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8202d1364c4680845ef9553ac8b35c, user_id=337b9e9ccb50498a839ef7a9fd29349f, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:29.170031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd9da9-497a-4917-96a6-7d4bbc036957 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:29.196110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 836/1697] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:29 2022] PUT /identity/v3/projects/cf8202d1364c4680845ef9553ac8b35c/users/337b9e9ccb50498a839ef7a9fd29349f/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:29.210985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d66a03-d969-4a81-9dde-386b99dd4516 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:29.211278 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d66a03-d969-4a81-9dde-386b99dd4516 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:29.211553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d66a03-d969-4a81-9dde-386b99dd4516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:29.230131 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc4cad-0518-4551-8de0-a88989cd01fd service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:29.277241 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-55d66a03-d969-4a81-9dde-386b99dd4516 None None] MFA Rules not processed for user `337b9e9ccb50498a839ef7a9fd29349f`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:29.278493 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-55d66a03-d969-4a81-9dde-386b99dd4516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:29.363103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:29.399272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a9607-e5a6-4dc2-8d22-14d521da007c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:29.400572 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a9607-e5a6-4dc2-8d22-14d521da007c service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:29.400869 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a9607-e5a6-4dc2-8d22-14d521da007c service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:29.401142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a9607-e5a6-4dc2-8d22-14d521da007c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:29.515168 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a9607-e5a6-4dc2-8d22-14d521da007c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:29.516499 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 837/1698] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:29 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:29.516836 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a9607-e5a6-4dc2-8d22-14d521da007c service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:29.523949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d66a03-d969-4a81-9dde-386b99dd4516 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:29.541629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 862/1699] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:29.665117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d66a03-d969-4a81-9dde-386b99dd4516 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:29.677047 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534029a-478e-43ea-a6fb-8c988f09a9a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:29.677885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534029a-478e-43ea-a6fb-8c988f09a9a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:29.678272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534029a-478e-43ea-a6fb-8c988f09a9a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:29.678651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534029a-478e-43ea-a6fb-8c988f09a9a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:29.702413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534029a-478e-43ea-a6fb-8c988f09a9a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:29.703981 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534029a-478e-43ea-a6fb-8c988f09a9a3 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:29.737457 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 838/1700] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:29 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:28:29.900863 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a9607-e5a6-4dc2-8d22-14d521da007c service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:29.916362 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a9607-e5a6-4dc2-8d22-14d521da007c service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:29.920144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdb754-5ebb-40d9-b8f3-4e8cfa471764 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:29.920845 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdb754-5ebb-40d9-b8f3-4e8cfa471764 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:29.921122 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdb754-5ebb-40d9-b8f3-4e8cfa471764 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:29.921391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdb754-5ebb-40d9-b8f3-4e8cfa471764 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:30.055104 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bdb754-5ebb-40d9-b8f3-4e8cfa471764 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:30.056930 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bdb754-5ebb-40d9-b8f3-4e8cfa471764 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:30.066234 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:30.099807 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 863/1701] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:29 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:30.329185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7eeb5-7b34-43f7-b61a-4e9d1e0c8558 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:30.329718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7eeb5-7b34-43f7-b61a-4e9d1e0c8558 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:30.330316 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7eeb5-7b34-43f7-b61a-4e9d1e0c8558 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:30.333351 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 839/1702] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 03:28:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:28:30.350034 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbee87e-e5b8-446c-b4c5-e5592b382a45 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:30.350034 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbee87e-e5b8-446c-b4c5-e5592b382a45 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:30.350327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbee87e-e5b8-446c-b4c5-e5592b382a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:30.385908 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0bbee87e-e5b8-446c-b4c5-e5592b382a45 None None] MFA Rules not processed for user `361ad35021eb43cca46d9b66e6f24ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:30.387247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0bbee87e-e5b8-446c-b4c5-e5592b382a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:30.602621 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 864/1703] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 03:28:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:30.620737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a78f9-7cf5-410a-86c6-51e0bd64dfde None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:30.621327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a78f9-7cf5-410a-86c6-51e0bd64dfde None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:30.621608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a78f9-7cf5-410a-86c6-51e0bd64dfde None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:30.623689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 840/1704] 10.222.0.26 () {54 vars in 960 bytes} [Tue Jul 12 03:28:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:28:30.631409 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071e65d-493d-40e7-bdeb-59e68dc46e28 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:30.633950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071e65d-493d-40e7-bdeb-59e68dc46e28 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:30.634261 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071e65d-493d-40e7-bdeb-59e68dc46e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:30.708058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1071e65d-493d-40e7-bdeb-59e68dc46e28 None None] MFA Rules not processed for user `361ad35021eb43cca46d9b66e6f24ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:30.709340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1071e65d-493d-40e7-bdeb-59e68dc46e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:30.740939 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 865/1705] 10.222.0.26 () {58 vars in 1057 bytes} [Tue Jul 12 03:28:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:30.750117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a78f9-7cf5-410a-86c6-51e0bd64dfde None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:30.779398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a78f9-7cf5-410a-86c6-51e0bd64dfde None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:30.811558 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e0beb-bfa8-4cc1-9167-a5e64a7d6469 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '361ad35021eb43cca46d9b66e6f24ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:30.812752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e0beb-bfa8-4cc1-9167-a5e64a7d6469 service placement] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:30.813540 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e0beb-bfa8-4cc1-9167-a5e64a7d6469 service placement] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:30.813651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e0beb-bfa8-4cc1-9167-a5e64a7d6469 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:30.828315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e0beb-bfa8-4cc1-9167-a5e64a7d6469 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:30.831812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e0beb-bfa8-4cc1-9167-a5e64a7d6469 service placement] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:30.850793 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 841/1706] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:31.475025 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b14115-b3f6-498b-ad89-af7405f12cad None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:31.475594 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b14115-b3f6-498b-ad89-af7405f12cad None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:31.476406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b14115-b3f6-498b-ad89-af7405f12cad None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:31.480956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 866/1707] 10.222.0.26 () {54 vars in 912 bytes} [Tue Jul 12 03:28:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:28:31.505786 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0ea88-4cc2-4d81-b5a6-eed313fb227a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:31.506486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0ea88-4cc2-4d81-b5a6-eed313fb227a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:31.508338 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0ea88-4cc2-4d81-b5a6-eed313fb227a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:31.666457 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c2a0ea88-4cc2-4d81-b5a6-eed313fb227a None None] MFA Rules not processed for user `c2908efc19944583810abceb4c5d8d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:31.668049 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c2a0ea88-4cc2-4d81-b5a6-eed313fb227a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:31.829854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 842/1708] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 03:28:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:28:32.133205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b14115-b3f6-498b-ad89-af7405f12cad None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:32.135117 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-54b14115-b3f6-498b-ad89-af7405f12cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:32.166701 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b14115-b3f6-498b-ad89-af7405f12cad None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:32.177565 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fb123-d014-4edd-aa56-a1a7cd146299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:32.178794 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fb123-d014-4edd-aa56-a1a7cd146299 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:32.178942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fb123-d014-4edd-aa56-a1a7cd146299 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:32.179223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fb123-d014-4edd-aa56-a1a7cd146299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:32.224175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fb123-d014-4edd-aa56-a1a7cd146299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:32.228264 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fb123-d014-4edd-aa56-a1a7cd146299 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:32.252479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 867/1709] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:32.780268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55393f-d739-445f-b74a-4619446c752d None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:32.781160 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55393f-d739-445f-b74a-4619446c752d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:32.781592 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55393f-d739-445f-b74a-4619446c752d None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:32.783235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 843/1710] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 03:28:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:28:32.804964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1c39c-f9d4-4798-b6f8-7c1a952b40dc None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:32.805567 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1c39c-f9d4-4798-b6f8-7c1a952b40dc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:32.806027 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1c39c-f9d4-4798-b6f8-7c1a952b40dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:32.847648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-47b1c39c-f9d4-4798-b6f8-7c1a952b40dc None None] MFA Rules not processed for user `361ad35021eb43cca46d9b66e6f24ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:32.849601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-47b1c39c-f9d4-4798-b6f8-7c1a952b40dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:32.874652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 868/1711] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 03:28:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:32.964179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55393f-d739-445f-b74a-4619446c752d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:32.982051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1c39c-f9d4-4798-b6f8-7c1a952b40dc None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:32.984910 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-47b1c39c-f9d4-4798-b6f8-7c1a952b40dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:33.007750 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55393f-d739-445f-b74a-4619446c752d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:33.046907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4dd53-705e-4e25-9dcf-a9b32af77d74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '361ad35021eb43cca46d9b66e6f24ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:33.047578 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4dd53-705e-4e25-9dcf-a9b32af77d74 service placement] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:33.047855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4dd53-705e-4e25-9dcf-a9b32af77d74 service placement] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:33.048125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4dd53-705e-4e25-9dcf-a9b32af77d74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:33.089133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4dd53-705e-4e25-9dcf-a9b32af77d74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:33.090781 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4dd53-705e-4e25-9dcf-a9b32af77d74 service placement] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:33.153928 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 844/1712] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:33.204420 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1c39c-f9d4-4798-b6f8-7c1a952b40dc None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:33.211235 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3376e4-b24d-4807-88bf-fe31d75e9f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:33.213699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3376e4-b24d-4807-88bf-fe31d75e9f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:33.214162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3376e4-b24d-4807-88bf-fe31d75e9f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:33.214585 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3376e4-b24d-4807-88bf-fe31d75e9f65 admin admin] PATH_INFO: `/v3/users/872b6a446a414f23adf24a3fde1b681f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:33.216312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3376e4-b24d-4807-88bf-fe31d75e9f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=872b6a446a414f23adf24a3fde1b681f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:33.218875 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3376e4-b24d-4807-88bf-fe31d75e9f65 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:33.406508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6b3376e4-b24d-4807-88bf-fe31d75e9f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872b6a446a414f23adf24a3fde1b681f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:33.427892 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6b3376e4-b24d-4807-88bf-fe31d75e9f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872b6a446a414f23adf24a3fde1b681f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:33.439392 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6b3376e4-b24d-4807-88bf-fe31d75e9f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872b6a446a414f23adf24a3fde1b681f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:33.441829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6b3376e4-b24d-4807-88bf-fe31d75e9f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872b6a446a414f23adf24a3fde1b681f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:33.460890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:33.472136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6b3376e4-b24d-4807-88bf-fe31d75e9f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872b6a446a414f23adf24a3fde1b681f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:33.494046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 869/1713] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:28:32 2022] DELETE /identity/v3/users/872b6a446a414f23adf24a3fde1b681f => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:33.937614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4dd53-705e-4e25-9dcf-a9b32af77d74 service placement] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:33.954970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4dd53-705e-4e25-9dcf-a9b32af77d74 service placement] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:34.025230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:34.054675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860e381-33dc-498f-9f97-30998005d015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:34.059397 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860e381-33dc-498f-9f97-30998005d015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:34.059859 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860e381-33dc-498f-9f97-30998005d015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:34.060321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860e381-33dc-498f-9f97-30998005d015 admin admin] PATH_INFO: `/v3/projects/3bf23e3c25634ef3ac4eb3d7b2cbe76e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:34.061855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860e381-33dc-498f-9f97-30998005d015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf23e3c25634ef3ac4eb3d7b2cbe76e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:34.068440 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860e381-33dc-498f-9f97-30998005d015 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:34.172948 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c860e381-33dc-498f-9f97-30998005d015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf23e3c25634ef3ac4eb3d7b2cbe76e', 'request_id': 'req-c860e381-33dc-498f-9f97-30998005d015'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:34.190827 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c860e381-33dc-498f-9f97-30998005d015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf23e3c25634ef3ac4eb3d7b2cbe76e', 'request_id': 'req-c860e381-33dc-498f-9f97-30998005d015'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:34.205155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c860e381-33dc-498f-9f97-30998005d015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf23e3c25634ef3ac4eb3d7b2cbe76e', 'request_id': 'req-c860e381-33dc-498f-9f97-30998005d015'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:34.239781 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c860e381-33dc-498f-9f97-30998005d015 admin admin] The token cache is being invalidate because project 3bf23e3c25634ef3ac4eb3d7b2cbe76e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:28:34.240184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c860e381-33dc-498f-9f97-30998005d015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:34.240900 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c860e381-33dc-498f-9f97-30998005d015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:34.242498 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 845/1714] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:28:33 2022] DELETE /identity/v3/projects/3bf23e3c25634ef3ac4eb3d7b2cbe76e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:34.246554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3376e4-b24d-4807-88bf-fe31d75e9f65 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:34.248939 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6b3376e4-b24d-4807-88bf-fe31d75e9f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:34.278054 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3376e4-b24d-4807-88bf-fe31d75e9f65 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:34.395479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b132ac-a01b-4e6e-ab4a-aa7bc54bc2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:34.396770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b132ac-a01b-4e6e-ab4a-aa7bc54bc2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:34.397358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b132ac-a01b-4e6e-ab4a-aa7bc54bc2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:34.397842 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b132ac-a01b-4e6e-ab4a-aa7bc54bc2e0 admin admin] PATH_INFO: `/v3/users/3cf2b98d95a246d2ab0bb4e84e59516a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:34.399758 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b132ac-a01b-4e6e-ab4a-aa7bc54bc2e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf2b98d95a246d2ab0bb4e84e59516a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:34.402605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b132ac-a01b-4e6e-ab4a-aa7bc54bc2e0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:34.492396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-05b132ac-a01b-4e6e-ab4a-aa7bc54bc2e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf2b98d95a246d2ab0bb4e84e59516a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:34.506200 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-05b132ac-a01b-4e6e-ab4a-aa7bc54bc2e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf2b98d95a246d2ab0bb4e84e59516a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:34.517863 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-05b132ac-a01b-4e6e-ab4a-aa7bc54bc2e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf2b98d95a246d2ab0bb4e84e59516a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:34.518834 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-05b132ac-a01b-4e6e-ab4a-aa7bc54bc2e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf2b98d95a246d2ab0bb4e84e59516a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:34.537242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-05b132ac-a01b-4e6e-ab4a-aa7bc54bc2e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf2b98d95a246d2ab0bb4e84e59516a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:34.560633 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 870/1715] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:28:34 2022] DELETE /identity/v3/users/3cf2b98d95a246d2ab0bb4e84e59516a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:34.637858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860e381-33dc-498f-9f97-30998005d015 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:34.642093 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c860e381-33dc-498f-9f97-30998005d015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:34.891189 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860e381-33dc-498f-9f97-30998005d015 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:35.141310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400148b-f47a-4a93-853d-3fab6ef3edfd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '361ad35021eb43cca46d9b66e6f24ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:35.142039 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400148b-f47a-4a93-853d-3fab6ef3edfd service placement] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:35.144651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400148b-f47a-4a93-853d-3fab6ef3edfd service placement] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:35.145117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400148b-f47a-4a93-853d-3fab6ef3edfd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:35.164710 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a400148b-f47a-4a93-853d-3fab6ef3edfd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:35.223593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400148b-f47a-4a93-853d-3fab6ef3edfd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:35.224054 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b132ac-a01b-4e6e-ab4a-aa7bc54bc2e0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:35.225916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-05b132ac-a01b-4e6e-ab4a-aa7bc54bc2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:35.226456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400148b-f47a-4a93-853d-3fab6ef3edfd service placement] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:35.269841 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 846/1716] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:35.409118 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b132ac-a01b-4e6e-ab4a-aa7bc54bc2e0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:35.425451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2664f-aae6-47c8-a8bc-50b038b1a0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:35.426566 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2664f-aae6-47c8-a8bc-50b038b1a0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:35.427949 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2664f-aae6-47c8-a8bc-50b038b1a0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:35.428375 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2664f-aae6-47c8-a8bc-50b038b1a0b0 admin admin] PATH_INFO: `/v3/projects/67ee8181156d4ea1977bcc0df1788769` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:35.434285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2664f-aae6-47c8-a8bc-50b038b1a0b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ee8181156d4ea1977bcc0df1788769)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:35.438853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2664f-aae6-47c8-a8bc-50b038b1a0b0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:35.480751 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:35.605418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2af2664f-aae6-47c8-a8bc-50b038b1a0b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ee8181156d4ea1977bcc0df1788769', 'request_id': 'req-2af2664f-aae6-47c8-a8bc-50b038b1a0b0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:35.632731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2af2664f-aae6-47c8-a8bc-50b038b1a0b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ee8181156d4ea1977bcc0df1788769', 'request_id': 'req-2af2664f-aae6-47c8-a8bc-50b038b1a0b0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:35.647499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2af2664f-aae6-47c8-a8bc-50b038b1a0b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ee8181156d4ea1977bcc0df1788769', 'request_id': 'req-2af2664f-aae6-47c8-a8bc-50b038b1a0b0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:35.726499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2af2664f-aae6-47c8-a8bc-50b038b1a0b0 admin admin] The token cache is being invalidate because project 67ee8181156d4ea1977bcc0df1788769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:28:35.730714 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2af2664f-aae6-47c8-a8bc-50b038b1a0b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:35.734588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2af2664f-aae6-47c8-a8bc-50b038b1a0b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:35.738798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 871/1717] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:28:35 2022] DELETE /identity/v3/projects/67ee8181156d4ea1977bcc0df1788769 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:35.744054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fb9c4-8b3c-4235-be04-e9c2c21c2ce7 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:35.744946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fb9c4-8b3c-4235-be04-e9c2c21c2ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:35.745050 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fb9c4-8b3c-4235-be04-e9c2c21c2ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:35.755124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:35.802509 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e11fb9c4-8b3c-4235-be04-e9c2c21c2ce7 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:35.808195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e11fb9c4-8b3c-4235-be04-e9c2c21c2ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:35.963921 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 847/1718] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:35.972374 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c5cf7-e084-4614-a6ae-5c0e705433c4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:35.972912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c5cf7-e084-4614-a6ae-5c0e705433c4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:35.973079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c5cf7-e084-4614-a6ae-5c0e705433c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:36.014133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113827f-6623-4b5c-ae80-bb7b646d7697 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:36.014420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113827f-6623-4b5c-ae80-bb7b646d7697 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:36.014875 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113827f-6623-4b5c-ae80-bb7b646d7697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:36.062026 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c43c5cf7-e084-4614-a6ae-5c0e705433c4 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:36.070505 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c43c5cf7-e084-4614-a6ae-5c0e705433c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:36.129987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 872/1719] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:36.134704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c5cf7-e084-4614-a6ae-5c0e705433c4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:36.152990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-b113827f-6623-4b5c-ae80-bb7b646d7697 None None] MFA Rules not processed for user `6e67edcef8454b3fa4565fea949f1781`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:36.154246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b113827f-6623-4b5c-ae80-bb7b646d7697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:36.191026 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c5cf7-e084-4614-a6ae-5c0e705433c4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:36.215314 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1ed5b-2148-40cf-850a-4de4821c1552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:36.220702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1ed5b-2148-40cf-850a-4de4821c1552 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:36.221843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1ed5b-2148-40cf-850a-4de4821c1552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:36.223484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1ed5b-2148-40cf-850a-4de4821c1552 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:36.228856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1ed5b-2148-40cf-850a-4de4821c1552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:28:36.229166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1ed5b-2148-40cf-850a-4de4821c1552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:36.230861 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1ed5b-2148-40cf-850a-4de4821c1552 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:36.307816 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 873/1720] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:28:36.314259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1ed5b-2148-40cf-850a-4de4821c1552 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:36.365406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1ed5b-2148-40cf-850a-4de4821c1552 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:36.390340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f75d6-9394-4c98-ad69-659c9827f5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:36.391304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f75d6-9394-4c98-ad69-659c9827f5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:36.393904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f75d6-9394-4c98-ad69-659c9827f5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:36.394278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f75d6-9394-4c98-ad69-659c9827f5f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:36.399123 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f75d6-9394-4c98-ad69-659c9827f5f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:36.413580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f75d6-9394-4c98-ad69-659c9827f5f0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:36.502117 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 874/1721] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:36 2022] POST /identity/v3/projects => generated 367 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:36.504008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 848/1722] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:36.517680 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f75d6-9394-4c98-ad69-659c9827f5f0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:36.518351 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceafeae-b14c-45be-bfb9-a325b06ceaea None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:36.518789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceafeae-b14c-45be-bfb9-a325b06ceaea None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:36.519128 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceafeae-b14c-45be-bfb9-a325b06ceaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:36.557202 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-bceafeae-b14c-45be-bfb9-a325b06ceaea None None] MFA Rules not processed for user `6e67edcef8454b3fa4565fea949f1781`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:36.558465 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bceafeae-b14c-45be-bfb9-a325b06ceaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:36.704040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f75d6-9394-4c98-ad69-659c9827f5f0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:36.723737 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b01bd-f45f-482d-9c77-da2677fcfe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:36.724577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b01bd-f45f-482d-9c77-da2677fcfe52 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:36.724733 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b01bd-f45f-482d-9c77-da2677fcfe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:36.725001 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b01bd-f45f-482d-9c77-da2677fcfe52 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:36.725703 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b01bd-f45f-482d-9c77-da2677fcfe52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:36.731950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b01bd-f45f-482d-9c77-da2677fcfe52 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:36.806806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 875/1723] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:36 2022] POST /identity/v3/users => generated 284 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:36.814499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b01bd-f45f-482d-9c77-da2677fcfe52 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:36.825689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 849/1724] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:36.842513 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceafeae-b14c-45be-bfb9-a325b06ceaea None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:36.844011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bceafeae-b14c-45be-bfb9-a325b06ceaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:36.854671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b01bd-f45f-482d-9c77-da2677fcfe52 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:36.874042 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4575da8-b5c8-499c-ba4a-caa01a812af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:36.875731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575da8-b5c8-499c-ba4a-caa01a812af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:36.879153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575da8-b5c8-499c-ba4a-caa01a812af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:36.879849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575da8-b5c8-499c-ba4a-caa01a812af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:36.880641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4575da8-b5c8-499c-ba4a-caa01a812af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:36.885929 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4575da8-b5c8-499c-ba4a-caa01a812af6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:36.924575 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 876/1725] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:36.929154 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4575da8-b5c8-499c-ba4a-caa01a812af6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:36.961952 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4575da8-b5c8-499c-ba4a-caa01a812af6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:36.982554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b52c9-61f3-446f-811a-0f44a023af75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:36.983769 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b52c9-61f3-446f-811a-0f44a023af75 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:36.984200 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b52c9-61f3-446f-811a-0f44a023af75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:36.984662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b52c9-61f3-446f-811a-0f44a023af75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:36.985561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b52c9-61f3-446f-811a-0f44a023af75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:36.991296 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b52c9-61f3-446f-811a-0f44a023af75 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:37.025454 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:37.043283 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 877/1726] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:37.048431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b52c9-61f3-446f-811a-0f44a023af75 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:37.108494 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b52c9-61f3-446f-811a-0f44a023af75 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:37.128302 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd5066-d881-4201-8852-4f43e64c5641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:37.130910 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd5066-d881-4201-8852-4f43e64c5641 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:37.132277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd5066-d881-4201-8852-4f43e64c5641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:37.133241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd5066-d881-4201-8852-4f43e64c5641 admin admin] PATH_INFO: `/v3/projects/8627fadcd4bb4d1ba25c8e4dd5f2bc02/users/9ebd0c795dfd46308a3d67b24d6eff4f/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:37.155230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceafeae-b14c-45be-bfb9-a325b06ceaea None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:37.171528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a0e54-2817-4039-9399-273d07bf6b90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:37.172683 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a0e54-2817-4039-9399-273d07bf6b90 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:37.173916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a0e54-2817-4039-9399-273d07bf6b90 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:37.175035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a0e54-2817-4039-9399-273d07bf6b90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:37.196323 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd5066-d881-4201-8852-4f43e64c5641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8627fadcd4bb4d1ba25c8e4dd5f2bc02, user_id=9ebd0c795dfd46308a3d67b24d6eff4f, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:37.199924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd5066-d881-4201-8852-4f43e64c5641 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:37.209469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a0e54-2817-4039-9399-273d07bf6b90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:37.211506 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a0e54-2817-4039-9399-273d07bf6b90 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:37.215792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:37.226357 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 850/1727] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:37.227042 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 878/1728] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:37 2022] PUT /identity/v3/projects/8627fadcd4bb4d1ba25c8e4dd5f2bc02/users/9ebd0c795dfd46308a3d67b24d6eff4f/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:37.242710 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062515db-4562-416b-a0c7-768f2d102184 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:37.258331 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062515db-4562-416b-a0c7-768f2d102184 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:37.259024 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062515db-4562-416b-a0c7-768f2d102184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:37.307728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-062515db-4562-416b-a0c7-768f2d102184 None None] MFA Rules not processed for user `9ebd0c795dfd46308a3d67b24d6eff4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:37.319732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-062515db-4562-416b-a0c7-768f2d102184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:37.592077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 851/1729] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:37.596770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd5066-d881-4201-8852-4f43e64c5641 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:37.756123 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd5066-d881-4201-8852-4f43e64c5641 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:37.771709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da245518-fbae-40c8-8465-578b6f57a0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:37.772409 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da245518-fbae-40c8-8465-578b6f57a0ac admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:37.772714 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da245518-fbae-40c8-8465-578b6f57a0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:37.772989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da245518-fbae-40c8-8465-578b6f57a0ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:37.773846 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da245518-fbae-40c8-8465-578b6f57a0ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:37.775794 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da245518-fbae-40c8-8465-578b6f57a0ac admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:37.844697 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 879/1730] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:37 2022] POST /identity/v3/projects => generated 365 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:37.851604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062515db-4562-416b-a0c7-768f2d102184 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:37.868909 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062515db-4562-416b-a0c7-768f2d102184 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:38.048938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c7012-17ad-4054-80e4-7918fb62c213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:38.049640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c7012-17ad-4054-80e4-7918fb62c213 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:38.049932 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c7012-17ad-4054-80e4-7918fb62c213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:38.050192 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c7012-17ad-4054-80e4-7918fb62c213 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:38.052725 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c7012-17ad-4054-80e4-7918fb62c213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:38.057524 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c7012-17ad-4054-80e4-7918fb62c213 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:38.093028 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da245518-fbae-40c8-8465-578b6f57a0ac admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:38.093815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 852/1731] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:37 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:38.109802 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed15c0-4f9d-4012-988b-ed8fb35658fb None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:38.122698 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed15c0-4f9d-4012-988b-ed8fb35658fb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:38.123563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da245518-fbae-40c8-8465-578b6f57a0ac admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:38.124143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed15c0-4f9d-4012-988b-ed8fb35658fb None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:38.127600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 853/1732] 10.222.0.26 () {54 vars in 912 bytes} [Tue Jul 12 03:28:38 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:28:38.131217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da78ca-d3e2-41f7-a930-e429181d9224 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:38.132064 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da78ca-d3e2-41f7-a930-e429181d9224 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:38.132428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da78ca-d3e2-41f7-a930-e429181d9224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:38.136069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250d386-e1a2-447c-bd0a-0da75ad560cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:38.137130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250d386-e1a2-447c-bd0a-0da75ad560cc admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:38.138387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250d386-e1a2-447c-bd0a-0da75ad560cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:38.139386 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250d386-e1a2-447c-bd0a-0da75ad560cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:38.140633 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250d386-e1a2-447c-bd0a-0da75ad560cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:38.144383 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250d386-e1a2-447c-bd0a-0da75ad560cc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:38.173258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 880/1733] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:38.175179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc02e8e-b101-429e-866a-9b8160ed8c9f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:38.177491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc02e8e-b101-429e-866a-9b8160ed8c9f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:38.178219 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc02e8e-b101-429e-866a-9b8160ed8c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:38.201675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-38da78ca-d3e2-41f7-a930-e429181d9224 None None] MFA Rules not processed for user `dbfe7a2a6c144b598057e446e426688e`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:38.206342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-38da78ca-d3e2-41f7-a930-e429181d9224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:38.278259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-dcc02e8e-b101-429e-866a-9b8160ed8c9f None None] MFA Rules not processed for user `c2908efc19944583810abceb4c5d8d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:38.286237 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dcc02e8e-b101-429e-866a-9b8160ed8c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:38.298426 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:38.366745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 854/1734] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:38.367648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da78ca-d3e2-41f7-a930-e429181d9224 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:38.387552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da78ca-d3e2-41f7-a930-e429181d9224 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:38.400233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c81b6-e752-4c64-bc88-007d44b43607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:38.401174 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c81b6-e752-4c64-bc88-007d44b43607 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:38.401543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c81b6-e752-4c64-bc88-007d44b43607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:38.401821 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c81b6-e752-4c64-bc88-007d44b43607 admin admin] PATH_INFO: `/v3/projects/5b1fa6356a45431591673956f37b4d6e/users/5e640db13822462db5735f78993192c8/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:38.438668 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c81b6-e752-4c64-bc88-007d44b43607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1fa6356a45431591673956f37b4d6e, user_id=5e640db13822462db5735f78993192c8, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:38.441565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c81b6-e752-4c64-bc88-007d44b43607 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:38.490265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 855/1735] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:38 2022] PUT /identity/v3/projects/5b1fa6356a45431591673956f37b4d6e/users/5e640db13822462db5735f78993192c8/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:38.491428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c81b6-e752-4c64-bc88-007d44b43607 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:38.493534 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 881/1736] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 03:28:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:38.496050 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc02e8e-b101-429e-866a-9b8160ed8c9f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:38.506340 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9f3c81b6-e752-4c64-bc88-007d44b43607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:38.523560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc02e8e-b101-429e-866a-9b8160ed8c9f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:38.754678 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c81b6-e752-4c64-bc88-007d44b43607 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:38.762629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341985e-676d-469e-8dbe-ea67f6a876b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:38.763319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341985e-676d-469e-8dbe-ea67f6a876b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:38.763514 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341985e-676d-469e-8dbe-ea67f6a876b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:38.763790 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341985e-676d-469e-8dbe-ea67f6a876b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:38.764555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341985e-676d-469e-8dbe-ea67f6a876b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:38.766184 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341985e-676d-469e-8dbe-ea67f6a876b7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:38.770413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71cd38-1320-4c45-ae7f-92bf8202f00a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:38.772015 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71cd38-1320-4c45-ae7f-92bf8202f00a service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:38.772015 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71cd38-1320-4c45-ae7f-92bf8202f00a service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:38.772015 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71cd38-1320-4c45-ae7f-92bf8202f00a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:38.805695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 882/1737] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:38.806642 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341985e-676d-469e-8dbe-ea67f6a876b7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:38.808852 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a341985e-676d-469e-8dbe-ea67f6a876b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:38.857404 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:38.914756 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71cd38-1320-4c45-ae7f-92bf8202f00a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:38.919724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71cd38-1320-4c45-ae7f-92bf8202f00a service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:38.923480 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341985e-676d-469e-8dbe-ea67f6a876b7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:38.936207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740170d3-6065-4c12-9700-ecfce96dfe17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:38.936985 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740170d3-6065-4c12-9700-ecfce96dfe17 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:38.937331 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740170d3-6065-4c12-9700-ecfce96dfe17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:38.937691 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740170d3-6065-4c12-9700-ecfce96dfe17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:38.949941 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 856/1738] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:38.950888 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740170d3-6065-4c12-9700-ecfce96dfe17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:38.952396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740170d3-6065-4c12-9700-ecfce96dfe17 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:38.952943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71cd38-1320-4c45-ae7f-92bf8202f00a service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:38.972182 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 883/1739] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:39.009073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71cd38-1320-4c45-ae7f-92bf8202f00a service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:39.025108 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9536d3-bb53-4ace-a4a8-12c807cbd7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:39.029020 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9536d3-bb53-4ace-a4a8-12c807cbd7e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:39.030248 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9536d3-bb53-4ace-a4a8-12c807cbd7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:39.032188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9536d3-bb53-4ace-a4a8-12c807cbd7e1 admin admin] PATH_INFO: `/v3/projects/5b1fa6356a45431591673956f37b4d6e/users/5e640db13822462db5735f78993192c8/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:39.039137 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9536d3-bb53-4ace-a4a8-12c807cbd7e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1fa6356a45431591673956f37b4d6e, user_id=5e640db13822462db5735f78993192c8, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:39.085531 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9536d3-bb53-4ace-a4a8-12c807cbd7e1 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:39.163415 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 857/1740] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:38 2022] PUT /identity/v3/projects/5b1fa6356a45431591673956f37b4d6e/users/5e640db13822462db5735f78993192c8/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:39.174474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe014b4-777e-45f4-887d-933d33a744ca None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:39.174764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe014b4-777e-45f4-887d-933d33a744ca None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:39.175039 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe014b4-777e-45f4-887d-933d33a744ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:39.178355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b417d1-589b-4c5f-a895-a4d682b1de0e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:39.178639 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b417d1-589b-4c5f-a895-a4d682b1de0e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:39.178929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b417d1-589b-4c5f-a895-a4d682b1de0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:39.307670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-26b417d1-589b-4c5f-a895-a4d682b1de0e None None] MFA Rules not processed for user `5e640db13822462db5735f78993192c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:39.318228 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-26b417d1-589b-4c5f-a895-a4d682b1de0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:39.365138 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-afe014b4-777e-45f4-887d-933d33a744ca None None] MFA Rules not processed for user `e23aea853cce44698b19d6bc087093c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:39.377658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-afe014b4-777e-45f4-887d-933d33a744ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:39.389341 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:39.524249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 858/1741] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:39.525531 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b417d1-589b-4c5f-a895-a4d682b1de0e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:39.535947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-26b417d1-589b-4c5f-a895-a4d682b1de0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:39.561010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 884/1742] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 03:28:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:39.698240 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b417d1-589b-4c5f-a895-a4d682b1de0e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:39.706342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a08f0e-d016-4137-a61f-0266f357648e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:39.707300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a08f0e-d016-4137-a61f-0266f357648e service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:39.707802 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a08f0e-d016-4137-a61f-0266f357648e service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:39.708281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a08f0e-d016-4137-a61f-0266f357648e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:39.733074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a08f0e-d016-4137-a61f-0266f357648e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:39.734632 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a08f0e-d016-4137-a61f-0266f357648e service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:39.774631 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 859/1743] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:39.774879 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe014b4-777e-45f4-887d-933d33a744ca None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:39.777579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-afe014b4-777e-45f4-887d-933d33a744ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:39.900538 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe560eb0-03f2-48cf-8b51-54b8916bed82 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:39.900862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe560eb0-03f2-48cf-8b51-54b8916bed82 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:39.901152 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe560eb0-03f2-48cf-8b51-54b8916bed82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:39.983866 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-fe560eb0-03f2-48cf-8b51-54b8916bed82 None None] MFA Rules not processed for user `d8e90b4b09dd453f9685fb034227a136`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:39.985141 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fe560eb0-03f2-48cf-8b51-54b8916bed82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:40.029827 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe014b4-777e-45f4-887d-933d33a744ca None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:40.049624 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b986a2-320c-4bdc-bdae-59a4a3e44a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:40.050465 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b986a2-320c-4bdc-bdae-59a4a3e44a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:40.050812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b986a2-320c-4bdc-bdae-59a4a3e44a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:40.051141 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b986a2-320c-4bdc-bdae-59a4a3e44a02 admin admin] PATH_INFO: `/v3/users/cfbb961c9d6d494a84477ce08d43b6f5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:40.053464 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b986a2-320c-4bdc-bdae-59a4a3e44a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfbb961c9d6d494a84477ce08d43b6f5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:40.055770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b986a2-320c-4bdc-bdae-59a4a3e44a02 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:40.181876 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 860/1744] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:28:40.183248 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe560eb0-03f2-48cf-8b51-54b8916bed82 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:40.203857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fe560eb0-03f2-48cf-8b51-54b8916bed82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:40.218974 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:40.249665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-94b986a2-320c-4bdc-bdae-59a4a3e44a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfbb961c9d6d494a84477ce08d43b6f5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:40.275430 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-94b986a2-320c-4bdc-bdae-59a4a3e44a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfbb961c9d6d494a84477ce08d43b6f5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:40.293527 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-94b986a2-320c-4bdc-bdae-59a4a3e44a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfbb961c9d6d494a84477ce08d43b6f5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:40.295582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-94b986a2-320c-4bdc-bdae-59a4a3e44a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfbb961c9d6d494a84477ce08d43b6f5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:40.339120 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-94b986a2-320c-4bdc-bdae-59a4a3e44a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfbb961c9d6d494a84477ce08d43b6f5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:40.353810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 885/1745] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:28:39 2022] DELETE /identity/v3/users/cfbb961c9d6d494a84477ce08d43b6f5 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:28:40.354900 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b986a2-320c-4bdc-bdae-59a4a3e44a02 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:40.357648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-94b986a2-320c-4bdc-bdae-59a4a3e44a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:40.383914 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:40.485422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b986a2-320c-4bdc-bdae-59a4a3e44a02 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:40.495996 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e680e0-683c-4391-a03c-cf74a02cf64e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:40.496953 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e680e0-683c-4391-a03c-cf74a02cf64e service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:40.497211 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e680e0-683c-4391-a03c-cf74a02cf64e service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:40.497490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e680e0-683c-4391-a03c-cf74a02cf64e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:40.499559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-13e680e0-683c-4391-a03c-cf74a02cf64e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:40.545579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe560eb0-03f2-48cf-8b51-54b8916bed82 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:40.588554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e680e0-683c-4391-a03c-cf74a02cf64e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:40.590735 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e680e0-683c-4391-a03c-cf74a02cf64e service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:40.605625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 886/1746] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:40.607357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087b7f6-a7ed-47ad-8be0-0279ed176a74 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:40.608451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087b7f6-a7ed-47ad-8be0-0279ed176a74 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:40.608808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087b7f6-a7ed-47ad-8be0-0279ed176a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:40.634788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9087b7f6-a7ed-47ad-8be0-0279ed176a74 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:40.636080 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9087b7f6-a7ed-47ad-8be0-0279ed176a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:40.711186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:40.767953 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 887/1747] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:40.770791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087b7f6-a7ed-47ad-8be0-0279ed176a74 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:40.773732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9087b7f6-a7ed-47ad-8be0-0279ed176a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:40.810886 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb6ff8-3cb3-45dc-84bc-7828bd2f7389 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc4cbd87dd249868cfb704535774126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:40.811586 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb6ff8-3cb3-45dc-84bc-7828bd2f7389 service swift] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:40.811866 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb6ff8-3cb3-45dc-84bc-7828bd2f7389 service swift] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:40.812135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb6ff8-3cb3-45dc-84bc-7828bd2f7389 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:40.820910 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-94fb6ff8-3cb3-45dc-84bc-7828bd2f7389 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:41.031004 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb6ff8-3cb3-45dc-84bc-7828bd2f7389 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:41.034877 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb6ff8-3cb3-45dc-84bc-7828bd2f7389 service swift] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:41.061557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 861/1748] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 03:28:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 879 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 03:28:41.104037 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087b7f6-a7ed-47ad-8be0-0279ed176a74 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:41.121998 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a19cd7-29b9-484a-9011-f3ec31e747cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:41.124469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a19cd7-29b9-484a-9011-f3ec31e747cf service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:41.124799 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a19cd7-29b9-484a-9011-f3ec31e747cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:41.125075 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a19cd7-29b9-484a-9011-f3ec31e747cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:41.156123 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a19cd7-29b9-484a-9011-f3ec31e747cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:41.157720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a19cd7-29b9-484a-9011-f3ec31e747cf service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:41.241253 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 888/1749] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:41.849363 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb6ff8-3cb3-45dc-84bc-7828bd2f7389 service swift] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:41.851069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-94fb6ff8-3cb3-45dc-84bc-7828bd2f7389 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:41.906820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb6ff8-3cb3-45dc-84bc-7828bd2f7389 service swift] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:41.925359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6275e67-88c4-4e42-b905-5da90af84c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:41.926329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6275e67-88c4-4e42-b905-5da90af84c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:41.926618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6275e67-88c4-4e42-b905-5da90af84c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:41.926897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6275e67-88c4-4e42-b905-5da90af84c24 admin admin] PATH_INFO: `/v3/users/8dadeae8e29240cda515f3d1257df0bf` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:41.935878 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6275e67-88c4-4e42-b905-5da90af84c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dadeae8e29240cda515f3d1257df0bf)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:41.937616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6275e67-88c4-4e42-b905-5da90af84c24 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:42.090723 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c6275e67-88c4-4e42-b905-5da90af84c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dadeae8e29240cda515f3d1257df0bf'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:42.124800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c6275e67-88c4-4e42-b905-5da90af84c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dadeae8e29240cda515f3d1257df0bf'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:42.151106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:42.156734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c6275e67-88c4-4e42-b905-5da90af84c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dadeae8e29240cda515f3d1257df0bf'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:42.156734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c6275e67-88c4-4e42-b905-5da90af84c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dadeae8e29240cda515f3d1257df0bf'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:42.174498 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c6275e67-88c4-4e42-b905-5da90af84c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dadeae8e29240cda515f3d1257df0bf'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:42.232648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 862/1750] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:28:41 2022] DELETE /identity/v3/users/8dadeae8e29240cda515f3d1257df0bf => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:42.235390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f4edc-9aae-43fd-8267-dc1272b72a4d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:42.235390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f4edc-9aae-43fd-8267-dc1272b72a4d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:42.235912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f4edc-9aae-43fd-8267-dc1272b72a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:42.259524 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c46fc1-a5c2-4fa5-86cf-6cc5acba1e2c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:42.266550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c46fc1-a5c2-4fa5-86cf-6cc5acba1e2c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:42.273135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c46fc1-a5c2-4fa5-86cf-6cc5acba1e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:42.365903 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-457f4edc-9aae-43fd-8267-dc1272b72a4d None None] MFA Rules not processed for user `6e67edcef8454b3fa4565fea949f1781`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:42.367142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-457f4edc-9aae-43fd-8267-dc1272b72a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:42.408996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-55c46fc1-a5c2-4fa5-86cf-6cc5acba1e2c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:42.416487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-55c46fc1-a5c2-4fa5-86cf-6cc5acba1e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:42.689965 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 889/1751] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:42.866621 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 863/1752] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 623 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:42.945761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f4edc-9aae-43fd-8267-dc1272b72a4d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:42.948807 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-457f4edc-9aae-43fd-8267-dc1272b72a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:43.136689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f4edc-9aae-43fd-8267-dc1272b72a4d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:43.149286 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec468da-970d-490b-8d78-186343932d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:43.151333 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec468da-970d-490b-8d78-186343932d2e service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:43.153567 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec468da-970d-490b-8d78-186343932d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:43.154771 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec468da-970d-490b-8d78-186343932d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:43.190829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec468da-970d-490b-8d78-186343932d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:43.199699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec468da-970d-490b-8d78-186343932d2e service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:43.251398 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 890/1753] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:43.982169 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0712f6f-06ea-4af3-b2ed-e9a2d173138c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:43.983427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0712f6f-06ea-4af3-b2ed-e9a2d173138c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:43.983891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0712f6f-06ea-4af3-b2ed-e9a2d173138c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:44.039200 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-d0712f6f-06ea-4af3-b2ed-e9a2d173138c None None] MFA Rules not processed for user `c2908efc19944583810abceb4c5d8d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:44.040575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d0712f6f-06ea-4af3-b2ed-e9a2d173138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:44.074936 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 864/1754] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Jul 12 03:28:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:44.173314 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec468da-970d-490b-8d78-186343932d2e service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:44.177883 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7ec468da-970d-490b-8d78-186343932d2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:44.204612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec468da-970d-490b-8d78-186343932d2e service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:44.218265 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1ff12-96fe-4fbf-b9b6-72cbc4878d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:44.219381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1ff12-96fe-4fbf-b9b6-72cbc4878d48 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:44.220011 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1ff12-96fe-4fbf-b9b6-72cbc4878d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:44.220724 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1ff12-96fe-4fbf-b9b6-72cbc4878d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:44.222170 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0712f6f-06ea-4af3-b2ed-e9a2d173138c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:44.224391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d0712f6f-06ea-4af3-b2ed-e9a2d173138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:44.269536 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1ff12-96fe-4fbf-b9b6-72cbc4878d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:44.276999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0712f6f-06ea-4af3-b2ed-e9a2d173138c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:44.277861 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1ff12-96fe-4fbf-b9b6-72cbc4878d48 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:44.303600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:44.308677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:44.311001 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:44.312900 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f admin admin] PATH_INFO: `/v3/projects/9b100d47b8b2484abbe9f1090e157c4f` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:44.319014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b100d47b8b2484abbe9f1090e157c4f)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:44.330139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 891/1755] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:44.337884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:44.343885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1ff12-96fe-4fbf-b9b6-72cbc4878d48 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:44.357140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-64f1ff12-96fe-4fbf-b9b6-72cbc4878d48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:44.424263 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1ff12-96fe-4fbf-b9b6-72cbc4878d48 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:44.434912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228fa51-044c-46dd-9b68-bcc17bfee026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:44.436300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228fa51-044c-46dd-9b68-bcc17bfee026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:44.436750 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228fa51-044c-46dd-9b68-bcc17bfee026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:44.437314 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228fa51-044c-46dd-9b68-bcc17bfee026 admin admin] PATH_INFO: `/v3/users/9ebd0c795dfd46308a3d67b24d6eff4f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:44.439417 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228fa51-044c-46dd-9b68-bcc17bfee026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ebd0c795dfd46308a3d67b24d6eff4f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:44.443303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228fa51-044c-46dd-9b68-bcc17bfee026 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:44.490471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:44.547976 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b100d47b8b2484abbe9f1090e157c4f', 'request_id': 'req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:44.549229 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a228fa51-044c-46dd-9b68-bcc17bfee026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ebd0c795dfd46308a3d67b24d6eff4f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:44.567878 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b100d47b8b2484abbe9f1090e157c4f', 'request_id': 'req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:44.579699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a228fa51-044c-46dd-9b68-bcc17bfee026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ebd0c795dfd46308a3d67b24d6eff4f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:44.592840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b100d47b8b2484abbe9f1090e157c4f', 'request_id': 'req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:44.594427 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a228fa51-044c-46dd-9b68-bcc17bfee026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ebd0c795dfd46308a3d67b24d6eff4f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:44.598457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a228fa51-044c-46dd-9b68-bcc17bfee026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ebd0c795dfd46308a3d67b24d6eff4f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:44.616937 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f admin admin] The token cache is being invalidate because project 9b100d47b8b2484abbe9f1090e157c4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:28:44.617505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:44.622161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:44.628615 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 865/1756] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:28:44 2022] DELETE /identity/v3/projects/9b100d47b8b2484abbe9f1090e157c4f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:44.629983 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:44.631781 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:44.643491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a228fa51-044c-46dd-9b68-bcc17bfee026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ebd0c795dfd46308a3d67b24d6eff4f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:44.669762 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 892/1757] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:28:44 2022] DELETE /identity/v3/users/9ebd0c795dfd46308a3d67b24d6eff4f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:44.677297 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc33d7-608c-476a-8494-099b370481bd None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:44.677831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc33d7-608c-476a-8494-099b370481bd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:44.678249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc33d7-608c-476a-8494-099b370481bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:44.739085 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-13dc33d7-608c-476a-8494-099b370481bd None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:44.741840 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-13dc33d7-608c-476a-8494-099b370481bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:44.923102 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f758c1e-0ad0-460c-89d4-dbbdb8259f1f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:44.934439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 893/1758] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:44.939619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b998daf-2e11-4213-9e81-e22959d7383e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:44.940559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b998daf-2e11-4213-9e81-e22959d7383e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:44.940978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b998daf-2e11-4213-9e81-e22959d7383e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:44.943932 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b998daf-2e11-4213-9e81-e22959d7383e admin admin] PATH_INFO: `/v3/users/4cbfeb9dd22c4f0699d55742cd365677` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:44.945447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b998daf-2e11-4213-9e81-e22959d7383e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cbfeb9dd22c4f0699d55742cd365677)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:44.947665 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b998daf-2e11-4213-9e81-e22959d7383e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:44.954842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:45.012432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc33d7-608c-476a-8494-099b370481bd None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:45.014250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-13dc33d7-608c-476a-8494-099b370481bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:45.118559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6b998daf-2e11-4213-9e81-e22959d7383e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cbfeb9dd22c4f0699d55742cd365677'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:45.166497 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6b998daf-2e11-4213-9e81-e22959d7383e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cbfeb9dd22c4f0699d55742cd365677'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:45.204895 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6b998daf-2e11-4213-9e81-e22959d7383e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cbfeb9dd22c4f0699d55742cd365677'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:45.207973 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6b998daf-2e11-4213-9e81-e22959d7383e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cbfeb9dd22c4f0699d55742cd365677'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:45.251745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6b998daf-2e11-4213-9e81-e22959d7383e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cbfeb9dd22c4f0699d55742cd365677'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:45.288672 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 866/1759] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:28:44 2022] DELETE /identity/v3/users/4cbfeb9dd22c4f0699d55742cd365677 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:45.296133 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc33d7-608c-476a-8494-099b370481bd None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:45.476963 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288e56e-8cf5-47ab-94e2-95fb09779c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:45.478006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288e56e-8cf5-47ab-94e2-95fb09779c48 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:45.478700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288e56e-8cf5-47ab-94e2-95fb09779c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:45.479133 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288e56e-8cf5-47ab-94e2-95fb09779c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:45.481438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2288e56e-8cf5-47ab-94e2-95fb09779c48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:45.495862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:45.714411 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288e56e-8cf5-47ab-94e2-95fb09779c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:45.717128 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288e56e-8cf5-47ab-94e2-95fb09779c48 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:45.763818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 894/1760] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:46.752590 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b998daf-2e11-4213-9e81-e22959d7383e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:46.755429 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6b998daf-2e11-4213-9e81-e22959d7383e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:46.829195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b998daf-2e11-4213-9e81-e22959d7383e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:46.848470 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc5d01-cb33-4455-9bef-622bc59b33d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:46.849331 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc5d01-cb33-4455-9bef-622bc59b33d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:46.849615 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc5d01-cb33-4455-9bef-622bc59b33d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:46.861070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc5d01-cb33-4455-9bef-622bc59b33d6 admin admin] PATH_INFO: `/v3/projects/c83c2d3b7b45407fbf5a261d0a664aff` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:46.868984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc5d01-cb33-4455-9bef-622bc59b33d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c83c2d3b7b45407fbf5a261d0a664aff)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:46.870972 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc5d01-cb33-4455-9bef-622bc59b33d6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:47.043007 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d8cc5d01-cb33-4455-9bef-622bc59b33d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c83c2d3b7b45407fbf5a261d0a664aff', 'request_id': 'req-d8cc5d01-cb33-4455-9bef-622bc59b33d6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:47.082488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d8cc5d01-cb33-4455-9bef-622bc59b33d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c83c2d3b7b45407fbf5a261d0a664aff', 'request_id': 'req-d8cc5d01-cb33-4455-9bef-622bc59b33d6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:47.113386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d8cc5d01-cb33-4455-9bef-622bc59b33d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c83c2d3b7b45407fbf5a261d0a664aff', 'request_id': 'req-d8cc5d01-cb33-4455-9bef-622bc59b33d6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:47.159380 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d8cc5d01-cb33-4455-9bef-622bc59b33d6 admin admin] The token cache is being invalidate because project c83c2d3b7b45407fbf5a261d0a664aff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:28:47.162190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d8cc5d01-cb33-4455-9bef-622bc59b33d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:47.172716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d8cc5d01-cb33-4455-9bef-622bc59b33d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:47.174889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 867/1761] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:28:46 2022] DELETE /identity/v3/projects/c83c2d3b7b45407fbf5a261d0a664aff => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:47.179078 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288e56e-8cf5-47ab-94e2-95fb09779c48 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:47.192982 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288e56e-8cf5-47ab-94e2-95fb09779c48 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:47.348438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457b6ba-2e83-422a-8e79-eae128649980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:47.349347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457b6ba-2e83-422a-8e79-eae128649980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:47.349628 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457b6ba-2e83-422a-8e79-eae128649980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:47.349905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457b6ba-2e83-422a-8e79-eae128649980 admin admin] PATH_INFO: `/v3/users/ccd2f5e3de49454cb20faa365f3fa719` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:47.351387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457b6ba-2e83-422a-8e79-eae128649980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd2f5e3de49454cb20faa365f3fa719)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:47.362013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457b6ba-2e83-422a-8e79-eae128649980 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:47.492388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4457b6ba-2e83-422a-8e79-eae128649980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd2f5e3de49454cb20faa365f3fa719'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:47.510471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4457b6ba-2e83-422a-8e79-eae128649980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd2f5e3de49454cb20faa365f3fa719'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:47.526625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4457b6ba-2e83-422a-8e79-eae128649980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd2f5e3de49454cb20faa365f3fa719'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:47.527765 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4457b6ba-2e83-422a-8e79-eae128649980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd2f5e3de49454cb20faa365f3fa719'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:47.557021 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4457b6ba-2e83-422a-8e79-eae128649980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd2f5e3de49454cb20faa365f3fa719'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:47.568342 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 895/1762] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:28:47 2022] DELETE /identity/v3/users/ccd2f5e3de49454cb20faa365f3fa719 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:48.158910 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc5d01-cb33-4455-9bef-622bc59b33d6 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:48.160702 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d8cc5d01-cb33-4455-9bef-622bc59b33d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:48.182631 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc5d01-cb33-4455-9bef-622bc59b33d6 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:48.465735 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ed729-6372-461f-8521-58ea9ad4f10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:48.466807 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ed729-6372-461f-8521-58ea9ad4f10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:48.470472 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ed729-6372-461f-8521-58ea9ad4f10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:48.472399 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ed729-6372-461f-8521-58ea9ad4f10d admin admin] PATH_INFO: `/v3/projects/3b9199f003ed47eea214a6c893e81fa4` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:48.478805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ed729-6372-461f-8521-58ea9ad4f10d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9199f003ed47eea214a6c893e81fa4)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:48.482609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ed729-6372-461f-8521-58ea9ad4f10d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:48.519835 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:48.651518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3a3ed729-6372-461f-8521-58ea9ad4f10d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9199f003ed47eea214a6c893e81fa4', 'request_id': 'req-3a3ed729-6372-461f-8521-58ea9ad4f10d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:48.678030 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3a3ed729-6372-461f-8521-58ea9ad4f10d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9199f003ed47eea214a6c893e81fa4', 'request_id': 'req-3a3ed729-6372-461f-8521-58ea9ad4f10d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:48.695530 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3a3ed729-6372-461f-8521-58ea9ad4f10d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9199f003ed47eea214a6c893e81fa4', 'request_id': 'req-3a3ed729-6372-461f-8521-58ea9ad4f10d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:48.728384 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3a3ed729-6372-461f-8521-58ea9ad4f10d admin admin] The token cache is being invalidate because project 3b9199f003ed47eea214a6c893e81fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:28:48.728987 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3a3ed729-6372-461f-8521-58ea9ad4f10d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:48.730770 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3a3ed729-6372-461f-8521-58ea9ad4f10d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:48.739920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 868/1763] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:28:48 2022] DELETE /identity/v3/projects/3b9199f003ed47eea214a6c893e81fa4 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:28:48.741746 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0e752-b357-44c1-b3b5-abe0dab246c0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:48.743255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0e752-b357-44c1-b3b5-abe0dab246c0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:48.743760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0e752-b357-44c1-b3b5-abe0dab246c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:48.784508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-21e0e752-b357-44c1-b3b5-abe0dab246c0 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:48.786250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-21e0e752-b357-44c1-b3b5-abe0dab246c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:48.862650 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:48.946365 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 896/1764] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:28:48.948970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042512f-40c0-4f10-b0fb-764abcd6aecc None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:48.949507 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042512f-40c0-4f10-b0fb-764abcd6aecc None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:48.949613 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042512f-40c0-4f10-b0fb-764abcd6aecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:49.004145 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2042512f-40c0-4f10-b0fb-764abcd6aecc None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:49.006809 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2042512f-40c0-4f10-b0fb-764abcd6aecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:49.035663 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0e752-b357-44c1-b3b5-abe0dab246c0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:49.050258 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 869/1765] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:49.077612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0e752-b357-44c1-b3b5-abe0dab246c0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:49.135967 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d24f76-1553-4ba3-a1d0-644ae42c6ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:49.138237 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d24f76-1553-4ba3-a1d0-644ae42c6ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:49.138527 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d24f76-1553-4ba3-a1d0-644ae42c6ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:49.138799 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d24f76-1553-4ba3-a1d0-644ae42c6ad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:49.140855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d24f76-1553-4ba3-a1d0-644ae42c6ad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:28:49.141167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d24f76-1553-4ba3-a1d0-644ae42c6ad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:49.150433 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d24f76-1553-4ba3-a1d0-644ae42c6ad5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:49.200821 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042512f-40c0-4f10-b0fb-764abcd6aecc None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:49.205584 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 897/1766] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:28:49.214400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042512f-40c0-4f10-b0fb-764abcd6aecc None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:49.225830 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b654e-7951-4636-8cbb-6df2bccc7ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:49.229452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b654e-7951-4636-8cbb-6df2bccc7ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:49.230016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b654e-7951-4636-8cbb-6df2bccc7ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:49.230513 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b654e-7951-4636-8cbb-6df2bccc7ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:49.232041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b654e-7951-4636-8cbb-6df2bccc7ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:49.235546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b654e-7951-4636-8cbb-6df2bccc7ab7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:49.294649 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d24f76-1553-4ba3-a1d0-644ae42c6ad5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:49.299885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 870/1767] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:49 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:49.312164 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d24f76-1553-4ba3-a1d0-644ae42c6ad5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:49.402325 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b654e-7951-4636-8cbb-6df2bccc7ab7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:49.405364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1f5b654e-7951-4636-8cbb-6df2bccc7ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:49.499628 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50aceb-e8b3-4297-8e6f-488802fdade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:49.500325 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50aceb-e8b3-4297-8e6f-488802fdade3 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:49.500644 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50aceb-e8b3-4297-8e6f-488802fdade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:49.500917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50aceb-e8b3-4297-8e6f-488802fdade3 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:49.501615 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50aceb-e8b3-4297-8e6f-488802fdade3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:49.503666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50aceb-e8b3-4297-8e6f-488802fdade3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:49.577968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 898/1768] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:49 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:49.583721 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50aceb-e8b3-4297-8e6f-488802fdade3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:49.607596 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b654e-7951-4636-8cbb-6df2bccc7ab7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:49.629529 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50aceb-e8b3-4297-8e6f-488802fdade3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:49.635182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37955d9-4de6-4520-aa43-7f495c034bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:49.642923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37955d9-4de6-4520-aa43-7f495c034bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:49.643539 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37955d9-4de6-4520-aa43-7f495c034bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:49.643950 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37955d9-4de6-4520-aa43-7f495c034bc0 admin admin] PATH_INFO: `/v3/projects/ee298cb1258347a7a21dffe28dff1a9d` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:49.648137 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37955d9-4de6-4520-aa43-7f495c034bc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee298cb1258347a7a21dffe28dff1a9d)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:49.652936 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a22746-23d3-4333-8c1b-e5698ca47968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:49.654833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a22746-23d3-4333-8c1b-e5698ca47968 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:49.655270 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a22746-23d3-4333-8c1b-e5698ca47968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:49.656933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a22746-23d3-4333-8c1b-e5698ca47968 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:49.656933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a22746-23d3-4333-8c1b-e5698ca47968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:49.659418 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37955d9-4de6-4520-aa43-7f495c034bc0 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:49.670301 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a22746-23d3-4333-8c1b-e5698ca47968 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:49.717671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 899/1769] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:49.722788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a22746-23d3-4333-8c1b-e5698ca47968 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:49.756485 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a22746-23d3-4333-8c1b-e5698ca47968 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:49.770965 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104a8f2-1a47-45f9-aeea-9200c11cad7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:49.772847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104a8f2-1a47-45f9-aeea-9200c11cad7f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:49.773131 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104a8f2-1a47-45f9-aeea-9200c11cad7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:49.773402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104a8f2-1a47-45f9-aeea-9200c11cad7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:49.774163 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104a8f2-1a47-45f9-aeea-9200c11cad7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:49.782697 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104a8f2-1a47-45f9-aeea-9200c11cad7f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:49.857961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 900/1770] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:49.862410 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104a8f2-1a47-45f9-aeea-9200c11cad7f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:49.870411 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0104a8f2-1a47-45f9-aeea-9200c11cad7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:49.893461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d37955d9-4de6-4520-aa43-7f495c034bc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee298cb1258347a7a21dffe28dff1a9d', 'request_id': 'req-d37955d9-4de6-4520-aa43-7f495c034bc0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:49.924579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d37955d9-4de6-4520-aa43-7f495c034bc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee298cb1258347a7a21dffe28dff1a9d', 'request_id': 'req-d37955d9-4de6-4520-aa43-7f495c034bc0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:49.929635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104a8f2-1a47-45f9-aeea-9200c11cad7f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:49.942923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d37955d9-4de6-4520-aa43-7f495c034bc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee298cb1258347a7a21dffe28dff1a9d', 'request_id': 'req-d37955d9-4de6-4520-aa43-7f495c034bc0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:49.975004 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:49.993470 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d37955d9-4de6-4520-aa43-7f495c034bc0 admin admin] The token cache is being invalidate because project ee298cb1258347a7a21dffe28dff1a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:28:49.998668 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d37955d9-4de6-4520-aa43-7f495c034bc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:50.002330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d37955d9-4de6-4520-aa43-7f495c034bc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:50.007923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 871/1771] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:28:49 2022] DELETE /identity/v3/projects/ee298cb1258347a7a21dffe28dff1a9d => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:50.007923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37955d9-4de6-4520-aa43-7f495c034bc0 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:50.010567 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d37955d9-4de6-4520-aa43-7f495c034bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:50.153741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d815a43-c1f3-4d41-822e-6790f65fd23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:50.154590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d815a43-c1f3-4d41-822e-6790f65fd23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:50.156554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d815a43-c1f3-4d41-822e-6790f65fd23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:50.156664 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d815a43-c1f3-4d41-822e-6790f65fd23e admin admin] PATH_INFO: `/v3/projects/8627fadcd4bb4d1ba25c8e4dd5f2bc02` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:50.161308 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d815a43-c1f3-4d41-822e-6790f65fd23e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8627fadcd4bb4d1ba25c8e4dd5f2bc02)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:50.169124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d815a43-c1f3-4d41-822e-6790f65fd23e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:50.243443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37955d9-4de6-4520-aa43-7f495c034bc0 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:50.279805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c12b1-e3c1-41dd-a7de-7b9f10738620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:50.280425 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:50.280889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c12b1-e3c1-41dd-a7de-7b9f10738620 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:50.283501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c12b1-e3c1-41dd-a7de-7b9f10738620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:50.283863 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c12b1-e3c1-41dd-a7de-7b9f10738620 admin admin] PATH_INFO: `/v3/projects/b39f6429d81946afb7466b6bec2b7f48/users/4dee5dd9f2064a44a156cf52f055d756/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:50.362776 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c12b1-e3c1-41dd-a7de-7b9f10738620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b39f6429d81946afb7466b6bec2b7f48, user_id=4dee5dd9f2064a44a156cf52f055d756, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:50.366983 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c12b1-e3c1-41dd-a7de-7b9f10738620 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:50.376764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3d815a43-c1f3-4d41-822e-6790f65fd23e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8627fadcd4bb4d1ba25c8e4dd5f2bc02', 'request_id': 'req-3d815a43-c1f3-4d41-822e-6790f65fd23e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:50.390553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3d815a43-c1f3-4d41-822e-6790f65fd23e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8627fadcd4bb4d1ba25c8e4dd5f2bc02', 'request_id': 'req-3d815a43-c1f3-4d41-822e-6790f65fd23e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:50.401825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3d815a43-c1f3-4d41-822e-6790f65fd23e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8627fadcd4bb4d1ba25c8e4dd5f2bc02', 'request_id': 'req-3d815a43-c1f3-4d41-822e-6790f65fd23e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:50.402584 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 872/1772] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:50 2022] PUT /identity/v3/projects/b39f6429d81946afb7466b6bec2b7f48/users/4dee5dd9f2064a44a156cf52f055d756/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:50.415647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2289-3ec4-420e-af82-b269a5053a21 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:50.415934 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2289-3ec4-420e-af82-b269a5053a21 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:50.416341 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2289-3ec4-420e-af82-b269a5053a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:50.440758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a7db2289-3ec4-420e-af82-b269a5053a21 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:50.443391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a7db2289-3ec4-420e-af82-b269a5053a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:50.482969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3d815a43-c1f3-4d41-822e-6790f65fd23e admin admin] The token cache is being invalidate because project 8627fadcd4bb4d1ba25c8e4dd5f2bc02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:28:50.485368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3d815a43-c1f3-4d41-822e-6790f65fd23e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:50.487841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3d815a43-c1f3-4d41-822e-6790f65fd23e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:50.515166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 901/1773] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:28:49 2022] DELETE /identity/v3/projects/8627fadcd4bb4d1ba25c8e4dd5f2bc02 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:50.518619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0ff57-acb9-4396-b7a4-0feca2e395f4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:50.518963 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0ff57-acb9-4396-b7a4-0feca2e395f4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:50.519303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0ff57-acb9-4396-b7a4-0feca2e395f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:50.586363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-45e0ff57-acb9-4396-b7a4-0feca2e395f4 None None] MFA Rules not processed for user `4dee5dd9f2064a44a156cf52f055d756`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:50.587640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-45e0ff57-acb9-4396-b7a4-0feca2e395f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:50.594998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 873/1774] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:50.594998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db2289-3ec4-420e-af82-b269a5053a21 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:50.594998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a7db2289-3ec4-420e-af82-b269a5053a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:50.619210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db2289-3ec4-420e-af82-b269a5053a21 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:50.628109 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e668d87-a46c-4e8a-99d2-8f8673f1520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:50.629863 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e668d87-a46c-4e8a-99d2-8f8673f1520a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:50.630174 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e668d87-a46c-4e8a-99d2-8f8673f1520a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:50.630447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e668d87-a46c-4e8a-99d2-8f8673f1520a admin admin] PATH_INFO: `/v3/users/5e640db13822462db5735f78993192c8` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:50.631769 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e668d87-a46c-4e8a-99d2-8f8673f1520a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e640db13822462db5735f78993192c8)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:50.633938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e668d87-a46c-4e8a-99d2-8f8673f1520a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:50.737501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0e668d87-a46c-4e8a-99d2-8f8673f1520a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e640db13822462db5735f78993192c8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:50.787832 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0e668d87-a46c-4e8a-99d2-8f8673f1520a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e640db13822462db5735f78993192c8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:50.811721 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 902/1775] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:50.813826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12218b-f649-4530-bb09-fb6edf576ea9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:50.814143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12218b-f649-4530-bb09-fb6edf576ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:50.814412 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12218b-f649-4530-bb09-fb6edf576ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:50.830877 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0e668d87-a46c-4e8a-99d2-8f8673f1520a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e640db13822462db5735f78993192c8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:50.831949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0e668d87-a46c-4e8a-99d2-8f8673f1520a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e640db13822462db5735f78993192c8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:50.842970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:50.848726 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0e668d87-a46c-4e8a-99d2-8f8673f1520a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e640db13822462db5735f78993192c8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:50.860168 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 874/1776] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:28:50 2022] DELETE /identity/v3/users/5e640db13822462db5735f78993192c8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:50.861642 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e668d87-a46c-4e8a-99d2-8f8673f1520a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:50.864185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3a12218b-f649-4530-bb09-fb6edf576ea9 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:50.864496 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0e668d87-a46c-4e8a-99d2-8f8673f1520a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:50.865527 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3a12218b-f649-4530-bb09-fb6edf576ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:51.040657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 903/1777] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:51.044323 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12218b-f649-4530-bb09-fb6edf576ea9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:51.052996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e668d87-a46c-4e8a-99d2-8f8673f1520a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:51.071721 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12218b-f649-4530-bb09-fb6edf576ea9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:51.091494 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5814d-dedf-48eb-b85a-47736645d1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:51.092338 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5814d-dedf-48eb-b85a-47736645d1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:51.092951 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5814d-dedf-48eb-b85a-47736645d1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:51.093305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5814d-dedf-48eb-b85a-47736645d1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:51.094977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5814d-dedf-48eb-b85a-47736645d1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:51.102292 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5814d-dedf-48eb-b85a-47736645d1e5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:51.108902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2e42b-753c-4c6f-81dc-23d91f780f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:51.112252 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2e42b-753c-4c6f-81dc-23d91f780f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:51.113272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2e42b-753c-4c6f-81dc-23d91f780f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:51.113832 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2e42b-753c-4c6f-81dc-23d91f780f4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:51.114860 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2e42b-753c-4c6f-81dc-23d91f780f4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:28:51.116998 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2e42b-753c-4c6f-81dc-23d91f780f4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:51.123727 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2e42b-753c-4c6f-81dc-23d91f780f4e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:51.173298 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 904/1778] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:28:51.178174 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2e42b-753c-4c6f-81dc-23d91f780f4e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:51.198603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 875/1779] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:50 2022] POST /identity/v3/projects => generated 385 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:51.201684 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5814d-dedf-48eb-b85a-47736645d1e5 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:51.214502 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2e42b-753c-4c6f-81dc-23d91f780f4e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:51.307942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:51.425870 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf3970-ca39-46e8-ae77-2775d90732e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:51.426721 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf3970-ca39-46e8-ae77-2775d90732e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:51.426855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf3970-ca39-46e8-ae77-2775d90732e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:51.427154 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf3970-ca39-46e8-ae77-2775d90732e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:51.427983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf3970-ca39-46e8-ae77-2775d90732e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:51.433053 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf3970-ca39-46e8-ae77-2775d90732e0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:51.538734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5814d-dedf-48eb-b85a-47736645d1e5 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:51.558909 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa20972-3866-4d1a-821f-b623f1439c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:51.561462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa20972-3866-4d1a-821f-b623f1439c42 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:51.562802 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa20972-3866-4d1a-821f-b623f1439c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:51.563478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa20972-3866-4d1a-821f-b623f1439c42 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:51.565976 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa20972-3866-4d1a-821f-b623f1439c42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:51.584924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa20972-3866-4d1a-821f-b623f1439c42 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:51.602963 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 905/1780] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:51 2022] POST /identity/v3/projects => generated 373 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:51.604964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eefe50-a687-486e-bd17-275a50d7e841 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:51.605408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eefe50-a687-486e-bd17-275a50d7e841 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:51.610874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eefe50-a687-486e-bd17-275a50d7e841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:51.643669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 876/1781] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:51 2022] POST /identity/v3/users => generated 299 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:51.647636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9587ad-6199-495d-912e-d037e487a60d None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:51.649631 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9587ad-6199-495d-912e-d037e487a60d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:51.649631 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9587ad-6199-495d-912e-d037e487a60d None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:51.652387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b2eefe50-a687-486e-bd17-275a50d7e841 None None] MFA Rules not processed for user `dbfe7a2a6c144b598057e446e426688e`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:51.655495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 877/1782] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 03:28:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:28:51.658018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9587ad-6199-495d-912e-d037e487a60d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:51.664323 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b2eefe50-a687-486e-bd17-275a50d7e841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:51.802268 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 906/1783] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:51.803075 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eefe50-a687-486e-bd17-275a50d7e841 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:51.817448 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eefe50-a687-486e-bd17-275a50d7e841 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:51.825143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9587ad-6199-495d-912e-d037e487a60d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:51.837537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdc38a-c355-4cd2-bb47-8991eb23ad0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:51.838763 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc38a-c355-4cd2-bb47-8991eb23ad0e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:51.839342 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc38a-c355-4cd2-bb47-8991eb23ad0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:51.839921 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc38a-c355-4cd2-bb47-8991eb23ad0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:51.840585 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdc38a-c355-4cd2-bb47-8991eb23ad0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:51.841287 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21cd77-f219-41aa-81a2-84b0ef653cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:51.842246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21cd77-f219-41aa-81a2-84b0ef653cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:51.845721 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21cd77-f219-41aa-81a2-84b0ef653cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:51.846537 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21cd77-f219-41aa-81a2-84b0ef653cd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:51.846653 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdc38a-c355-4cd2-bb47-8991eb23ad0e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:51.849588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21cd77-f219-41aa-81a2-84b0ef653cd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:51.854751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21cd77-f219-41aa-81a2-84b0ef653cd3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:51.895955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 907/1784] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:51.899740 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ee4c7-56eb-47ea-b2d1-c1b21773d4f8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:51.902633 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ee4c7-56eb-47ea-b2d1-c1b21773d4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:51.903830 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ee4c7-56eb-47ea-b2d1-c1b21773d4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:51.915241 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:51.932400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 878/1785] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:51 2022] POST /identity/v3/users => generated 287 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:51.932400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21cd77-f219-41aa-81a2-84b0ef653cd3 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:51.974191 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2a8ee4c7-56eb-47ea-b2d1-c1b21773d4f8 None None] MFA Rules not processed for user `0c43d9d0a6264b19a843077a4669ce70`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:51.976997 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21cd77-f219-41aa-81a2-84b0ef653cd3 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:51.978614 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2a8ee4c7-56eb-47ea-b2d1-c1b21773d4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:51.992368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f0484-4b64-4ae8-821c-92852c0f718d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:51.993439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f0484-4b64-4ae8-821c-92852c0f718d admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:51.993801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f0484-4b64-4ae8-821c-92852c0f718d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:51.994141 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f0484-4b64-4ae8-821c-92852c0f718d admin admin] PATH_INFO: `/v3/projects/a4bbfa8233d84bbaa8f08b3ab8022fc1/users/35d47be825ae4cdd94e3fab9adc3a400/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:52.043519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f0484-4b64-4ae8-821c-92852c0f718d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4bbfa8233d84bbaa8f08b3ab8022fc1, user_id=35d47be825ae4cdd94e3fab9adc3a400, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:52.046673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f0484-4b64-4ae8-821c-92852c0f718d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:52.083206 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 879/1786] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:51 2022] PUT /identity/v3/projects/a4bbfa8233d84bbaa8f08b3ab8022fc1/users/35d47be825ae4cdd94e3fab9adc3a400/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:52.087751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f0484-4b64-4ae8-821c-92852c0f718d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:52.147634 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 908/1787] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 03:28:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:52.148946 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ee4c7-56eb-47ea-b2d1-c1b21773d4f8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:52.171912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ee4c7-56eb-47ea-b2d1-c1b21773d4f8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:52.259715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:52.261060 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f0484-4b64-4ae8-821c-92852c0f718d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:52.273417 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead0c71-25de-45df-b492-ea99d045924b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:52.274128 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead0c71-25de-45df-b492-ea99d045924b admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:52.274397 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead0c71-25de-45df-b492-ea99d045924b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:52.274675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead0c71-25de-45df-b492-ea99d045924b admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:52.275423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead0c71-25de-45df-b492-ea99d045924b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:52.277182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead0c71-25de-45df-b492-ea99d045924b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:52.305495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 880/1788] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:52.308838 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead0c71-25de-45df-b492-ea99d045924b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:52.311948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120b8b2-64e8-40b3-8f56-23e8a4db4569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:52.318284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120b8b2-64e8-40b3-8f56-23e8a4db4569 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:52.318717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120b8b2-64e8-40b3-8f56-23e8a4db4569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:52.319040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120b8b2-64e8-40b3-8f56-23e8a4db4569 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:52.319804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120b8b2-64e8-40b3-8f56-23e8a4db4569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:52.321706 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120b8b2-64e8-40b3-8f56-23e8a4db4569 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:52.331662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead0c71-25de-45df-b492-ea99d045924b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:52.361514 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a0dcb-e432-4c09-add0-045d8db50165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:52.362278 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a0dcb-e432-4c09-add0-045d8db50165 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:52.363020 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a0dcb-e432-4c09-add0-045d8db50165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:52.363388 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a0dcb-e432-4c09-add0-045d8db50165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:52.364172 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a0dcb-e432-4c09-add0-045d8db50165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:52.369488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a0dcb-e432-4c09-add0-045d8db50165 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:52.384480 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 909/1789] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:52.385633 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120b8b2-64e8-40b3-8f56-23e8a4db4569 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:52.394392 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9120b8b2-64e8-40b3-8f56-23e8a4db4569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:52.396739 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 881/1790] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:52.397692 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a0dcb-e432-4c09-add0-045d8db50165 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:52.409626 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a0dcb-e432-4c09-add0-045d8db50165 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:52.415856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120b8b2-64e8-40b3-8f56-23e8a4db4569 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:52.416136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a360d4d-5ab2-478c-9678-dd393f8e356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:52.421092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3553e-c55a-400c-a5a7-7b7ee2f918f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:52.422652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3553e-c55a-400c-a5a7-7b7ee2f918f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:52.422926 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3553e-c55a-400c-a5a7-7b7ee2f918f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:52.423213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3553e-c55a-400c-a5a7-7b7ee2f918f0 admin admin] PATH_INFO: `/v3/projects/5b1fa6356a45431591673956f37b4d6e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:52.424649 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3553e-c55a-400c-a5a7-7b7ee2f918f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b1fa6356a45431591673956f37b4d6e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:52.427362 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3553e-c55a-400c-a5a7-7b7ee2f918f0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:52.428544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a360d4d-5ab2-478c-9678-dd393f8e356b admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:52.428995 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a360d4d-5ab2-478c-9678-dd393f8e356b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:52.429337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a360d4d-5ab2-478c-9678-dd393f8e356b admin admin] PATH_INFO: `/v3/projects/a4bbfa8233d84bbaa8f08b3ab8022fc1/users/35d47be825ae4cdd94e3fab9adc3a400/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:52.434953 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a360d4d-5ab2-478c-9678-dd393f8e356b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4bbfa8233d84bbaa8f08b3ab8022fc1, user_id=35d47be825ae4cdd94e3fab9adc3a400, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:52.439755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a360d4d-5ab2-478c-9678-dd393f8e356b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:52.460677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 882/1791] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:52 2022] PUT /identity/v3/projects/a4bbfa8233d84bbaa8f08b3ab8022fc1/users/35d47be825ae4cdd94e3fab9adc3a400/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:52.460677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a360d4d-5ab2-478c-9678-dd393f8e356b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:52.523989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-93a3553e-c55a-400c-a5a7-7b7ee2f918f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b1fa6356a45431591673956f37b4d6e', 'request_id': 'req-93a3553e-c55a-400c-a5a7-7b7ee2f918f0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:52.557761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-93a3553e-c55a-400c-a5a7-7b7ee2f918f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b1fa6356a45431591673956f37b4d6e', 'request_id': 'req-93a3553e-c55a-400c-a5a7-7b7ee2f918f0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:52.574224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-93a3553e-c55a-400c-a5a7-7b7ee2f918f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b1fa6356a45431591673956f37b4d6e', 'request_id': 'req-93a3553e-c55a-400c-a5a7-7b7ee2f918f0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:52.612914 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-93a3553e-c55a-400c-a5a7-7b7ee2f918f0 admin admin] The token cache is being invalidate because project 5b1fa6356a45431591673956f37b4d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:28:52.613770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-93a3553e-c55a-400c-a5a7-7b7ee2f918f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:52.616994 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-93a3553e-c55a-400c-a5a7-7b7ee2f918f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:52.623642 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a360d4d-5ab2-478c-9678-dd393f8e356b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:52.626643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 910/1792] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:28:52 2022] DELETE /identity/v3/projects/5b1fa6356a45431591673956f37b4d6e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:52.628682 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9975340-a07a-4d64-bc60-5e5a7918c195 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:52.628886 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9975340-a07a-4d64-bc60-5e5a7918c195 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:52.632538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9975340-a07a-4d64-bc60-5e5a7918c195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:52.669828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d9975340-a07a-4d64-bc60-5e5a7918c195 None None] MFA Rules not processed for user `35d47be825ae4cdd94e3fab9adc3a400`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:52.670994 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d9975340-a07a-4d64-bc60-5e5a7918c195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:52.749346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:52.786174 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb92be9-5da5-4df4-8c20-90580603fc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:52.788492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb92be9-5da5-4df4-8c20-90580603fc9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:52.789565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb92be9-5da5-4df4-8c20-90580603fc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:52.789565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb92be9-5da5-4df4-8c20-90580603fc9d admin admin] PATH_INFO: `/v3/projects/30a8d4707cba4b06b7337b4189438eff/users/58d91cb8553f4739ac4623ff041f2d91/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:52.818137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 911/1793] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:52.825082 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472042c8-bbbf-440b-b4d4-1f6485ddeb20 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:52.825560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472042c8-bbbf-440b-b4d4-1f6485ddeb20 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:52.825855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472042c8-bbbf-440b-b4d4-1f6485ddeb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:52.844932 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb92be9-5da5-4df4-8c20-90580603fc9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a8d4707cba4b06b7337b4189438eff, user_id=58d91cb8553f4739ac4623ff041f2d91, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:52.854446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb92be9-5da5-4df4-8c20-90580603fc9d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:52.869198 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-472042c8-bbbf-440b-b4d4-1f6485ddeb20 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:52.870885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-472042c8-bbbf-440b-b4d4-1f6485ddeb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:52.881503 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 912/1794] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:52.882761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472042c8-bbbf-440b-b4d4-1f6485ddeb20 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:52.885023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-472042c8-bbbf-440b-b4d4-1f6485ddeb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:52.911039 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 883/1795] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:52 2022] PUT /identity/v3/projects/30a8d4707cba4b06b7337b4189438eff/users/58d91cb8553f4739ac4623ff041f2d91/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:52.911039 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b8465-3451-46fd-8496-d5b0709141c6 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:52.911039 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b8465-3451-46fd-8496-d5b0709141c6 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:52.911039 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b8465-3451-46fd-8496-d5b0709141c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:52.947637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:52.966641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-673b8465-3451-46fd-8496-d5b0709141c6 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:52.968187 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-673b8465-3451-46fd-8496-d5b0709141c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:52.983268 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472042c8-bbbf-440b-b4d4-1f6485ddeb20 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:53.100784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c9b35-0f5a-4f53-b12f-d06052f5f8e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:53.101647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c9b35-0f5a-4f53-b12f-d06052f5f8e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:53.101976 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c9b35-0f5a-4f53-b12f-d06052f5f8e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:53.102253 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c9b35-0f5a-4f53-b12f-d06052f5f8e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:53.192422 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 884/1796] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:53.193961 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd5bd4-9bea-49d6-aca7-e5cf09bd0c50 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:53.194251 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd5bd4-9bea-49d6-aca7-e5cf09bd0c50 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:53.194532 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd5bd4-9bea-49d6-aca7-e5cf09bd0c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:53.269331 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a0bd5bd4-9bea-49d6-aca7-e5cf09bd0c50 None None] MFA Rules not processed for user `58d91cb8553f4739ac4623ff041f2d91`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:53.269331 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a0bd5bd4-9bea-49d6-aca7-e5cf09bd0c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:53.270756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c9b35-0f5a-4f53-b12f-d06052f5f8e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:53.272373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c9b35-0f5a-4f53-b12f-d06052f5f8e5 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:53.322934 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 913/1797] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:53.353643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd60e3-9bbe-4d2b-b5b6-3dc10ffba98a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:53.353643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd60e3-9bbe-4d2b-b5b6-3dc10ffba98a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:53.353643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd60e3-9bbe-4d2b-b5b6-3dc10ffba98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:53.376282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 885/1798] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:53.377224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd5bd4-9bea-49d6-aca7-e5cf09bd0c50 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:53.406094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd5bd4-9bea-49d6-aca7-e5cf09bd0c50 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:53.420884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cd3a1-ca74-495e-8823-44863d3c439b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:53.421439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cd3a1-ca74-495e-8823-44863d3c439b admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:53.421721 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cd3a1-ca74-495e-8823-44863d3c439b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:53.422001 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cd3a1-ca74-495e-8823-44863d3c439b admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:53.422854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cd3a1-ca74-495e-8823-44863d3c439b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:28:53.423183 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cd3a1-ca74-495e-8823-44863d3c439b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:53.424157 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b2cd60e3-9bbe-4d2b-b5b6-3dc10ffba98a None None] MFA Rules not processed for user `d8e90b4b09dd453f9685fb034227a136`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:53.424954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cd3a1-ca74-495e-8823-44863d3c439b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:53.426687 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b2cd60e3-9bbe-4d2b-b5b6-3dc10ffba98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:53.456035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 886/1799] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:28:53.460969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cd3a1-ca74-495e-8823-44863d3c439b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:53.463827 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-878cd3a1-ca74-495e-8823-44863d3c439b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:53.484194 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cd3a1-ca74-495e-8823-44863d3c439b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:53.491847 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2bfa5-2160-476d-ade5-0ce6afb80807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:53.494218 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2bfa5-2160-476d-ade5-0ce6afb80807 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:53.494817 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2bfa5-2160-476d-ade5-0ce6afb80807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:53.495250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2bfa5-2160-476d-ade5-0ce6afb80807 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:53.496401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2bfa5-2160-476d-ade5-0ce6afb80807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:53.502142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2bfa5-2160-476d-ade5-0ce6afb80807 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:53.542717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 914/1800] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:53.545751 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd60e3-9bbe-4d2b-b5b6-3dc10ffba98a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:53.553452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 887/1801] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:53 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:53.553657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b2cd60e3-9bbe-4d2b-b5b6-3dc10ffba98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:53.555510 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2bfa5-2160-476d-ade5-0ce6afb80807 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:53.557596 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d0a2bfa5-2160-476d-ade5-0ce6afb80807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:53.595409 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd60e3-9bbe-4d2b-b5b6-3dc10ffba98a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:53.639386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:53.717398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2bfa5-2160-476d-ade5-0ce6afb80807 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:53.728220 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db534b-72a5-459c-aea8-c4a35d782aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:53.729149 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db534b-72a5-459c-aea8-c4a35d782aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:53.729426 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db534b-72a5-459c-aea8-c4a35d782aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:53.729695 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db534b-72a5-459c-aea8-c4a35d782aa0 admin admin] PATH_INFO: `/v3/users/4dee5dd9f2064a44a156cf52f055d756` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:53.736565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db534b-72a5-459c-aea8-c4a35d782aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dee5dd9f2064a44a156cf52f055d756)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:53.744584 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db534b-72a5-459c-aea8-c4a35d782aa0 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:53.759368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:53.792037 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d85b1-746a-4cde-9c6e-d731b2756977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:53.793925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d85b1-746a-4cde-9c6e-d731b2756977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:53.795926 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d85b1-746a-4cde-9c6e-d731b2756977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:53.797529 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d85b1-746a-4cde-9c6e-d731b2756977 admin admin] PATH_INFO: `/v3/users/f18c5d76d90e4b5db0cf4e3d75acbf3b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:53.800736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d85b1-746a-4cde-9c6e-d731b2756977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f18c5d76d90e4b5db0cf4e3d75acbf3b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:53.817245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d0db534b-72a5-459c-aea8-c4a35d782aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dee5dd9f2064a44a156cf52f055d756'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:53.826456 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d85b1-746a-4cde-9c6e-d731b2756977 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:53.831796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d0db534b-72a5-459c-aea8-c4a35d782aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dee5dd9f2064a44a156cf52f055d756'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:53.861407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d0db534b-72a5-459c-aea8-c4a35d782aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dee5dd9f2064a44a156cf52f055d756'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:53.863238 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d0db534b-72a5-459c-aea8-c4a35d782aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dee5dd9f2064a44a156cf52f055d756'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:53.883998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d0db534b-72a5-459c-aea8-c4a35d782aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dee5dd9f2064a44a156cf52f055d756'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:53.897661 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 888/1802] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:28:53 2022] DELETE /identity/v3/users/4dee5dd9f2064a44a156cf52f055d756 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:53.899086 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db534b-72a5-459c-aea8-c4a35d782aa0 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:53.901691 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d0db534b-72a5-459c-aea8-c4a35d782aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:53.981985 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-415d85b1-746a-4cde-9c6e-d731b2756977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f18c5d76d90e4b5db0cf4e3d75acbf3b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:53.994501 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-415d85b1-746a-4cde-9c6e-d731b2756977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f18c5d76d90e4b5db0cf4e3d75acbf3b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:54.004770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-415d85b1-746a-4cde-9c6e-d731b2756977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f18c5d76d90e4b5db0cf4e3d75acbf3b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:54.005783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-415d85b1-746a-4cde-9c6e-d731b2756977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f18c5d76d90e4b5db0cf4e3d75acbf3b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:54.014076 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db534b-72a5-459c-aea8-c4a35d782aa0 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:54.022223 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1823f7-73f5-478b-b6c7-4ffb5193eedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:54.023386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1823f7-73f5-478b-b6c7-4ffb5193eedc admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:54.024775 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1823f7-73f5-478b-b6c7-4ffb5193eedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:54.025263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1823f7-73f5-478b-b6c7-4ffb5193eedc admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:54.026859 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1823f7-73f5-478b-b6c7-4ffb5193eedc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:54.029803 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-415d85b1-746a-4cde-9c6e-d731b2756977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f18c5d76d90e4b5db0cf4e3d75acbf3b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:54.030437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1823f7-73f5-478b-b6c7-4ffb5193eedc admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:54.060325 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 915/1803] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:28:53 2022] DELETE /identity/v3/users/f18c5d76d90e4b5db0cf4e3d75acbf3b => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:54.061326 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d85b1-746a-4cde-9c6e-d731b2756977 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:54.069440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-415d85b1-746a-4cde-9c6e-d731b2756977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:54.078778 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 889/1804] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:53 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:54.083353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce03d4-cc69-4a6d-a537-136317b32d01 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:54.084040 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce03d4-cc69-4a6d-a537-136317b32d01 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:54.085091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce03d4-cc69-4a6d-a537-136317b32d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:54.132585 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-96ce03d4-cc69-4a6d-a537-136317b32d01 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:54.134152 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-96ce03d4-cc69-4a6d-a537-136317b32d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:54.234033 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:54.255262 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d85b1-746a-4cde-9c6e-d731b2756977 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:54.334984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 890/1805] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:54.340223 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b57515-3b6f-4986-8086-c34df0760d74 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:54.340532 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b57515-3b6f-4986-8086-c34df0760d74 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:54.340824 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b57515-3b6f-4986-8086-c34df0760d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:54.365368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf1973-d98e-4502-a74b-4fae62babd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:54.366307 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf1973-d98e-4502-a74b-4fae62babd78 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:54.369162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf1973-d98e-4502-a74b-4fae62babd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:54.369555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf1973-d98e-4502-a74b-4fae62babd78 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:54.370383 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf1973-d98e-4502-a74b-4fae62babd78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:54.371671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-17b57515-3b6f-4986-8086-c34df0760d74 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:54.373225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-17b57515-3b6f-4986-8086-c34df0760d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:54.374188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf1973-d98e-4502-a74b-4fae62babd78 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:54.388151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 891/1806] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:54.390117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b57515-3b6f-4986-8086-c34df0760d74 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:54.393167 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-17b57515-3b6f-4986-8086-c34df0760d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:54.410106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b57515-3b6f-4986-8086-c34df0760d74 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:54.417585 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1036469-d87d-48ec-bbe3-195355754c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:54.418923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1036469-d87d-48ec-bbe3-195355754c09 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:54.419410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1036469-d87d-48ec-bbe3-195355754c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:54.420242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1036469-d87d-48ec-bbe3-195355754c09 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:54.422285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1036469-d87d-48ec-bbe3-195355754c09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:54.427219 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1036469-d87d-48ec-bbe3-195355754c09 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:54.442366 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 916/1807] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:54 2022] POST /identity/v3/users => generated 293 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:54.442366 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf1973-d98e-4502-a74b-4fae62babd78 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:54.446175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-34bf1973-d98e-4502-a74b-4fae62babd78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:54.460819 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:54.463849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 892/1808] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:54 2022] POST /identity/v3/users => generated 294 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:54.465449 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1036469-d87d-48ec-bbe3-195355754c09 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:54.469237 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c1036469-d87d-48ec-bbe3-195355754c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:54.550435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1036469-d87d-48ec-bbe3-195355754c09 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:54.554965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198a84d-7077-4902-9ec0-3e9903c1dc2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:54.555914 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198a84d-7077-4902-9ec0-3e9903c1dc2e service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:54.556369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198a84d-7077-4902-9ec0-3e9903c1dc2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:54.556838 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198a84d-7077-4902-9ec0-3e9903c1dc2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:54.576380 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198a84d-7077-4902-9ec0-3e9903c1dc2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:54.578135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198a84d-7077-4902-9ec0-3e9903c1dc2e service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:54.593300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 893/1809] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:54.594381 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198a84d-7077-4902-9ec0-3e9903c1dc2e service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:54.606813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198a84d-7077-4902-9ec0-3e9903c1dc2e service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:54.611269 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f1188-d6dd-4ea2-b939-af9c31449746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:54.612162 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f1188-d6dd-4ea2-b939-af9c31449746 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:54.628914 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f1188-d6dd-4ea2-b939-af9c31449746 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:54.629598 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f1188-d6dd-4ea2-b939-af9c31449746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:54.643610 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f1188-d6dd-4ea2-b939-af9c31449746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:54.645567 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f1188-d6dd-4ea2-b939-af9c31449746 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:54.662550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 894/1810] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:54.666061 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f1188-d6dd-4ea2-b939-af9c31449746 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:54.690685 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f1188-d6dd-4ea2-b939-af9c31449746 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:54.703327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da531551-fa66-480c-b7ec-5e2c3c2bb80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:54.704195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da531551-fa66-480c-b7ec-5e2c3c2bb80f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:54.706762 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da531551-fa66-480c-b7ec-5e2c3c2bb80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:54.707386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da531551-fa66-480c-b7ec-5e2c3c2bb80f admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:54.707689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf1973-d98e-4502-a74b-4fae62babd78 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:54.708638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da531551-fa66-480c-b7ec-5e2c3c2bb80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:54.711921 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da531551-fa66-480c-b7ec-5e2c3c2bb80f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:54.723919 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113eeb88-aee1-4a45-8a80-e6934ccfe368 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:54.725175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eeb88-aee1-4a45-8a80-e6934ccfe368 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:54.729722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eeb88-aee1-4a45-8a80-e6934ccfe368 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:54.730006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eeb88-aee1-4a45-8a80-e6934ccfe368 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:54.730779 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 895/1811] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:54.733912 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da531551-fa66-480c-b7ec-5e2c3c2bb80f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:54.734215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-113eeb88-aee1-4a45-8a80-e6934ccfe368 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:54.749204 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da531551-fa66-480c-b7ec-5e2c3c2bb80f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:54.759539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113eeb88-aee1-4a45-8a80-e6934ccfe368 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:54.761255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113eeb88-aee1-4a45-8a80-e6934ccfe368 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:54.761761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051abc09-60d3-4ef0-a49d-5a19c882f58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:54.762891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051abc09-60d3-4ef0-a49d-5a19c882f58f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:54.763317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051abc09-60d3-4ef0-a49d-5a19c882f58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:54.763755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051abc09-60d3-4ef0-a49d-5a19c882f58f admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:54.764992 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051abc09-60d3-4ef0-a49d-5a19c882f58f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:54.767268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051abc09-60d3-4ef0-a49d-5a19c882f58f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:54.774827 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 917/1812] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:54.775691 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113eeb88-aee1-4a45-8a80-e6934ccfe368 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:54.787505 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113eeb88-aee1-4a45-8a80-e6934ccfe368 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:54.789966 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 896/1813] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:54.790881 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051abc09-60d3-4ef0-a49d-5a19c882f58f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:54.800276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944d2e6-848f-40ee-8107-69b81c7f11a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:54.801078 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944d2e6-848f-40ee-8107-69b81c7f11a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:54.801357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944d2e6-848f-40ee-8107-69b81c7f11a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:54.801629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944d2e6-848f-40ee-8107-69b81c7f11a7 admin admin] PATH_INFO: `/v3/projects/fd52cbc75e3b4f9396d0ab94eeaf6b8e/users/9adf1917a40d410cbf8dde300c22d860/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:54.818474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051abc09-60d3-4ef0-a49d-5a19c882f58f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:54.823685 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8545ec-6116-47d9-9ee0-4d7c35e10195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:54.824367 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8545ec-6116-47d9-9ee0-4d7c35e10195 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:54.824703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8545ec-6116-47d9-9ee0-4d7c35e10195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:54.825127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8545ec-6116-47d9-9ee0-4d7c35e10195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:54.825872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8545ec-6116-47d9-9ee0-4d7c35e10195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:54.827485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8545ec-6116-47d9-9ee0-4d7c35e10195 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:54.846715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944d2e6-848f-40ee-8107-69b81c7f11a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd52cbc75e3b4f9396d0ab94eeaf6b8e, user_id=9adf1917a40d410cbf8dde300c22d860, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:54.850242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 897/1814] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:54.854076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944d2e6-848f-40ee-8107-69b81c7f11a7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:54.854476 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8545ec-6116-47d9-9ee0-4d7c35e10195 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:54.884208 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8545ec-6116-47d9-9ee0-4d7c35e10195 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:54.894630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 918/1815] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:54 2022] PUT /identity/v3/projects/fd52cbc75e3b4f9396d0ab94eeaf6b8e/users/9adf1917a40d410cbf8dde300c22d860/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:54.898467 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944d2e6-848f-40ee-8107-69b81c7f11a7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:54.899402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912fb17-da7a-4f32-bfd1-a12a90f4d8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:54.900326 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912fb17-da7a-4f32-bfd1-a12a90f4d8ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:54.900648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912fb17-da7a-4f32-bfd1-a12a90f4d8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:54.900929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912fb17-da7a-4f32-bfd1-a12a90f4d8ed admin admin] PATH_INFO: `/v3/projects/7cfc6649121246f5b1ab40a1cbc9506a/users/9ee1def0a19c4ff18f17de7bd13dbea6/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:54.969947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912fb17-da7a-4f32-bfd1-a12a90f4d8ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cfc6649121246f5b1ab40a1cbc9506a, user_id=9ee1def0a19c4ff18f17de7bd13dbea6, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:54.976899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912fb17-da7a-4f32-bfd1-a12a90f4d8ed admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:55.009785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 898/1816] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:54 2022] PUT /identity/v3/projects/7cfc6649121246f5b1ab40a1cbc9506a/users/9ee1def0a19c4ff18f17de7bd13dbea6/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:28:55.011558 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b338b-86d6-456b-9ff9-5ab438708ac3 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:55.011855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b338b-86d6-456b-9ff9-5ab438708ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:55.012135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b338b-86d6-456b-9ff9-5ab438708ac3 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:55.014450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 899/1817] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 03:28:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:28:55.023392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a54180-b606-47a7-8ef4-1e1569e5d4ef None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:55.025977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a54180-b606-47a7-8ef4-1e1569e5d4ef None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:55.027838 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a54180-b606-47a7-8ef4-1e1569e5d4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:55.169033 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-81a54180-b606-47a7-8ef4-1e1569e5d4ef None None] MFA Rules not processed for user `9ee1def0a19c4ff18f17de7bd13dbea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:55.174725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944d2e6-848f-40ee-8107-69b81c7f11a7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:55.175170 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-81a54180-b606-47a7-8ef4-1e1569e5d4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:55.276158 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:55.341767 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6301950-3571-4a22-bcd2-a0612703ae3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:55.343531 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301950-3571-4a22-bcd2-a0612703ae3b admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:55.344380 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301950-3571-4a22-bcd2-a0612703ae3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:55.345125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301950-3571-4a22-bcd2-a0612703ae3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:55.346250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6301950-3571-4a22-bcd2-a0612703ae3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:55.362239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6301950-3571-4a22-bcd2-a0612703ae3b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:55.399692 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 900/1818] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:55.401094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93133e-b06a-42c6-8a93-21a29f1b8107 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:55.401489 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93133e-b06a-42c6-8a93-21a29f1b8107 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:55.402384 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93133e-b06a-42c6-8a93-21a29f1b8107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:55.405178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 919/1819] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 505 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:28:55.406853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6301950-3571-4a22-bcd2-a0612703ae3b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:55.474511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6301950-3571-4a22-bcd2-a0612703ae3b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:55.488167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717a803-7c3c-409e-af94-a6ecbe7cc812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:55.492557 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717a803-7c3c-409e-af94-a6ecbe7cc812 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:55.493521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717a803-7c3c-409e-af94-a6ecbe7cc812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:55.494220 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717a803-7c3c-409e-af94-a6ecbe7cc812 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:55.496073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717a803-7c3c-409e-af94-a6ecbe7cc812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:55.496880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-1f93133e-b06a-42c6-8a93-21a29f1b8107 None None] MFA Rules not processed for user `0c43d9d0a6264b19a843077a4669ce70`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:55.501917 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1f93133e-b06a-42c6-8a93-21a29f1b8107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:55.506158 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717a803-7c3c-409e-af94-a6ecbe7cc812 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:55.522351 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:55.572985 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 920/1820] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:55 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:55.573290 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717a803-7c3c-409e-af94-a6ecbe7cc812 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:55.681386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 901/1821] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 03:28:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:55.681386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93133e-b06a-42c6-8a93-21a29f1b8107 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:55.718053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93133e-b06a-42c6-8a93-21a29f1b8107 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:55.753897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717a803-7c3c-409e-af94-a6ecbe7cc812 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:55.760724 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ada74-0017-4db0-b694-4a0317dd43ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:55.762008 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ada74-0017-4db0-b694-4a0317dd43ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:55.762405 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ada74-0017-4db0-b694-4a0317dd43ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:55.762783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ada74-0017-4db0-b694-4a0317dd43ca admin admin] PATH_INFO: `/v3/projects/fd52cbc75e3b4f9396d0ab94eeaf6b8e/users/9adf1917a40d410cbf8dde300c22d860/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:55.765579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ada74-0017-4db0-b694-4a0317dd43ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd52cbc75e3b4f9396d0ab94eeaf6b8e, user_id=9adf1917a40d410cbf8dde300c22d860, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:55.769059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ada74-0017-4db0-b694-4a0317dd43ca admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:55.800375 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 921/1822] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:55 2022] PUT /identity/v3/projects/fd52cbc75e3b4f9396d0ab94eeaf6b8e/users/9adf1917a40d410cbf8dde300c22d860/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:55.810506 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc540beb-3103-4fa8-8524-bb26094140e7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:55.810962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc540beb-3103-4fa8-8524-bb26094140e7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:55.811709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc540beb-3103-4fa8-8524-bb26094140e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:55.872054 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cc540beb-3103-4fa8-8524-bb26094140e7 None None] MFA Rules not processed for user `9adf1917a40d410cbf8dde300c22d860`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:55.883046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cc540beb-3103-4fa8-8524-bb26094140e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:55.889191 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652f3a0-e2b3-450b-b41a-6ac4d7d0c464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:55.889672 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652f3a0-e2b3-450b-b41a-6ac4d7d0c464 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:55.890020 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652f3a0-e2b3-450b-b41a-6ac4d7d0c464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:55.890622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652f3a0-e2b3-450b-b41a-6ac4d7d0c464 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:55.891527 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652f3a0-e2b3-450b-b41a-6ac4d7d0c464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:55.901634 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652f3a0-e2b3-450b-b41a-6ac4d7d0c464 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:55.960567 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 902/1823] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:55 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:55.962569 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652f3a0-e2b3-450b-b41a-6ac4d7d0c464 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:55.974355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652f3a0-e2b3-450b-b41a-6ac4d7d0c464 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:56.014322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 922/1824] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:28:56.027641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc540beb-3103-4fa8-8524-bb26094140e7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:56.030604 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cc540beb-3103-4fa8-8524-bb26094140e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:56.073980 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:56.084298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621e769-2851-4a0a-94e1-15ec1ca1ce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:56.085566 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621e769-2851-4a0a-94e1-15ec1ca1ce4f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:56.088793 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621e769-2851-4a0a-94e1-15ec1ca1ce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:56.093358 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621e769-2851-4a0a-94e1-15ec1ca1ce4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:56.094791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621e769-2851-4a0a-94e1-15ec1ca1ce4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:56.097621 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621e769-2851-4a0a-94e1-15ec1ca1ce4f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:56.123001 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 903/1825] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:56.126849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621e769-2851-4a0a-94e1-15ec1ca1ce4f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:56.140355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621e769-2851-4a0a-94e1-15ec1ca1ce4f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:56.147964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc540beb-3103-4fa8-8524-bb26094140e7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:56.149090 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2f915-2951-4649-a48b-2309d76fd898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:56.149998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2f915-2951-4649-a48b-2309d76fd898 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:56.150272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2f915-2951-4649-a48b-2309d76fd898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:56.150605 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2f915-2951-4649-a48b-2309d76fd898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:56.151265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2f915-2951-4649-a48b-2309d76fd898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:56.152993 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2f915-2951-4649-a48b-2309d76fd898 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:56.161120 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe3bfc-47fc-468c-9259-83a9b7745d0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:56.162366 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe3bfc-47fc-468c-9259-83a9b7745d0c service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:56.162924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe3bfc-47fc-468c-9259-83a9b7745d0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:56.163689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe3bfc-47fc-468c-9259-83a9b7745d0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:56.193421 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe3bfc-47fc-468c-9259-83a9b7745d0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:56.195669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe3bfc-47fc-468c-9259-83a9b7745d0c service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:56.214208 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 904/1826] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:56.222935 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2f915-2951-4649-a48b-2309d76fd898 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:56.228084 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 923/1827] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:56.242907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2f915-2951-4649-a48b-2309d76fd898 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:56.248958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911abc5-98b4-4ca0-bdac-15483e29739a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:56.249873 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911abc5-98b4-4ca0-bdac-15483e29739a admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:56.250261 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911abc5-98b4-4ca0-bdac-15483e29739a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:56.250544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911abc5-98b4-4ca0-bdac-15483e29739a admin admin] PATH_INFO: `/v3/projects/a70d87f07d7c4ef6b3400ef7c26d5f93/users/ad0b044212ef48f59f279dfc86fe3edf/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:56.271094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911abc5-98b4-4ca0-bdac-15483e29739a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70d87f07d7c4ef6b3400ef7c26d5f93, user_id=ad0b044212ef48f59f279dfc86fe3edf, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:56.275591 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911abc5-98b4-4ca0-bdac-15483e29739a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:56.320127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 905/1828] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:56 2022] PUT /identity/v3/projects/a70d87f07d7c4ef6b3400ef7c26d5f93/users/ad0b044212ef48f59f279dfc86fe3edf/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:28:56.330346 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85095c01-8e5a-4606-b1e8-c8e4815fc1b2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:56.330631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85095c01-8e5a-4606-b1e8-c8e4815fc1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:56.330899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85095c01-8e5a-4606-b1e8-c8e4815fc1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:56.359156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:56.372174 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-85095c01-8e5a-4606-b1e8-c8e4815fc1b2 None None] MFA Rules not processed for user `ad0b044212ef48f59f279dfc86fe3edf`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:56.373786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-85095c01-8e5a-4606-b1e8-c8e4815fc1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:56.474000 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 924/1829] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:56.478514 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911abc5-98b4-4ca0-bdac-15483e29739a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:56.500997 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85095c01-8e5a-4606-b1e8-c8e4815fc1b2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:56.502598 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-85095c01-8e5a-4606-b1e8-c8e4815fc1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:56.640495 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85095c01-8e5a-4606-b1e8-c8e4815fc1b2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:56.655765 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911abc5-98b4-4ca0-bdac-15483e29739a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:56.661083 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db980dde-8d68-4634-b59f-1ba66ae2d2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:56.662202 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a8436-62d3-40e7-87aa-21f037755813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:56.663010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a8436-62d3-40e7-87aa-21f037755813 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:56.663351 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a8436-62d3-40e7-87aa-21f037755813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:56.663624 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a8436-62d3-40e7-87aa-21f037755813 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:56.663764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db980dde-8d68-4634-b59f-1ba66ae2d2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:56.664451 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a8436-62d3-40e7-87aa-21f037755813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:56.665404 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db980dde-8d68-4634-b59f-1ba66ae2d2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:56.666821 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db980dde-8d68-4634-b59f-1ba66ae2d2a0 admin admin] PATH_INFO: `/v3/projects/b39f6429d81946afb7466b6bec2b7f48` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:56.667156 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a8436-62d3-40e7-87aa-21f037755813 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:56.669014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db980dde-8d68-4634-b59f-1ba66ae2d2a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b39f6429d81946afb7466b6bec2b7f48)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:56.672093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db980dde-8d68-4634-b59f-1ba66ae2d2a0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:56.736625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 906/1830] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:56 2022] POST /identity/v3/projects => generated 385 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:56.737829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a8436-62d3-40e7-87aa-21f037755813 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:56.763107 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-db980dde-8d68-4634-b59f-1ba66ae2d2a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b39f6429d81946afb7466b6bec2b7f48', 'request_id': 'req-db980dde-8d68-4634-b59f-1ba66ae2d2a0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:56.777751 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-db980dde-8d68-4634-b59f-1ba66ae2d2a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b39f6429d81946afb7466b6bec2b7f48', 'request_id': 'req-db980dde-8d68-4634-b59f-1ba66ae2d2a0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:56.788894 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-db980dde-8d68-4634-b59f-1ba66ae2d2a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b39f6429d81946afb7466b6bec2b7f48', 'request_id': 'req-db980dde-8d68-4634-b59f-1ba66ae2d2a0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:56.806246 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-db980dde-8d68-4634-b59f-1ba66ae2d2a0 admin admin] The token cache is being invalidate because project b39f6429d81946afb7466b6bec2b7f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:28:56.807209 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-db980dde-8d68-4634-b59f-1ba66ae2d2a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:56.808565 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-db980dde-8d68-4634-b59f-1ba66ae2d2a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:56.810996 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 925/1831] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:28:56 2022] DELETE /identity/v3/projects/b39f6429d81946afb7466b6bec2b7f48 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:56.812118 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db980dde-8d68-4634-b59f-1ba66ae2d2a0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:56.813907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-db980dde-8d68-4634-b59f-1ba66ae2d2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:56.838446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a8436-62d3-40e7-87aa-21f037755813 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:56.881250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:56.885416 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:56.924470 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db980dde-8d68-4634-b59f-1ba66ae2d2a0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:56.930635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f066f-b8ac-42ac-92fb-f0ad6b2f06d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:56.930839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f066f-b8ac-42ac-92fb-f0ad6b2f06d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:56.931124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f066f-b8ac-42ac-92fb-f0ad6b2f06d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:56.931412 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f066f-b8ac-42ac-92fb-f0ad6b2f06d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:56.932113 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f066f-b8ac-42ac-92fb-f0ad6b2f06d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:56.934530 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f066f-b8ac-42ac-92fb-f0ad6b2f06d8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:56.947996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc190754-75ea-49fc-af2c-38b50db23d5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:56.949381 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc190754-75ea-49fc-af2c-38b50db23d5a service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:56.949762 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc190754-75ea-49fc-af2c-38b50db23d5a service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:56.950127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc190754-75ea-49fc-af2c-38b50db23d5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:56.952985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-dc190754-75ea-49fc-af2c-38b50db23d5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:56.963299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 926/1832] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:56 2022] POST /identity/v3/users => generated 299 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:56.965588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f066f-b8ac-42ac-92fb-f0ad6b2f06d8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:56.975080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc190754-75ea-49fc-af2c-38b50db23d5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:56.977075 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc190754-75ea-49fc-af2c-38b50db23d5a service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:56.991060 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 907/1833] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:56.991948 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc190754-75ea-49fc-af2c-38b50db23d5a service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:56.993375 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-dc190754-75ea-49fc-af2c-38b50db23d5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:56.993553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-685f066f-b8ac-42ac-92fb-f0ad6b2f06d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:57.011001 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc190754-75ea-49fc-af2c-38b50db23d5a service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:57.011684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f066f-b8ac-42ac-92fb-f0ad6b2f06d8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:57.015831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b9352-f51d-40c3-912f-089dd927d6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:57.016743 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b9352-f51d-40c3-912f-089dd927d6f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:57.017079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b9352-f51d-40c3-912f-089dd927d6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:57.017357 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b9352-f51d-40c3-912f-089dd927d6f2 admin admin] PATH_INFO: `/v3/users/58d91cb8553f4739ac4623ff041f2d91` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:57.019113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b9352-f51d-40c3-912f-089dd927d6f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d91cb8553f4739ac4623ff041f2d91)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:57.020933 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b9352-f51d-40c3-912f-089dd927d6f2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:57.030751 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef0dc0-ab53-4298-9f03-2cfd81b94b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:57.031660 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef0dc0-ab53-4298-9f03-2cfd81b94b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:57.031943 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef0dc0-ab53-4298-9f03-2cfd81b94b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:57.032255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef0dc0-ab53-4298-9f03-2cfd81b94b2b admin admin] PATH_INFO: `/v3/users/35d47be825ae4cdd94e3fab9adc3a400` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:57.038701 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef0dc0-ab53-4298-9f03-2cfd81b94b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d47be825ae4cdd94e3fab9adc3a400)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:57.040890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef0dc0-ab53-4298-9f03-2cfd81b94b2b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:57.084616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-110b9352-f51d-40c3-912f-089dd927d6f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d91cb8553f4739ac4623ff041f2d91'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:57.095241 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-110b9352-f51d-40c3-912f-089dd927d6f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d91cb8553f4739ac4623ff041f2d91'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:57.112861 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-110b9352-f51d-40c3-912f-089dd927d6f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d91cb8553f4739ac4623ff041f2d91'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:57.113822 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-110b9352-f51d-40c3-912f-089dd927d6f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d91cb8553f4739ac4623ff041f2d91'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:57.122007 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-110b9352-f51d-40c3-912f-089dd927d6f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d91cb8553f4739ac4623ff041f2d91'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:57.128666 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 908/1834] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:28:56 2022] DELETE /identity/v3/users/58d91cb8553f4739ac4623ff041f2d91 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:57.129738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b9352-f51d-40c3-912f-089dd927d6f2 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:57.131760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-110b9352-f51d-40c3-912f-089dd927d6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:57.150545 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-43ef0dc0-ab53-4298-9f03-2cfd81b94b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d47be825ae4cdd94e3fab9adc3a400'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:57.162232 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-43ef0dc0-ab53-4298-9f03-2cfd81b94b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d47be825ae4cdd94e3fab9adc3a400'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:57.174557 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-43ef0dc0-ab53-4298-9f03-2cfd81b94b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d47be825ae4cdd94e3fab9adc3a400'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:57.176647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-43ef0dc0-ab53-4298-9f03-2cfd81b94b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d47be825ae4cdd94e3fab9adc3a400'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:57.195974 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-43ef0dc0-ab53-4298-9f03-2cfd81b94b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d47be825ae4cdd94e3fab9adc3a400'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:57.211871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 927/1835] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:28:56 2022] DELETE /identity/v3/users/35d47be825ae4cdd94e3fab9adc3a400 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:57.213089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef0dc0-ab53-4298-9f03-2cfd81b94b2b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:57.225049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-43ef0dc0-ab53-4298-9f03-2cfd81b94b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:57.292059 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b9352-f51d-40c3-912f-089dd927d6f2 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:57.390105 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef0dc0-ab53-4298-9f03-2cfd81b94b2b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:57.400903 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:57.402600 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524882c-c1d7-4e7c-a5ef-94c24c824d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:57.403302 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524882c-c1d7-4e7c-a5ef-94c24c824d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:57.403582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524882c-c1d7-4e7c-a5ef-94c24c824d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:57.403854 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524882c-c1d7-4e7c-a5ef-94c24c824d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:57.404631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524882c-c1d7-4e7c-a5ef-94c24c824d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:57.406525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524882c-c1d7-4e7c-a5ef-94c24c824d46 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:57.422049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 928/1836] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:57.422049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe00a9-5e7b-4d64-83f7-0fd3591de3e5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:57.422049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe00a9-5e7b-4d64-83f7-0fd3591de3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:57.422049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe00a9-5e7b-4d64-83f7-0fd3591de3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:57.442142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-febe00a9-5e7b-4d64-83f7-0fd3591de3e5 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:57.444582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-febe00a9-5e7b-4d64-83f7-0fd3591de3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:57.471973 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 929/1837] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:57.473047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe00a9-5e7b-4d64-83f7-0fd3591de3e5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:57.485313 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe00a9-5e7b-4d64-83f7-0fd3591de3e5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:57.491492 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa1b62-68da-4de7-ae85-512a2b154439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:57.492647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa1b62-68da-4de7-ae85-512a2b154439 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:57.492939 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa1b62-68da-4de7-ae85-512a2b154439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:57.493215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa1b62-68da-4de7-ae85-512a2b154439 admin admin] PATH_INFO: `/v3/projects/184feb6b0d8e4a1fa7ca1560fe04a347/users/b5607fd2f94d4bb3b8d2c1384cad6f3e/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:57.514023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa1b62-68da-4de7-ae85-512a2b154439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=184feb6b0d8e4a1fa7ca1560fe04a347, user_id=b5607fd2f94d4bb3b8d2c1384cad6f3e, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:57.515306 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24654c3-f95d-4deb-9673-43399d6ac0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:57.517945 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa1b62-68da-4de7-ae85-512a2b154439 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:57.519971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24654c3-f95d-4deb-9673-43399d6ac0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:57.520709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24654c3-f95d-4deb-9673-43399d6ac0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:57.522327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:57.522753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24654c3-f95d-4deb-9673-43399d6ac0e7 admin admin] PATH_INFO: `/v3/projects/a008e4498a3a4eecabd84209f4aead4e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:57.526169 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24654c3-f95d-4deb-9673-43399d6ac0e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a008e4498a3a4eecabd84209f4aead4e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:57.530230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24654c3-f95d-4deb-9673-43399d6ac0e7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:57.569590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 930/1838] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:57 2022] PUT /identity/v3/projects/184feb6b0d8e4a1fa7ca1560fe04a347/users/b5607fd2f94d4bb3b8d2c1384cad6f3e/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:57.570629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa1b62-68da-4de7-ae85-512a2b154439 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:57.580214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-03fa1b62-68da-4de7-ae85-512a2b154439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:57.636786 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a24654c3-f95d-4deb-9673-43399d6ac0e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a008e4498a3a4eecabd84209f4aead4e', 'request_id': 'req-a24654c3-f95d-4deb-9673-43399d6ac0e7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:57.658365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a24654c3-f95d-4deb-9673-43399d6ac0e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a008e4498a3a4eecabd84209f4aead4e', 'request_id': 'req-a24654c3-f95d-4deb-9673-43399d6ac0e7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:57.671295 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a24654c3-f95d-4deb-9673-43399d6ac0e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a008e4498a3a4eecabd84209f4aead4e', 'request_id': 'req-a24654c3-f95d-4deb-9673-43399d6ac0e7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:57.686020 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a24654c3-f95d-4deb-9673-43399d6ac0e7 admin admin] The token cache is being invalidate because project a008e4498a3a4eecabd84209f4aead4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:28:57.686451 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a24654c3-f95d-4deb-9673-43399d6ac0e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:57.687247 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a24654c3-f95d-4deb-9673-43399d6ac0e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:57.690080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 909/1839] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:28:57 2022] DELETE /identity/v3/projects/a008e4498a3a4eecabd84209f4aead4e => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:57.690584 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24654c3-f95d-4deb-9673-43399d6ac0e7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:57.694227 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a24654c3-f95d-4deb-9673-43399d6ac0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:57.696800 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa1b62-68da-4de7-ae85-512a2b154439 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:57.774277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946573e-9f8c-4c48-b7f0-33a774c394d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:57.775291 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946573e-9f8c-4c48-b7f0-33a774c394d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:57.775811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946573e-9f8c-4c48-b7f0-33a774c394d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:57.776316 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946573e-9f8c-4c48-b7f0-33a774c394d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:57.778469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f946573e-9f8c-4c48-b7f0-33a774c394d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:57.794682 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946573e-9f8c-4c48-b7f0-33a774c394d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:57.796472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946573e-9f8c-4c48-b7f0-33a774c394d5 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:57.816370 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24654c3-f95d-4deb-9673-43399d6ac0e7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:57.818838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 931/1840] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:57.822123 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946573e-9f8c-4c48-b7f0-33a774c394d5 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:57.828196 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f946573e-9f8c-4c48-b7f0-33a774c394d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:57.833468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9c7bc-eed2-47ec-9163-bc45a0850a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:57.837296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9c7bc-eed2-47ec-9163-bc45a0850a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:57.837296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9c7bc-eed2-47ec-9163-bc45a0850a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:57.837296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9c7bc-eed2-47ec-9163-bc45a0850a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:57.837296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9c7bc-eed2-47ec-9163-bc45a0850a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:57.839079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9c7bc-eed2-47ec-9163-bc45a0850a55 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:57.853362 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946573e-9f8c-4c48-b7f0-33a774c394d5 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:57.864150 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f4004-99f5-4219-92c6-a9d23fd8dfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:57.865909 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 910/1841] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:28:57.867672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f4004-99f5-4219-92c6-a9d23fd8dfd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:57.867961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f4004-99f5-4219-92c6-a9d23fd8dfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:57.868237 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f4004-99f5-4219-92c6-a9d23fd8dfd3 admin admin] PATH_INFO: `/v3/users/337b9e9ccb50498a839ef7a9fd29349f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:57.873398 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f4004-99f5-4219-92c6-a9d23fd8dfd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=337b9e9ccb50498a839ef7a9fd29349f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:57.874241 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9c7bc-eed2-47ec-9163-bc45a0850a55 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:57.875370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f4004-99f5-4219-92c6-a9d23fd8dfd3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:57.894718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9c7bc-eed2-47ec-9163-bc45a0850a55 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:57.927729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75199b-fa40-45e9-9f68-3e33941be645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:57.928881 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75199b-fa40-45e9-9f68-3e33941be645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:57.929303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75199b-fa40-45e9-9f68-3e33941be645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:57.929773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75199b-fa40-45e9-9f68-3e33941be645 admin admin] PATH_INFO: `/v3/projects/184feb6b0d8e4a1fa7ca1560fe04a347/users/b5607fd2f94d4bb3b8d2c1384cad6f3e/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:57.932897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75199b-fa40-45e9-9f68-3e33941be645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=184feb6b0d8e4a1fa7ca1560fe04a347, user_id=b5607fd2f94d4bb3b8d2c1384cad6f3e, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:57.946992 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75199b-fa40-45e9-9f68-3e33941be645 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:57.977924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 911/1842] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:28:57 2022] PUT /identity/v3/projects/184feb6b0d8e4a1fa7ca1560fe04a347/users/b5607fd2f94d4bb3b8d2c1384cad6f3e/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:57.980957 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7ae78-ba26-4389-b749-b41a70fbfbf5 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:57.983382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7ae78-ba26-4389-b749-b41a70fbfbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:57.984657 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7ae78-ba26-4389-b749-b41a70fbfbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:58.018259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a33f4004-99f5-4219-92c6-a9d23fd8dfd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '337b9e9ccb50498a839ef7a9fd29349f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:58.033107 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a33f4004-99f5-4219-92c6-a9d23fd8dfd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '337b9e9ccb50498a839ef7a9fd29349f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:58.054738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-d8e7ae78-ba26-4389-b749-b41a70fbfbf5 None None] MFA Rules not processed for user `b5607fd2f94d4bb3b8d2c1384cad6f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:58.059123 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d8e7ae78-ba26-4389-b749-b41a70fbfbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:58.060713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a33f4004-99f5-4219-92c6-a9d23fd8dfd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '337b9e9ccb50498a839ef7a9fd29349f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:58.062732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a33f4004-99f5-4219-92c6-a9d23fd8dfd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '337b9e9ccb50498a839ef7a9fd29349f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:58.094331 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a33f4004-99f5-4219-92c6-a9d23fd8dfd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '337b9e9ccb50498a839ef7a9fd29349f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:58.110652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 932/1843] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:28:57 2022] DELETE /identity/v3/users/337b9e9ccb50498a839ef7a9fd29349f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:58.135989 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:58.174146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 912/1844] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:58.186798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f4004-99f5-4219-92c6-a9d23fd8dfd3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:58.188372 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a33f4004-99f5-4219-92c6-a9d23fd8dfd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:58.223687 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:58.262518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f4004-99f5-4219-92c6-a9d23fd8dfd3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:58.269561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa747d6-fb76-465f-a281-907c01b851e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:58.270336 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa747d6-fb76-465f-a281-907c01b851e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:58.270679 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa747d6-fb76-465f-a281-907c01b851e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:58.271042 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa747d6-fb76-465f-a281-907c01b851e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:58.355019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa747d6-fb76-465f-a281-907c01b851e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:58.356874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa747d6-fb76-465f-a281-907c01b851e5 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:58.368432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 933/1845] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:58.368589 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7ae78-ba26-4389-b749-b41a70fbfbf5 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:58.373065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d8e7ae78-ba26-4389-b749-b41a70fbfbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:58.523780 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7ae78-ba26-4389-b749-b41a70fbfbf5 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:58.623709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:58.628097 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:58.628550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:58.631593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca admin admin] PATH_INFO: `/v3/projects/a4bbfa8233d84bbaa8f08b3ab8022fc1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:58.634394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4bbfa8233d84bbaa8f08b3ab8022fc1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:58.638653 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:58.659094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa747d6-fb76-465f-a281-907c01b851e5 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:58.660697 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-efa747d6-fb76-465f-a281-907c01b851e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:58.689847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa747d6-fb76-465f-a281-907c01b851e5 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:58.715268 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27766d63-7368-47ed-b868-c859b466e707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:58.717748 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27766d63-7368-47ed-b868-c859b466e707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:58.718178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27766d63-7368-47ed-b868-c859b466e707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:58.719985 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27766d63-7368-47ed-b868-c859b466e707 admin admin] PATH_INFO: `/v3/projects/30a8d4707cba4b06b7337b4189438eff` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:58.724934 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27766d63-7368-47ed-b868-c859b466e707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a8d4707cba4b06b7337b4189438eff)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:58.729281 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27766d63-7368-47ed-b868-c859b466e707 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:58.791591 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4bbfa8233d84bbaa8f08b3ab8022fc1', 'request_id': 'req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:58.815984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4bbfa8233d84bbaa8f08b3ab8022fc1', 'request_id': 'req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:58.829973 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4bbfa8233d84bbaa8f08b3ab8022fc1', 'request_id': 'req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:58.834219 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-27766d63-7368-47ed-b868-c859b466e707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a8d4707cba4b06b7337b4189438eff', 'request_id': 'req-27766d63-7368-47ed-b868-c859b466e707'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:58.864191 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-27766d63-7368-47ed-b868-c859b466e707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a8d4707cba4b06b7337b4189438eff', 'request_id': 'req-27766d63-7368-47ed-b868-c859b466e707'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:58.866733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca admin admin] The token cache is being invalidate because project a4bbfa8233d84bbaa8f08b3ab8022fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:28:58.867743 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:58.873711 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:58.879082 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-27766d63-7368-47ed-b868-c859b466e707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a8d4707cba4b06b7337b4189438eff', 'request_id': 'req-27766d63-7368-47ed-b868-c859b466e707'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:58.881985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 913/1846] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:28:58 2022] DELETE /identity/v3/projects/a4bbfa8233d84bbaa8f08b3ab8022fc1 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:58.884917 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:58.889342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:58.923512 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-27766d63-7368-47ed-b868-c859b466e707 admin admin] The token cache is being invalidate because project 30a8d4707cba4b06b7337b4189438eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:28:58.924570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-27766d63-7368-47ed-b868-c859b466e707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:58.926989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-27766d63-7368-47ed-b868-c859b466e707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:58.930220 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 934/1847] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:28:58 2022] DELETE /identity/v3/projects/30a8d4707cba4b06b7337b4189438eff => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:28:58.933774 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb2c75-7877-4d66-8f3d-5322e5568e06 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:58.934094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb2c75-7877-4d66-8f3d-5322e5568e06 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:58.934370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb2c75-7877-4d66-8f3d-5322e5568e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:58.953242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:59.007330 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e8cb2c75-7877-4d66-8f3d-5322e5568e06 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:59.013103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e8cb2c75-7877-4d66-8f3d-5322e5568e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:59.067780 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aeada9-1f44-42c4-b3e1-4a08ae3585ca admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:59.101607 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:59.137566 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 935/1848] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:59.138562 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb2c75-7877-4d66-8f3d-5322e5568e06 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:59.148823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e8cb2c75-7877-4d66-8f3d-5322e5568e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:59.161890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb2c75-7877-4d66-8f3d-5322e5568e06 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:59.171098 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f207ae-f310-4ce4-b874-c72df78ed503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:59.171995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f207ae-f310-4ce4-b874-c72df78ed503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:59.172323 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f207ae-f310-4ce4-b874-c72df78ed503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:59.172797 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f207ae-f310-4ce4-b874-c72df78ed503 admin admin] PATH_INFO: `/v3/users/9adf1917a40d410cbf8dde300c22d860` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:59.173820 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f207ae-f310-4ce4-b874-c72df78ed503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9adf1917a40d410cbf8dde300c22d860)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:59.175799 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f207ae-f310-4ce4-b874-c72df78ed503 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:59.180903 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2de5d-667f-4536-9207-6ae534d77642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:59.183270 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2de5d-667f-4536-9207-6ae534d77642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:59.183270 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2de5d-667f-4536-9207-6ae534d77642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:59.183270 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2de5d-667f-4536-9207-6ae534d77642 admin admin] PATH_INFO: `/v3/projects/cf8202d1364c4680845ef9553ac8b35c` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:59.184343 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2de5d-667f-4536-9207-6ae534d77642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf8202d1364c4680845ef9553ac8b35c)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:59.186942 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2de5d-667f-4536-9207-6ae534d77642 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:59.257976 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a5f207ae-f310-4ce4-b874-c72df78ed503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9adf1917a40d410cbf8dde300c22d860'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:59.275158 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a5f207ae-f310-4ce4-b874-c72df78ed503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9adf1917a40d410cbf8dde300c22d860'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:59.283680 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-afd2de5d-667f-4536-9207-6ae534d77642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf8202d1364c4680845ef9553ac8b35c', 'request_id': 'req-afd2de5d-667f-4536-9207-6ae534d77642'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:59.287749 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a5f207ae-f310-4ce4-b874-c72df78ed503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9adf1917a40d410cbf8dde300c22d860'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:59.289508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a5f207ae-f310-4ce4-b874-c72df78ed503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9adf1917a40d410cbf8dde300c22d860'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:59.317037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-afd2de5d-667f-4536-9207-6ae534d77642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf8202d1364c4680845ef9553ac8b35c', 'request_id': 'req-afd2de5d-667f-4536-9207-6ae534d77642'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:59.327816 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a5f207ae-f310-4ce4-b874-c72df78ed503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9adf1917a40d410cbf8dde300c22d860'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:59.329182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-afd2de5d-667f-4536-9207-6ae534d77642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf8202d1364c4680845ef9553ac8b35c', 'request_id': 'req-afd2de5d-667f-4536-9207-6ae534d77642'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:59.340606 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 936/1849] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:28:59 2022] DELETE /identity/v3/users/9adf1917a40d410cbf8dde300c22d860 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:59.342027 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6726c3c-5720-4267-b26c-dc529ccedb5b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:59.343049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6726c3c-5720-4267-b26c-dc529ccedb5b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:59.343049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6726c3c-5720-4267-b26c-dc529ccedb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:59.349363 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-afd2de5d-667f-4536-9207-6ae534d77642 admin admin] The token cache is being invalidate because project cf8202d1364c4680845ef9553ac8b35c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:28:59.350259 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-afd2de5d-667f-4536-9207-6ae534d77642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:59.352404 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-afd2de5d-667f-4536-9207-6ae534d77642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:28:59.355187 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 914/1850] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:28:58 2022] DELETE /identity/v3/projects/cf8202d1364c4680845ef9553ac8b35c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:28:59.356557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2de5d-667f-4536-9207-6ae534d77642 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:59.359131 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-afd2de5d-667f-4536-9207-6ae534d77642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:59.363410 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e6726c3c-5720-4267-b26c-dc529ccedb5b None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:59.364246 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e6726c3c-5720-4267-b26c-dc529ccedb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:59.444424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2de5d-667f-4536-9207-6ae534d77642 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:59.457746 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:59.495215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 937/1851] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:59.499740 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc1cd1-7954-4f6a-8d91-8f1f7f483765 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:59.500697 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc1cd1-7954-4f6a-8d91-8f1f7f483765 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:59.500837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc1cd1-7954-4f6a-8d91-8f1f7f483765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:59.514266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d1710-4056-4175-b69e-0cb898ec1536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:59.516379 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d1710-4056-4175-b69e-0cb898ec1536 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:59.516790 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d1710-4056-4175-b69e-0cb898ec1536 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:59.517325 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d1710-4056-4175-b69e-0cb898ec1536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:59.519793 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-284d1710-4056-4175-b69e-0cb898ec1536 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:59.551691 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-45cc1cd1-7954-4f6a-8d91-8f1f7f483765 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:59.556770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-45cc1cd1-7954-4f6a-8d91-8f1f7f483765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:59.574072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 938/1852] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:59.576368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc1cd1-7954-4f6a-8d91-8f1f7f483765 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:59.606125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc1cd1-7954-4f6a-8d91-8f1f7f483765 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:59.638553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5955845-cd4d-4697-bc4e-352090202492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:59.639235 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5955845-cd4d-4697-bc4e-352090202492 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:59.639612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5955845-cd4d-4697-bc4e-352090202492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:59.639894 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5955845-cd4d-4697-bc4e-352090202492 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:59.640470 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d1710-4056-4175-b69e-0cb898ec1536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:59.640753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5955845-cd4d-4697-bc4e-352090202492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:28:59.641137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5955845-cd4d-4697-bc4e-352090202492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:59.642829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5955845-cd4d-4697-bc4e-352090202492 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:59.648335 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d1710-4056-4175-b69e-0cb898ec1536 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:59.672605 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 915/1853] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:28:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:28:59.674365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c9ace-8241-4af9-9773-eae7c79550ef None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:59.678539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 939/1854] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:28:59.680603 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5955845-cd4d-4697-bc4e-352090202492 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:59.687550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c9ace-8241-4af9-9773-eae7c79550ef None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:59.687834 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c9ace-8241-4af9-9773-eae7c79550ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:59.700893 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5955845-cd4d-4697-bc4e-352090202492 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:59.713249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302bd01-fe12-4ab2-a9f4-9f417777b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:59.714472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302bd01-fe12-4ab2-a9f4-9f417777b462 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:59.714472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302bd01-fe12-4ab2-a9f4-9f417777b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:59.714472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302bd01-fe12-4ab2-a9f4-9f417777b462 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:59.715178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302bd01-fe12-4ab2-a9f4-9f417777b462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:59.721087 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302bd01-fe12-4ab2-a9f4-9f417777b462 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:59.745928 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-252c9ace-8241-4af9-9773-eae7c79550ef None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:28:59.749406 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-252c9ace-8241-4af9-9773-eae7c79550ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:28:59.772933 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 916/1855] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:28:59.774260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c9ace-8241-4af9-9773-eae7c79550ef None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:59.782919 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 940/1856] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:59 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:59.786935 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302bd01-fe12-4ab2-a9f4-9f417777b462 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:59.810602 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c9ace-8241-4af9-9773-eae7c79550ef None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:59.846151 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:28:59.916831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302bd01-fe12-4ab2-a9f4-9f417777b462 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:28:59.926148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ac5b4-aefc-4bfa-a4a8-454278211c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:59.926862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ac5b4-aefc-4bfa-a4a8-454278211c62 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:59.927150 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ac5b4-aefc-4bfa-a4a8-454278211c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:59.927430 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ac5b4-aefc-4bfa-a4a8-454278211c62 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:59.928145 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ac5b4-aefc-4bfa-a4a8-454278211c62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:59.930677 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ac5b4-aefc-4bfa-a4a8-454278211c62 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:59.961325 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de17145-1697-4761-bc91-d2608a69eaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:28:59.962659 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de17145-1697-4761-bc91-d2608a69eaed admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:28:59.962946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de17145-1697-4761-bc91-d2608a69eaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:28:59.963223 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de17145-1697-4761-bc91-d2608a69eaed admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:28:59.965115 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de17145-1697-4761-bc91-d2608a69eaed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:28:59.965434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de17145-1697-4761-bc91-d2608a69eaed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:28:59.967321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de17145-1697-4761-bc91-d2608a69eaed admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:28:59.978292 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 941/1857] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:28:59 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:28:59.980021 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ac5b4-aefc-4bfa-a4a8-454278211c62 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:28:59.985200 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 917/1858] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:28:59.992054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de17145-1697-4761-bc91-d2608a69eaed admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:00.000725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ac5b4-aefc-4bfa-a4a8-454278211c62 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:00.015213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3f06c-a654-4dd3-9327-018843fe0448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:00.015921 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3f06c-a654-4dd3-9327-018843fe0448 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:00.016207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3f06c-a654-4dd3-9327-018843fe0448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:00.016487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3f06c-a654-4dd3-9327-018843fe0448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:00.017317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3f06c-a654-4dd3-9327-018843fe0448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:00.019113 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3f06c-a654-4dd3-9327-018843fe0448 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:00.040383 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 942/1859] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:29:00.044326 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3f06c-a654-4dd3-9327-018843fe0448 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:00.047550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de17145-1697-4761-bc91-d2608a69eaed admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:00.062229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee625d-8c40-446c-9044-6eeab84346db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:00.062907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee625d-8c40-446c-9044-6eeab84346db admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:00.063185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee625d-8c40-446c-9044-6eeab84346db admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:00.063496 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee625d-8c40-446c-9044-6eeab84346db admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:00.064377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee625d-8c40-446c-9044-6eeab84346db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:00.069653 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee625d-8c40-446c-9044-6eeab84346db admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:00.086992 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3f06c-a654-4dd3-9327-018843fe0448 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:00.098108 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c99c22-3daa-494a-9949-7a93fa60044c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:00.106074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c99c22-3daa-494a-9949-7a93fa60044c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:00.106699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c99c22-3daa-494a-9949-7a93fa60044c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:00.108496 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c99c22-3daa-494a-9949-7a93fa60044c admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:00.111847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c99c22-3daa-494a-9949-7a93fa60044c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:00.116228 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c99c22-3daa-494a-9949-7a93fa60044c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:00.130134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 918/1860] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:28:59 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:00.131819 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee625d-8c40-446c-9044-6eeab84346db admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:00.147019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 943/1861] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:00.151185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c99c22-3daa-494a-9949-7a93fa60044c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:00.181054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:00.184982 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c99c22-3daa-494a-9949-7a93fa60044c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:00.246832 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee625d-8c40-446c-9044-6eeab84346db admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:00.259297 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547b30d-61bb-410c-bd17-c587dc833a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:00.260057 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547b30d-61bb-410c-bd17-c587dc833a74 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:00.260330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547b30d-61bb-410c-bd17-c587dc833a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:00.260630 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547b30d-61bb-410c-bd17-c587dc833a74 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:00.261383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547b30d-61bb-410c-bd17-c587dc833a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:00.266077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547b30d-61bb-410c-bd17-c587dc833a74 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:00.313245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 919/1862] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:00 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:29:00.314459 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547b30d-61bb-410c-bd17-c587dc833a74 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:00.337594 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547b30d-61bb-410c-bd17-c587dc833a74 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:00.367750 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d9e45-c6db-44c3-a617-2a2399f6d2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:00.370700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d9e45-c6db-44c3-a617-2a2399f6d2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:00.370992 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d9e45-c6db-44c3-a617-2a2399f6d2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:00.371097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a3d4f-1216-463d-ae41-53955e4a51b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:00.372017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a3d4f-1216-463d-ae41-53955e4a51b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:00.372818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a3d4f-1216-463d-ae41-53955e4a51b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:00.373360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a3d4f-1216-463d-ae41-53955e4a51b7 admin admin] PATH_INFO: `/v3/projects/f7806414fe1f4041baf724351f0398f9/users/533b42cf76b34849b1e0814f8ec88e53/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:00.374187 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d9e45-c6db-44c3-a617-2a2399f6d2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:00.377398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d9e45-c6db-44c3-a617-2a2399f6d2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:00.385280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d9e45-c6db-44c3-a617-2a2399f6d2e8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:00.402378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a3d4f-1216-463d-ae41-53955e4a51b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7806414fe1f4041baf724351f0398f9, user_id=533b42cf76b34849b1e0814f8ec88e53, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:00.405960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a3d4f-1216-463d-ae41-53955e4a51b7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:00.416300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 920/1863] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:00.418215 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d9e45-c6db-44c3-a617-2a2399f6d2e8 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:00.433675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 944/1864] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:00 2022] PUT /identity/v3/projects/f7806414fe1f4041baf724351f0398f9/users/533b42cf76b34849b1e0814f8ec88e53/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:00.441742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d9e45-c6db-44c3-a617-2a2399f6d2e8 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:00.446678 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde01f91-d5ad-43df-8f30-de3ce620533e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:00.446967 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde01f91-d5ad-43df-8f30-de3ce620533e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:00.447249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde01f91-d5ad-43df-8f30-de3ce620533e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:00.514135 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-dde01f91-d5ad-43df-8f30-de3ce620533e None None] MFA Rules not processed for user `533b42cf76b34849b1e0814f8ec88e53`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:00.515730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dde01f91-d5ad-43df-8f30-de3ce620533e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:00.585083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086b48b-7e38-4b9c-8551-791d00ee2c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:00.585999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086b48b-7e38-4b9c-8551-791d00ee2c7f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:00.586463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086b48b-7e38-4b9c-8551-791d00ee2c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:00.587214 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086b48b-7e38-4b9c-8551-791d00ee2c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:00.587743 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086b48b-7e38-4b9c-8551-791d00ee2c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:00.593228 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086b48b-7e38-4b9c-8551-791d00ee2c7f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:00.614494 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 945/1865] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:00.615548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde01f91-d5ad-43df-8f30-de3ce620533e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:00.618527 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 921/1866] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:00.622915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086b48b-7e38-4b9c-8551-791d00ee2c7f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:00.644926 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086b48b-7e38-4b9c-8551-791d00ee2c7f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:00.656250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde01f91-d5ad-43df-8f30-de3ce620533e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:00.668188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d226aa-f965-46cb-ac3e-13b8f352565e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:00.670916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c64e11-f11e-4861-8470-4bcbd9aa240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:00.671855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c64e11-f11e-4861-8470-4bcbd9aa240a admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:00.673040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d226aa-f965-46cb-ac3e-13b8f352565e admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:00.673372 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d226aa-f965-46cb-ac3e-13b8f352565e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:00.673825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d226aa-f965-46cb-ac3e-13b8f352565e admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:00.674813 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d226aa-f965-46cb-ac3e-13b8f352565e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:00.676969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d226aa-f965-46cb-ac3e-13b8f352565e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:00.685698 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c64e11-f11e-4861-8470-4bcbd9aa240a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:00.686072 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c64e11-f11e-4861-8470-4bcbd9aa240a admin admin] PATH_INFO: `/v3/projects/85ea4e24c0eb4948830c85cd19468e2e/users/7fec7f0fa06941c3b97e17e4c3621b2f/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:00.688315 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:00.722853 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c64e11-f11e-4861-8470-4bcbd9aa240a admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ea4e24c0eb4948830c85cd19468e2e, user_id=7fec7f0fa06941c3b97e17e4c3621b2f, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:00.726883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c64e11-f11e-4861-8470-4bcbd9aa240a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:00.734346 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 946/1867] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:00 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:00.738882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d226aa-f965-46cb-ac3e-13b8f352565e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:00.773476 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 922/1868] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:00 2022] PUT /identity/v3/projects/85ea4e24c0eb4948830c85cd19468e2e/users/7fec7f0fa06941c3b97e17e4c3621b2f/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:00.786184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31a29f-ba31-4ed9-a42d-b96216854355 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:00.786471 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31a29f-ba31-4ed9-a42d-b96216854355 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:00.786753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31a29f-ba31-4ed9-a42d-b96216854355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:00.822846 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-da31a29f-ba31-4ed9-a42d-b96216854355 None None] MFA Rules not processed for user `7fec7f0fa06941c3b97e17e4c3621b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:00.824842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-da31a29f-ba31-4ed9-a42d-b96216854355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:00.853040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d226aa-f965-46cb-ac3e-13b8f352565e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:00.917779 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 923/1869] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:29:00.922276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31a29f-ba31-4ed9-a42d-b96216854355 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:00.923711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ea2b6-f781-48b3-b024-e378fcf48028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:00.924406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ea2b6-f781-48b3-b024-e378fcf48028 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:00.925256 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ea2b6-f781-48b3-b024-e378fcf48028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:00.925256 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ea2b6-f781-48b3-b024-e378fcf48028 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:00.926192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ea2b6-f781-48b3-b024-e378fcf48028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:00.928280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ea2b6-f781-48b3-b024-e378fcf48028 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:00.939112 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31a29f-ba31-4ed9-a42d-b96216854355 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:00.945306 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3b613-283e-4a5c-a054-b65a96465851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:00.946210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3b613-283e-4a5c-a054-b65a96465851 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:00.946497 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3b613-283e-4a5c-a054-b65a96465851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:00.946772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3b613-283e-4a5c-a054-b65a96465851 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:00.947473 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3b613-283e-4a5c-a054-b65a96465851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:00.949969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3b613-283e-4a5c-a054-b65a96465851 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:00.964787 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:00.967111 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 947/1870] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:00 2022] POST /identity/v3/users => generated 301 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:29:00.978295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ea2b6-f781-48b3-b024-e378fcf48028 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:00.996006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ea2b6-f781-48b3-b024-e378fcf48028 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:00.998078 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 924/1871] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:00 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:01.001932 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3b613-283e-4a5c-a054-b65a96465851 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:01.090857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aeade7-d369-43e9-9c21-e46c31701ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:01.091287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeade7-d369-43e9-9c21-e46c31701ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:01.091564 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeade7-d369-43e9-9c21-e46c31701ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:01.091839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeade7-d369-43e9-9c21-e46c31701ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:01.093947 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aeade7-d369-43e9-9c21-e46c31701ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:01.097292 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aeade7-d369-43e9-9c21-e46c31701ad0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:01.117736 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3b613-283e-4a5c-a054-b65a96465851 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:01.125220 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 948/1872] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:01.125747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aeade7-d369-43e9-9c21-e46c31701ad0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:01.139335 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67f679-4c61-46b8-a562-2cf7c711bfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:01.140092 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67f679-4c61-46b8-a562-2cf7c711bfac admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:01.140277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67f679-4c61-46b8-a562-2cf7c711bfac admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:01.140576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67f679-4c61-46b8-a562-2cf7c711bfac admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:01.141279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67f679-4c61-46b8-a562-2cf7c711bfac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:01.143369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67f679-4c61-46b8-a562-2cf7c711bfac admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:01.155559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aeade7-d369-43e9-9c21-e46c31701ad0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:01.166906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3b382-db06-493f-b1df-bdd9c3b7e7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:01.167865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b382-db06-493f-b1df-bdd9c3b7e7a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:01.168144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b382-db06-493f-b1df-bdd9c3b7e7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:01.172147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b382-db06-493f-b1df-bdd9c3b7e7a8 admin admin] PATH_INFO: `/v3/projects/a24072ced4be4e8196bdc19b643813d1/users/120d20e6d4384d81ad180374e1ddcd54/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:01.173727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 925/1873] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:01 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:01.192954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3b382-db06-493f-b1df-bdd9c3b7e7a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24072ced4be4e8196bdc19b643813d1, user_id=120d20e6d4384d81ad180374e1ddcd54, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:01.195809 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3b382-db06-493f-b1df-bdd9c3b7e7a8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:01.197559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67f679-4c61-46b8-a562-2cf7c711bfac admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:01.200710 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ee67f679-4c61-46b8-a562-2cf7c711bfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:01.207763 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:01.217216 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 949/1874] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:01 2022] PUT /identity/v3/projects/a24072ced4be4e8196bdc19b643813d1/users/120d20e6d4384d81ad180374e1ddcd54/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:01.218434 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3b382-db06-493f-b1df-bdd9c3b7e7a8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:01.221714 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67f679-4c61-46b8-a562-2cf7c711bfac admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:01.296972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3b382-db06-493f-b1df-bdd9c3b7e7a8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:01.310982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f82f5-3c89-46db-855a-c9e92350ff79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:01.310982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f82f5-3c89-46db-855a-c9e92350ff79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:01.310982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f82f5-3c89-46db-855a-c9e92350ff79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:01.310982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f82f5-3c89-46db-855a-c9e92350ff79 admin admin] PATH_INFO: `/v3/projects/fd52cbc75e3b4f9396d0ab94eeaf6b8e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:01.311368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6073f65-4029-48ff-af13-46e5c2e03c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:01.311451 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f82f5-3c89-46db-855a-c9e92350ff79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd52cbc75e3b4f9396d0ab94eeaf6b8e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:01.311520 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6073f65-4029-48ff-af13-46e5c2e03c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:01.311520 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6073f65-4029-48ff-af13-46e5c2e03c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:01.311520 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6073f65-4029-48ff-af13-46e5c2e03c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:01.311520 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6073f65-4029-48ff-af13-46e5c2e03c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:01.311756 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f82f5-3c89-46db-855a-c9e92350ff79 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:01.311823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6073f65-4029-48ff-af13-46e5c2e03c8f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:01.321952 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 950/1875] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:01.326167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6073f65-4029-48ff-af13-46e5c2e03c8f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:01.336284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6073f65-4029-48ff-af13-46e5c2e03c8f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:01.341787 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389b7c-39b7-4f35-a5e4-126667231890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:01.342814 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389b7c-39b7-4f35-a5e4-126667231890 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:01.343452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389b7c-39b7-4f35-a5e4-126667231890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:01.343818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389b7c-39b7-4f35-a5e4-126667231890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:01.345461 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2389b7c-39b7-4f35-a5e4-126667231890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:01.348510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2389b7c-39b7-4f35-a5e4-126667231890 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:01.363445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 951/1876] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:01.363445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389b7c-39b7-4f35-a5e4-126667231890 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:01.372797 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389b7c-39b7-4f35-a5e4-126667231890 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:01.395550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-356f82f5-3c89-46db-855a-c9e92350ff79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd52cbc75e3b4f9396d0ab94eeaf6b8e', 'request_id': 'req-356f82f5-3c89-46db-855a-c9e92350ff79'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:01.417981 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-356f82f5-3c89-46db-855a-c9e92350ff79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd52cbc75e3b4f9396d0ab94eeaf6b8e', 'request_id': 'req-356f82f5-3c89-46db-855a-c9e92350ff79'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:01.427986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-356f82f5-3c89-46db-855a-c9e92350ff79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd52cbc75e3b4f9396d0ab94eeaf6b8e', 'request_id': 'req-356f82f5-3c89-46db-855a-c9e92350ff79'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:01.446044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-356f82f5-3c89-46db-855a-c9e92350ff79 admin admin] The token cache is being invalidate because project fd52cbc75e3b4f9396d0ab94eeaf6b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:01.446372 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-356f82f5-3c89-46db-855a-c9e92350ff79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:01.447400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-356f82f5-3c89-46db-855a-c9e92350ff79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:01.449317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 926/1877] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:01 2022] DELETE /identity/v3/projects/fd52cbc75e3b4f9396d0ab94eeaf6b8e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:01.450082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f82f5-3c89-46db-855a-c9e92350ff79 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:01.454550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-356f82f5-3c89-46db-855a-c9e92350ff79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:01.482848 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d248d9b-e779-440e-8b18-b637cbd47022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:01.483666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d248d9b-e779-440e-8b18-b637cbd47022 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:01.483966 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d248d9b-e779-440e-8b18-b637cbd47022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:01.484640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d248d9b-e779-440e-8b18-b637cbd47022 admin admin] PATH_INFO: `/v3/projects/ad96e898e07e4d7583c6634123710f83/users/ddacf7e807404907bea3395eb8d31f48/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:01.490854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:01.509345 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d248d9b-e779-440e-8b18-b637cbd47022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad96e898e07e4d7583c6634123710f83, user_id=ddacf7e807404907bea3395eb8d31f48, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:01.514363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d248d9b-e779-440e-8b18-b637cbd47022 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:01.536451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 952/1878] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:01 2022] PUT /identity/v3/projects/ad96e898e07e4d7583c6634123710f83/users/ddacf7e807404907bea3395eb8d31f48/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:01.538174 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b023cc-d595-4d53-98a1-e0c6023d9578 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:01.538461 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b023cc-d595-4d53-98a1-e0c6023d9578 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:01.539049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b023cc-d595-4d53-98a1-e0c6023d9578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:01.566096 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-69b023cc-d595-4d53-98a1-e0c6023d9578 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:01.567625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-69b023cc-d595-4d53-98a1-e0c6023d9578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:01.593079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f82f5-3c89-46db-855a-c9e92350ff79 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:01.738961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 953/1879] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:01.739933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b023cc-d595-4d53-98a1-e0c6023d9578 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:01.764656 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-69b023cc-d595-4d53-98a1-e0c6023d9578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:01.771418 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ec766-8f40-4199-90e9-de5ff127e321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:01.772818 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ec766-8f40-4199-90e9-de5ff127e321 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:01.773112 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ec766-8f40-4199-90e9-de5ff127e321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:01.773648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ec766-8f40-4199-90e9-de5ff127e321 admin admin] PATH_INFO: `/v3/projects/a24072ced4be4e8196bdc19b643813d1/users/120d20e6d4384d81ad180374e1ddcd54/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:01.779270 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b023cc-d595-4d53-98a1-e0c6023d9578 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:01.787546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ec766-8f40-4199-90e9-de5ff127e321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24072ced4be4e8196bdc19b643813d1, user_id=120d20e6d4384d81ad180374e1ddcd54, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:01.789273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d4d7d-fb1b-435d-8c45-30c013277ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:01.789978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d4d7d-fb1b-435d-8c45-30c013277ace admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:01.790260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d4d7d-fb1b-435d-8c45-30c013277ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:01.790540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d4d7d-fb1b-435d-8c45-30c013277ace admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:01.790867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ec766-8f40-4199-90e9-de5ff127e321 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:01.793057 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d4d7d-fb1b-435d-8c45-30c013277ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:01.794737 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d4d7d-fb1b-435d-8c45-30c013277ace admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:01.796583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:01.810856 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 927/1880] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:01 2022] PUT /identity/v3/projects/a24072ced4be4e8196bdc19b643813d1/users/120d20e6d4384d81ad180374e1ddcd54/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:01.812560 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda14cd0-58de-43b1-aefe-50605684fec7 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:01.812958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda14cd0-58de-43b1-aefe-50605684fec7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:01.813320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda14cd0-58de-43b1-aefe-50605684fec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:01.841425 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 954/1881] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:01.843079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12380adb-0c41-45b4-91fc-6bee4bece208 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:01.843742 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12380adb-0c41-45b4-91fc-6bee4bece208 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:01.844348 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12380adb-0c41-45b4-91fc-6bee4bece208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:01.852296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-fda14cd0-58de-43b1-aefe-50605684fec7 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:01.853759 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fda14cd0-58de-43b1-aefe-50605684fec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:01.881386 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-12380adb-0c41-45b4-91fc-6bee4bece208 None None] MFA Rules not processed for user `120d20e6d4384d81ad180374e1ddcd54`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:01.883019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-12380adb-0c41-45b4-91fc-6bee4bece208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:01.973774 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 955/1882] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:01.975041 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12380adb-0c41-45b4-91fc-6bee4bece208 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:01.989740 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 928/1883] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:01.991789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda14cd0-58de-43b1-aefe-50605684fec7 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:01.993225 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fda14cd0-58de-43b1-aefe-50605684fec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:02.093323 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda14cd0-58de-43b1-aefe-50605684fec7 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:02.099456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f3584-f3b3-492b-a466-430f073e2330 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:02.100455 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f3584-f3b3-492b-a466-430f073e2330 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:02.100844 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f3584-f3b3-492b-a466-430f073e2330 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:02.101221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f3584-f3b3-492b-a466-430f073e2330 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:02.106800 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12380adb-0c41-45b4-91fc-6bee4bece208 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:02.110037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:02.112744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f3584-f3b3-492b-a466-430f073e2330 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:02.114636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f3584-f3b3-492b-a466-430f073e2330 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:02.130053 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37ebad-a07d-4b03-b4a5-3e6f8e305a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:02.131704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37ebad-a07d-4b03-b4a5-3e6f8e305a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:02.132052 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37ebad-a07d-4b03-b4a5-3e6f8e305a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:02.132333 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37ebad-a07d-4b03-b4a5-3e6f8e305a1d admin admin] PATH_INFO: `/v3/projects/ad96e898e07e4d7583c6634123710f83/users/ddacf7e807404907bea3395eb8d31f48/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:02.135512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 929/1884] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:02.136407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f3584-f3b3-492b-a466-430f073e2330 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:02.137878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37ebad-a07d-4b03-b4a5-3e6f8e305a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad96e898e07e4d7583c6634123710f83, user_id=ddacf7e807404907bea3395eb8d31f48, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:02.143200 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37ebad-a07d-4b03-b4a5-3e6f8e305a1d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:02.149279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f3584-f3b3-492b-a466-430f073e2330 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:02.155820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef07ffe-64ea-41fe-b7bb-7990bdf6ed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:02.171486 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 956/1885] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:01 2022] PUT /identity/v3/projects/ad96e898e07e4d7583c6634123710f83/users/ddacf7e807404907bea3395eb8d31f48/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:02.176767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef07ffe-64ea-41fe-b7bb-7990bdf6ed04 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:02.177065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef07ffe-64ea-41fe-b7bb-7990bdf6ed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:02.177357 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef07ffe-64ea-41fe-b7bb-7990bdf6ed04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:02.178115 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef07ffe-64ea-41fe-b7bb-7990bdf6ed04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:02.178425 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef07ffe-64ea-41fe-b7bb-7990bdf6ed04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:02.180072 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef07ffe-64ea-41fe-b7bb-7990bdf6ed04 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:02.182509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e66ecd-cf09-4f4b-8a76-032896fadcb2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:02.183011 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e66ecd-cf09-4f4b-8a76-032896fadcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:02.187933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e66ecd-cf09-4f4b-8a76-032896fadcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:02.202832 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 930/1886] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:29:02.203968 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef07ffe-64ea-41fe-b7bb-7990bdf6ed04 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:02.216484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef07ffe-64ea-41fe-b7bb-7990bdf6ed04 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:02.278639 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-33e66ecd-cf09-4f4b-8a76-032896fadcb2 None None] MFA Rules not processed for user `ddacf7e807404907bea3395eb8d31f48`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:02.279874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-33e66ecd-cf09-4f4b-8a76-032896fadcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:02.310358 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318c237-a9a8-4b2c-84d0-bd71cf003d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:02.311027 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318c237-a9a8-4b2c-84d0-bd71cf003d1b admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:02.311303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318c237-a9a8-4b2c-84d0-bd71cf003d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:02.311571 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318c237-a9a8-4b2c-84d0-bd71cf003d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:02.312392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318c237-a9a8-4b2c-84d0-bd71cf003d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:02.341305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318c237-a9a8-4b2c-84d0-bd71cf003d1b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:02.404562 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 931/1887] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:02 2022] POST /identity/v3/projects => generated 379 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:02.406867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318c237-a9a8-4b2c-84d0-bd71cf003d1b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:02.449947 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:02.455377 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 957/1888] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:02 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:02.458036 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e66ecd-cf09-4f4b-8a76-032896fadcb2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:02.489472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e66ecd-cf09-4f4b-8a76-032896fadcb2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:02.556719 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318c237-a9a8-4b2c-84d0-bd71cf003d1b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:02.574800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94643190-749f-4003-8695-0affc72410d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:02.575973 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94643190-749f-4003-8695-0affc72410d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:02.576305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94643190-749f-4003-8695-0affc72410d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:02.576595 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94643190-749f-4003-8695-0affc72410d9 admin admin] PATH_INFO: `/v3/users/533b42cf76b34849b1e0814f8ec88e53` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:02.581686 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94643190-749f-4003-8695-0affc72410d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=533b42cf76b34849b1e0814f8ec88e53)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:02.584576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94643190-749f-4003-8695-0affc72410d9 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:02.599424 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54c3c3-0048-4f7f-9711-55e7b33438d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:02.601335 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54c3c3-0048-4f7f-9711-55e7b33438d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:02.602208 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54c3c3-0048-4f7f-9711-55e7b33438d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:02.602636 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54c3c3-0048-4f7f-9711-55e7b33438d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:02.603489 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54c3c3-0048-4f7f-9711-55e7b33438d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:02.607569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54c3c3-0048-4f7f-9711-55e7b33438d9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:02.661585 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 958/1889] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:02 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:02.662671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54c3c3-0048-4f7f-9711-55e7b33438d9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:02.680886 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-94643190-749f-4003-8695-0affc72410d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533b42cf76b34849b1e0814f8ec88e53'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:02.699233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-94643190-749f-4003-8695-0affc72410d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533b42cf76b34849b1e0814f8ec88e53'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:02.727507 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:02.730645 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-94643190-749f-4003-8695-0affc72410d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533b42cf76b34849b1e0814f8ec88e53'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:02.731581 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-94643190-749f-4003-8695-0affc72410d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533b42cf76b34849b1e0814f8ec88e53'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:02.751839 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-94643190-749f-4003-8695-0affc72410d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533b42cf76b34849b1e0814f8ec88e53'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:02.769062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54c3c3-0048-4f7f-9711-55e7b33438d9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:02.772189 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 932/1890] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:02 2022] DELETE /identity/v3/users/533b42cf76b34849b1e0814f8ec88e53 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:02.772189 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f8e96-eff7-447e-bc25-dd53a874bd27 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:02.772189 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f8e96-eff7-447e-bc25-dd53a874bd27 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:02.773523 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f8e96-eff7-447e-bc25-dd53a874bd27 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:02.774321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 933/1891] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 03:29:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:29:02.775139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f8e96-eff7-447e-bc25-dd53a874bd27 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:02.777065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-133f8e96-eff7-447e-bc25-dd53a874bd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:02.842975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d6bd5-3819-489c-b88f-e5b0037064a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:02.843760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d6bd5-3819-489c-b88f-e5b0037064a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:02.844048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d6bd5-3819-489c-b88f-e5b0037064a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:02.844779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d6bd5-3819-489c-b88f-e5b0037064a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:02.848138 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ed7d6bd5-3819-489c-b88f-e5b0037064a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:02.870558 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f8e96-eff7-447e-bc25-dd53a874bd27 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:02.876332 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859059e-8b05-4ab4-a552-1f9c3c8d2057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:02.877185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859059e-8b05-4ab4-a552-1f9c3c8d2057 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:02.877472 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859059e-8b05-4ab4-a552-1f9c3c8d2057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:02.878879 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859059e-8b05-4ab4-a552-1f9c3c8d2057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:02.880322 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859059e-8b05-4ab4-a552-1f9c3c8d2057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:02.881993 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859059e-8b05-4ab4-a552-1f9c3c8d2057 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:02.901524 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 934/1892] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:02.903663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72337001-b549-4766-9b94-0519fadd8ff6 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:02.904939 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72337001-b549-4766-9b94-0519fadd8ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:02.905456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72337001-b549-4766-9b94-0519fadd8ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:02.930866 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-72337001-b549-4766-9b94-0519fadd8ff6 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:02.932254 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-72337001-b549-4766-9b94-0519fadd8ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:02.933040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:02.936061 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d6bd5-3819-489c-b88f-e5b0037064a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:02.937807 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d6bd5-3819-489c-b88f-e5b0037064a0 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:02.946075 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 935/1893] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:02.947568 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c31d8-e478-4692-b65a-b6dbdfe336f4 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:02.947856 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c31d8-e478-4692-b65a-b6dbdfe336f4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:02.948235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c31d8-e478-4692-b65a-b6dbdfe336f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:02.954825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 959/1894] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:02 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:02.966905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d6bd5-3819-489c-b88f-e5b0037064a0 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:02.992167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d6bd5-3819-489c-b88f-e5b0037064a0 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:02.999286 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07915811-4101-4b08-9967-8aa159cc6831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:03.002203 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07915811-4101-4b08-9967-8aa159cc6831 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:03.004712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07915811-4101-4b08-9967-8aa159cc6831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:03.005295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07915811-4101-4b08-9967-8aa159cc6831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:03.006573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a01c31d8-e478-4692-b65a-b6dbdfe336f4 None None] MFA Rules not processed for user `0c43d9d0a6264b19a843077a4669ce70`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:03.008109 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a01c31d8-e478-4692-b65a-b6dbdfe336f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:03.015642 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07915811-4101-4b08-9967-8aa159cc6831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:03.022795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07915811-4101-4b08-9967-8aa159cc6831 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:03.055722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 960/1895] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:03.057904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07915811-4101-4b08-9967-8aa159cc6831 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:03.061281 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-07915811-4101-4b08-9967-8aa159cc6831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:03.168743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07915811-4101-4b08-9967-8aa159cc6831 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:03.170154 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 936/1896] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 03:29:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:03.171019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c31d8-e478-4692-b65a-b6dbdfe336f4 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:03.172458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a01c31d8-e478-4692-b65a-b6dbdfe336f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:03.173284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46959b02-6630-4c26-9e3f-452f90dd9eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:03.174171 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46959b02-6630-4c26-9e3f-452f90dd9eda service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:03.174740 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46959b02-6630-4c26-9e3f-452f90dd9eda service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:03.175455 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46959b02-6630-4c26-9e3f-452f90dd9eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:03.193211 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46959b02-6630-4c26-9e3f-452f90dd9eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:03.195309 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46959b02-6630-4c26-9e3f-452f90dd9eda service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:03.199451 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c31d8-e478-4692-b65a-b6dbdfe336f4 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:03.210267 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663da7a-e9ac-48b8-af08-ea36b9924ff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:03.210942 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663da7a-e9ac-48b8-af08-ea36b9924ff2 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:03.211282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663da7a-e9ac-48b8-af08-ea36b9924ff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:03.211521 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663da7a-e9ac-48b8-af08-ea36b9924ff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:03.213795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 961/1897] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:03.214688 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46959b02-6630-4c26-9e3f-452f90dd9eda service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:03.227812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46959b02-6630-4c26-9e3f-452f90dd9eda service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:03.235896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f34770-2e3f-444e-ac1b-a5f245119201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:03.237368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f34770-2e3f-444e-ac1b-a5f245119201 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:03.238087 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6663da7a-e9ac-48b8-af08-ea36b9924ff2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:03.238580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f34770-2e3f-444e-ac1b-a5f245119201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:03.239299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f34770-2e3f-444e-ac1b-a5f245119201 admin admin] PATH_INFO: `/v3/projects/33045ca387a84ffbbd2cb9869071e1ea/users/8d8c5596546a4b01a2a794460ec7073e/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:03.272722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f34770-2e3f-444e-ac1b-a5f245119201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33045ca387a84ffbbd2cb9869071e1ea, user_id=8d8c5596546a4b01a2a794460ec7073e, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:03.280572 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f34770-2e3f-444e-ac1b-a5f245119201 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:03.329468 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 962/1898] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:03 2022] PUT /identity/v3/projects/33045ca387a84ffbbd2cb9869071e1ea/users/8d8c5596546a4b01a2a794460ec7073e/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:03.332637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f34770-2e3f-444e-ac1b-a5f245119201 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:03.343292 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d5f34770-2e3f-444e-ac1b-a5f245119201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:03.411990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663da7a-e9ac-48b8-af08-ea36b9924ff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:03.413515 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663da7a-e9ac-48b8-af08-ea36b9924ff2 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:03.439908 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 937/1899] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:03 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:03.442446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dadcbd-fda7-488b-b462-72388fb9f564 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:03.443737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dadcbd-fda7-488b-b462-72388fb9f564 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:03.444148 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dadcbd-fda7-488b-b462-72388fb9f564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:03.479581 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:03.538006 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c1dadcbd-fda7-488b-b462-72388fb9f564 None None] MFA Rules not processed for user `8d8c5596546a4b01a2a794460ec7073e`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:03.540716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c1dadcbd-fda7-488b-b462-72388fb9f564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:03.557949 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f34770-2e3f-444e-ac1b-a5f245119201 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:03.572050 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfd81d-8068-4282-8c97-bdb3638f0029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:03.572804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd81d-8068-4282-8c97-bdb3638f0029 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:03.576396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd81d-8068-4282-8c97-bdb3638f0029 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:03.576778 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd81d-8068-4282-8c97-bdb3638f0029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:03.638622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfd81d-8068-4282-8c97-bdb3638f0029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:03.640800 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfd81d-8068-4282-8c97-bdb3638f0029 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:03.683395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 963/1900] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:03.727566 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 938/1901] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:03.732785 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfd81d-8068-4282-8c97-bdb3638f0029 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:03.944663 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:03.971597 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfd81d-8068-4282-8c97-bdb3638f0029 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:03.984845 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377bf36-2a33-49a2-a54f-b8d09fbf6aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:03.986020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377bf36-2a33-49a2-a54f-b8d09fbf6aea admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:03.986984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377bf36-2a33-49a2-a54f-b8d09fbf6aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:03.987600 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377bf36-2a33-49a2-a54f-b8d09fbf6aea admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:03.988904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377bf36-2a33-49a2-a54f-b8d09fbf6aea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:03.992227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377bf36-2a33-49a2-a54f-b8d09fbf6aea admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:04.061026 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 964/1902] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:03 2022] POST /identity/v3/projects => generated 379 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:04.066484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dadcbd-fda7-488b-b462-72388fb9f564 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:04.090443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dadcbd-fda7-488b-b462-72388fb9f564 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:04.172547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377bf36-2a33-49a2-a54f-b8d09fbf6aea admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:04.174615 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4377bf36-2a33-49a2-a54f-b8d09fbf6aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:04.241031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bdf89-7d2b-4f1a-ab95-964c6777b696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:04.242315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bdf89-7d2b-4f1a-ab95-964c6777b696 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:04.242601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bdf89-7d2b-4f1a-ab95-964c6777b696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:04.242906 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bdf89-7d2b-4f1a-ab95-964c6777b696 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:04.244237 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bdf89-7d2b-4f1a-ab95-964c6777b696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:04.251155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bdf89-7d2b-4f1a-ab95-964c6777b696 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:04.310872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 939/1903] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:04 2022] POST /identity/v3/users => generated 296 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:04.316273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bdf89-7d2b-4f1a-ab95-964c6777b696 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:04.370735 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377bf36-2a33-49a2-a54f-b8d09fbf6aea admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:04.370942 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bdf89-7d2b-4f1a-ab95-964c6777b696 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:04.377967 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:04.379274 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:04.379274 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:04.380061 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8 admin admin] PATH_INFO: `/v3/projects/f7806414fe1f4041baf724351f0398f9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:04.382052 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7806414fe1f4041baf724351f0398f9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:04.384389 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:04.384728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5722c-22d8-4d27-830f-804e0edd0c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:04.385563 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5722c-22d8-4d27-830f-804e0edd0c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:04.386294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5722c-22d8-4d27-830f-804e0edd0c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:04.386570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5722c-22d8-4d27-830f-804e0edd0c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:04.387306 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5722c-22d8-4d27-830f-804e0edd0c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:04.391825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5722c-22d8-4d27-830f-804e0edd0c13 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:04.420931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 940/1904] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:04.425730 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5722c-22d8-4d27-830f-804e0edd0c13 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:04.438369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5722c-22d8-4d27-830f-804e0edd0c13 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:04.447144 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd44ec1-d874-46b6-bc3f-f77581131549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:04.448369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44ec1-d874-46b6-bc3f-f77581131549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:04.448733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44ec1-d874-46b6-bc3f-f77581131549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:04.449008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44ec1-d874-46b6-bc3f-f77581131549 admin admin] PATH_INFO: `/v3/projects/2a6e3b1aeabf4d9d90557ded22939751/users/6beb90351c054df48169b8d887754179/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:04.473284 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd44ec1-d874-46b6-bc3f-f77581131549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a6e3b1aeabf4d9d90557ded22939751, user_id=6beb90351c054df48169b8d887754179, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:04.477169 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd44ec1-d874-46b6-bc3f-f77581131549 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:04.480544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7806414fe1f4041baf724351f0398f9', 'request_id': 'req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:04.497163 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7806414fe1f4041baf724351f0398f9', 'request_id': 'req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:04.497490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 941/1905] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:04 2022] PUT /identity/v3/projects/2a6e3b1aeabf4d9d90557ded22939751/users/6beb90351c054df48169b8d887754179/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:04.501229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd44ec1-d874-46b6-bc3f-f77581131549 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:04.514554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7806414fe1f4041baf724351f0398f9', 'request_id': 'req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:04.532816 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8 admin admin] The token cache is being invalidate because project f7806414fe1f4041baf724351f0398f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:04.533112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:04.534300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:04.538662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 965/1906] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:04 2022] DELETE /identity/v3/projects/f7806414fe1f4041baf724351f0398f9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:04.540149 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:04.541718 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:04.631129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:04.651047 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd44ec1-d874-46b6-bc3f-f77581131549 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:04.658411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d6745-3b0a-4a73-bae5-c3a0d0ee6240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:04.659410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d6745-3b0a-4a73-bae5-c3a0d0ee6240 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:04.659789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d6745-3b0a-4a73-bae5-c3a0d0ee6240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:04.660156 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d6745-3b0a-4a73-bae5-c3a0d0ee6240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:04.661327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d6745-3b0a-4a73-bae5-c3a0d0ee6240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:04.667473 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d6745-3b0a-4a73-bae5-c3a0d0ee6240 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:04.696125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 942/1907] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:04.702827 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d6745-3b0a-4a73-bae5-c3a0d0ee6240 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:04.705384 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-673d6745-3b0a-4a73-bae5-c3a0d0ee6240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:04.710010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7607a1-cc12-4dfd-90d6-a9d1a1ecb0c8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:04.721916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138de83-dafa-4378-a541-56ba34d828dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:04.721916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138de83-dafa-4378-a541-56ba34d828dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:04.721916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138de83-dafa-4378-a541-56ba34d828dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:04.721916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138de83-dafa-4378-a541-56ba34d828dc admin admin] PATH_INFO: `/v3/users/120d20e6d4384d81ad180374e1ddcd54` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:04.722344 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138de83-dafa-4378-a541-56ba34d828dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=120d20e6d4384d81ad180374e1ddcd54)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:04.722344 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138de83-dafa-4378-a541-56ba34d828dc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:04.722497 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d6745-3b0a-4a73-bae5-c3a0d0ee6240 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:04.726211 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:04.731743 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9dcfb-aef3-49e0-a980-860c2329a7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:04.733515 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9dcfb-aef3-49e0-a980-860c2329a7a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:04.733794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9dcfb-aef3-49e0-a980-860c2329a7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:04.734064 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9dcfb-aef3-49e0-a980-860c2329a7a2 admin admin] PATH_INFO: `/v3/projects/2a6e3b1aeabf4d9d90557ded22939751/users/6beb90351c054df48169b8d887754179/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:04.740178 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9dcfb-aef3-49e0-a980-860c2329a7a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a6e3b1aeabf4d9d90557ded22939751, user_id=6beb90351c054df48169b8d887754179, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:04.745251 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9dcfb-aef3-49e0-a980-860c2329a7a2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:04.758891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 943/1908] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:04 2022] PUT /identity/v3/projects/2a6e3b1aeabf4d9d90557ded22939751/users/6beb90351c054df48169b8d887754179/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:04.770846 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea5345-5198-470e-be3f-d014356962cd None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:04.771624 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea5345-5198-470e-be3f-d014356962cd None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:04.772025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea5345-5198-470e-be3f-d014356962cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:04.813024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8138de83-dafa-4378-a541-56ba34d828dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '120d20e6d4384d81ad180374e1ddcd54'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:04.830275 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8138de83-dafa-4378-a541-56ba34d828dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '120d20e6d4384d81ad180374e1ddcd54'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:04.842429 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3fea5345-5198-470e-be3f-d014356962cd None None] MFA Rules not processed for user `6beb90351c054df48169b8d887754179`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:04.843815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3fea5345-5198-470e-be3f-d014356962cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:04.862046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8138de83-dafa-4378-a541-56ba34d828dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '120d20e6d4384d81ad180374e1ddcd54'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:04.865107 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8138de83-dafa-4378-a541-56ba34d828dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '120d20e6d4384d81ad180374e1ddcd54'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:04.888650 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8138de83-dafa-4378-a541-56ba34d828dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '120d20e6d4384d81ad180374e1ddcd54'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:04.902385 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 966/1909] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:04 2022] DELETE /identity/v3/users/120d20e6d4384d81ad180374e1ddcd54 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:04.903293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138de83-dafa-4378-a541-56ba34d828dc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:04.919209 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8138de83-dafa-4378-a541-56ba34d828dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:04.955764 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 944/1910] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:05.022798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138de83-dafa-4378-a541-56ba34d828dc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:05.028610 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1d608-2ee9-42ed-bdaa-8b607f327ad2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:05.029425 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1d608-2ee9-42ed-bdaa-8b607f327ad2 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:05.029751 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1d608-2ee9-42ed-bdaa-8b607f327ad2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:05.030132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1d608-2ee9-42ed-bdaa-8b607f327ad2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:05.037999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bdd1d608-2ee9-42ed-bdaa-8b607f327ad2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:05.112284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1d608-2ee9-42ed-bdaa-8b607f327ad2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:05.113793 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1d608-2ee9-42ed-bdaa-8b607f327ad2 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:05.124603 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 967/1911] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:05.331478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea5345-5198-470e-be3f-d014356962cd None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:05.333473 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3fea5345-5198-470e-be3f-d014356962cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:05.486538 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea5345-5198-470e-be3f-d014356962cd None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:05.580400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5733bf-fd3d-44aa-a7e6-73a5cffe4a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:05.582128 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5733bf-fd3d-44aa-a7e6-73a5cffe4a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:05.582623 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5733bf-fd3d-44aa-a7e6-73a5cffe4a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:05.582962 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5733bf-fd3d-44aa-a7e6-73a5cffe4a83 admin admin] PATH_INFO: `/v3/projects/a24072ced4be4e8196bdc19b643813d1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:05.584692 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5733bf-fd3d-44aa-a7e6-73a5cffe4a83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a24072ced4be4e8196bdc19b643813d1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:05.605615 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5733bf-fd3d-44aa-a7e6-73a5cffe4a83 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:05.642844 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:05.752726 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0e5733bf-fd3d-44aa-a7e6-73a5cffe4a83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24072ced4be4e8196bdc19b643813d1', 'request_id': 'req-0e5733bf-fd3d-44aa-a7e6-73a5cffe4a83'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:05.770723 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0e5733bf-fd3d-44aa-a7e6-73a5cffe4a83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24072ced4be4e8196bdc19b643813d1', 'request_id': 'req-0e5733bf-fd3d-44aa-a7e6-73a5cffe4a83'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:05.790206 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0e5733bf-fd3d-44aa-a7e6-73a5cffe4a83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24072ced4be4e8196bdc19b643813d1', 'request_id': 'req-0e5733bf-fd3d-44aa-a7e6-73a5cffe4a83'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:05.825009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0e5733bf-fd3d-44aa-a7e6-73a5cffe4a83 admin admin] The token cache is being invalidate because project a24072ced4be4e8196bdc19b643813d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:05.825938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0e5733bf-fd3d-44aa-a7e6-73a5cffe4a83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:05.826925 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0e5733bf-fd3d-44aa-a7e6-73a5cffe4a83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:05.830221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 945/1912] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:05 2022] DELETE /identity/v3/projects/a24072ced4be4e8196bdc19b643813d1 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:05.834971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaa373-f7c6-47f6-8234-743d3d49ff06 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:05.841620 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaa373-f7c6-47f6-8234-743d3d49ff06 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:05.841933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaa373-f7c6-47f6-8234-743d3d49ff06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:05.880255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1ebaa373-f7c6-47f6-8234-743d3d49ff06 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:05.881451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1ebaa373-f7c6-47f6-8234-743d3d49ff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:05.950697 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:06.009964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 968/1913] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:06.017992 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a309a-e84a-4f66-bc50-0597cc40e0c8 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:06.018627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a309a-e84a-4f66-bc50-0597cc40e0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:06.019109 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a309a-e84a-4f66-bc50-0597cc40e0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:06.054437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-946a309a-e84a-4f66-bc50-0597cc40e0c8 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:06.056682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-946a309a-e84a-4f66-bc50-0597cc40e0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:06.072608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 946/1914] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:06.074938 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebaa373-f7c6-47f6-8234-743d3d49ff06 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:06.089058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebaa373-f7c6-47f6-8234-743d3d49ff06 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:06.103661 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd21e7-b4a7-4d4e-85f1-630d10bae1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:06.104499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd21e7-b4a7-4d4e-85f1-630d10bae1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:06.104899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd21e7-b4a7-4d4e-85f1-630d10bae1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:06.105330 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd21e7-b4a7-4d4e-85f1-630d10bae1b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:06.106079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd21e7-b4a7-4d4e-85f1-630d10bae1b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:06.106382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd21e7-b4a7-4d4e-85f1-630d10bae1b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:06.108025 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd21e7-b4a7-4d4e-85f1-630d10bae1b2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:06.126892 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 969/1915] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:29:06.128154 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a309a-e84a-4f66-bc50-0597cc40e0c8 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:06.141266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a309a-e84a-4f66-bc50-0597cc40e0c8 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:06.147383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78410ca-5f9d-4093-ad1d-0306a23a85b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:06.148052 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78410ca-5f9d-4093-ad1d-0306a23a85b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:06.148330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78410ca-5f9d-4093-ad1d-0306a23a85b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:06.149290 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78410ca-5f9d-4093-ad1d-0306a23a85b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:06.149422 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78410ca-5f9d-4093-ad1d-0306a23a85b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:06.151583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78410ca-5f9d-4093-ad1d-0306a23a85b4 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:06.181664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 947/1916] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:06 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:06.185426 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd21e7-b4a7-4d4e-85f1-630d10bae1b2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:06.196866 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd21e7-b4a7-4d4e-85f1-630d10bae1b2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:06.261776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943c0fd-e3a2-4c84-950a-2572a379e81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:06.262562 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c0fd-e3a2-4c84-950a-2572a379e81d admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:06.262841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c0fd-e3a2-4c84-950a-2572a379e81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:06.263109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c0fd-e3a2-4c84-950a-2572a379e81d admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:06.263793 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943c0fd-e3a2-4c84-950a-2572a379e81d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:06.265837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943c0fd-e3a2-4c84-950a-2572a379e81d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:06.286602 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 970/1917] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:06 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:29:06.290749 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78410ca-5f9d-4093-ad1d-0306a23a85b4 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:06.301545 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78410ca-5f9d-4093-ad1d-0306a23a85b4 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:06.306047 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb1aca-9667-4055-84cd-83ea9e241016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:06.306707 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb1aca-9667-4055-84cd-83ea9e241016 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:06.306989 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb1aca-9667-4055-84cd-83ea9e241016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:06.307312 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb1aca-9667-4055-84cd-83ea9e241016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:06.308034 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb1aca-9667-4055-84cd-83ea9e241016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:06.309758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb1aca-9667-4055-84cd-83ea9e241016 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:06.320277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 948/1918] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:06.324252 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943c0fd-e3a2-4c84-950a-2572a379e81d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:06.335449 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943c0fd-e3a2-4c84-950a-2572a379e81d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:06.340857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73453b1a-20e2-465b-957c-337e64a8d464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:06.341541 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73453b1a-20e2-465b-957c-337e64a8d464 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:06.341824 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73453b1a-20e2-465b-957c-337e64a8d464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:06.342097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73453b1a-20e2-465b-957c-337e64a8d464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:06.342842 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73453b1a-20e2-465b-957c-337e64a8d464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:06.344506 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73453b1a-20e2-465b-957c-337e64a8d464 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:06.355704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 971/1919] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:06.360023 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb1aca-9667-4055-84cd-83ea9e241016 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:06.371090 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb1aca-9667-4055-84cd-83ea9e241016 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:06.376250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92638d-48ec-4be3-bc5c-ffb353669721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:06.377270 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92638d-48ec-4be3-bc5c-ffb353669721 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:06.377549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92638d-48ec-4be3-bc5c-ffb353669721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:06.377920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92638d-48ec-4be3-bc5c-ffb353669721 admin admin] PATH_INFO: `/v3/projects/64d732a171c24db5881488cda0f95b29/users/fd488305d28c4477b2a14ccfd3ccaeb7/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:06.395012 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92638d-48ec-4be3-bc5c-ffb353669721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d732a171c24db5881488cda0f95b29, user_id=fd488305d28c4477b2a14ccfd3ccaeb7, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:06.397735 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92638d-48ec-4be3-bc5c-ffb353669721 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:06.412934 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 949/1920] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:06 2022] PUT /identity/v3/projects/64d732a171c24db5881488cda0f95b29/users/fd488305d28c4477b2a14ccfd3ccaeb7/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:06.425300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac427ab4-c26f-48c4-a83a-e0be8a4d225c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:06.425798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac427ab4-c26f-48c4-a83a-e0be8a4d225c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:06.426192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac427ab4-c26f-48c4-a83a-e0be8a4d225c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:06.458563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ac427ab4-c26f-48c4-a83a-e0be8a4d225c None None] MFA Rules not processed for user `fd488305d28c4477b2a14ccfd3ccaeb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:06.459835 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ac427ab4-c26f-48c4-a83a-e0be8a4d225c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:06.540359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 972/1921] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:06.545027 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92638d-48ec-4be3-bc5c-ffb353669721 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:06.611411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92638d-48ec-4be3-bc5c-ffb353669721 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:06.616155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ad0af-b008-46c1-b26e-65ed35b2cee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:06.616846 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ad0af-b008-46c1-b26e-65ed35b2cee4 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:06.617125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ad0af-b008-46c1-b26e-65ed35b2cee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:06.617398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ad0af-b008-46c1-b26e-65ed35b2cee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:06.618091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ad0af-b008-46c1-b26e-65ed35b2cee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:06.619978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ad0af-b008-46c1-b26e-65ed35b2cee4 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:06.652630 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 950/1922] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:06 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:06.656961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac427ab4-c26f-48c4-a83a-e0be8a4d225c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:06.668217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac427ab4-c26f-48c4-a83a-e0be8a4d225c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:06.699565 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:06.731472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293e1a0-45e1-4301-a436-983a02c0c51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:06.732281 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293e1a0-45e1-4301-a436-983a02c0c51b admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:06.732576 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293e1a0-45e1-4301-a436-983a02c0c51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:06.732856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293e1a0-45e1-4301-a436-983a02c0c51b admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:06.733588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293e1a0-45e1-4301-a436-983a02c0c51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:06.735699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293e1a0-45e1-4301-a436-983a02c0c51b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:06.757914 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 973/1923] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:06 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:06.762080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ad0af-b008-46c1-b26e-65ed35b2cee4 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:06.773390 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ad0af-b008-46c1-b26e-65ed35b2cee4 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:06.778604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a11cc-98dc-4c10-81e1-ddce8332ded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:06.779347 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a11cc-98dc-4c10-81e1-ddce8332ded6 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:06.779725 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a11cc-98dc-4c10-81e1-ddce8332ded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:06.780140 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a11cc-98dc-4c10-81e1-ddce8332ded6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:06.780949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a11cc-98dc-4c10-81e1-ddce8332ded6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:06.782611 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a11cc-98dc-4c10-81e1-ddce8332ded6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:06.801291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 951/1924] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:06.802761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293e1a0-45e1-4301-a436-983a02c0c51b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:06.817457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293e1a0-45e1-4301-a436-983a02c0c51b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:06.822661 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaa1f4-41a6-40ab-8d16-7bfedce1591a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:06.823602 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaa1f4-41a6-40ab-8d16-7bfedce1591a admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:06.823879 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaa1f4-41a6-40ab-8d16-7bfedce1591a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:06.824664 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaa1f4-41a6-40ab-8d16-7bfedce1591a admin admin] PATH_INFO: `/v3/projects/773b3f289d814587833a89460344a582/users/3911135c0e634b0da66812cfda6aa065/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:06.843029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaa1f4-41a6-40ab-8d16-7bfedce1591a admin admin] RBAC: Authorizing `identity:create_grant(project_id=773b3f289d814587833a89460344a582, user_id=3911135c0e634b0da66812cfda6aa065, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:06.847002 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaa1f4-41a6-40ab-8d16-7bfedce1591a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:06.864899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 974/1925] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:06 2022] PUT /identity/v3/projects/773b3f289d814587833a89460344a582/users/3911135c0e634b0da66812cfda6aa065/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:06.868627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a11cc-98dc-4c10-81e1-ddce8332ded6 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:06.882697 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a11cc-98dc-4c10-81e1-ddce8332ded6 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:06.886842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:06.949447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f4185-7809-482a-8c64-72cbbe9276a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:06.949620 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f4185-7809-482a-8c64-72cbbe9276a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:06.949901 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f4185-7809-482a-8c64-72cbbe9276a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:06.950171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f4185-7809-482a-8c64-72cbbe9276a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:06.951273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f4185-7809-482a-8c64-72cbbe9276a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:06.952842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f4185-7809-482a-8c64-72cbbe9276a9 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:06.964326 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 952/1926] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:29:06.969219 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaa1f4-41a6-40ab-8d16-7bfedce1591a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:06.982234 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaa1f4-41a6-40ab-8d16-7bfedce1591a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:06.990047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5b571-a96b-4a2c-a6cc-66726d5ac232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:06.990945 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5b571-a96b-4a2c-a6cc-66726d5ac232 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:06.991310 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5b571-a96b-4a2c-a6cc-66726d5ac232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:06.991480 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5b571-a96b-4a2c-a6cc-66726d5ac232 admin admin] PATH_INFO: `/v3/projects/773b3f289d814587833a89460344a582/users/3911135c0e634b0da66812cfda6aa065/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:07.000987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5b571-a96b-4a2c-a6cc-66726d5ac232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=773b3f289d814587833a89460344a582, user_id=3911135c0e634b0da66812cfda6aa065, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:07.003760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5b571-a96b-4a2c-a6cc-66726d5ac232 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:07.014478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 975/1927] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:06 2022] PUT /identity/v3/projects/773b3f289d814587833a89460344a582/users/3911135c0e634b0da66812cfda6aa065/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:07.025614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192fef0-2c7b-4a35-9862-5f005b6a3944 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:07.025904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192fef0-2c7b-4a35-9862-5f005b6a3944 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:07.026183 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192fef0-2c7b-4a35-9862-5f005b6a3944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:07.053488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e192fef0-2c7b-4a35-9862-5f005b6a3944 None None] MFA Rules not processed for user `3911135c0e634b0da66812cfda6aa065`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:07.054775 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e192fef0-2c7b-4a35-9862-5f005b6a3944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:07.125905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 953/1928] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:07.139311 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5b571-a96b-4a2c-a6cc-66726d5ac232 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:07.141095 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1ec5b571-a96b-4a2c-a6cc-66726d5ac232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:07.200421 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5b571-a96b-4a2c-a6cc-66726d5ac232 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:07.204352 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424de277-175e-4972-a5ed-15a6921636f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:07.205115 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424de277-175e-4972-a5ed-15a6921636f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:07.205401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424de277-175e-4972-a5ed-15a6921636f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:07.205658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424de277-175e-4972-a5ed-15a6921636f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:07.215485 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424de277-175e-4972-a5ed-15a6921636f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:07.216997 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424de277-175e-4972-a5ed-15a6921636f6 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:07.226854 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 976/1929] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:07.329383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192fef0-2c7b-4a35-9862-5f005b6a3944 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:07.340647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192fef0-2c7b-4a35-9862-5f005b6a3944 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:07.346268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d732e3-1ebb-4495-ad7e-dcc8ad32fdd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:07.347135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d732e3-1ebb-4495-ad7e-dcc8ad32fdd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:07.347551 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d732e3-1ebb-4495-ad7e-dcc8ad32fdd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:07.347825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d732e3-1ebb-4495-ad7e-dcc8ad32fdd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:07.427262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d732e3-1ebb-4495-ad7e-dcc8ad32fdd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:07.429436 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d732e3-1ebb-4495-ad7e-dcc8ad32fdd7 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:07.442204 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 954/1930] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:07.756766 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424de277-175e-4972-a5ed-15a6921636f6 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:07.758271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-424de277-175e-4972-a5ed-15a6921636f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:07.915557 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424de277-175e-4972-a5ed-15a6921636f6 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:07.925016 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee561e-3be2-4b99-a6b1-fa8043102e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:07.926509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee561e-3be2-4b99-a6b1-fa8043102e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:07.926846 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee561e-3be2-4b99-a6b1-fa8043102e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:07.927194 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee561e-3be2-4b99-a6b1-fa8043102e00 admin admin] PATH_INFO: `/v3/users/7fec7f0fa06941c3b97e17e4c3621b2f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:07.928570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee561e-3be2-4b99-a6b1-fa8043102e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fec7f0fa06941c3b97e17e4c3621b2f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:07.930644 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee561e-3be2-4b99-a6b1-fa8043102e00 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:07.959216 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d732e3-1ebb-4495-ad7e-dcc8ad32fdd7 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:07.960857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-34d732e3-1ebb-4495-ad7e-dcc8ad32fdd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:07.976308 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:07.983008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d732e3-1ebb-4495-ad7e-dcc8ad32fdd7 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:07.988985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e5fa8-0d84-4cdf-9ff7-abb4e171a405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:07.989873 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e5fa8-0d84-4cdf-9ff7-abb4e171a405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:07.990150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e5fa8-0d84-4cdf-9ff7-abb4e171a405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:07.990421 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e5fa8-0d84-4cdf-9ff7-abb4e171a405 admin admin] PATH_INFO: `/v3/users/9ee1def0a19c4ff18f17de7bd13dbea6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:07.991607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e5fa8-0d84-4cdf-9ff7-abb4e171a405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ee1def0a19c4ff18f17de7bd13dbea6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:07.993760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e5fa8-0d84-4cdf-9ff7-abb4e171a405 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:07.995687 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-37ee561e-3be2-4b99-a6b1-fa8043102e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fec7f0fa06941c3b97e17e4c3621b2f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:08.007945 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-37ee561e-3be2-4b99-a6b1-fa8043102e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fec7f0fa06941c3b97e17e4c3621b2f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:08.018515 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-37ee561e-3be2-4b99-a6b1-fa8043102e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fec7f0fa06941c3b97e17e4c3621b2f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:08.019861 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-37ee561e-3be2-4b99-a6b1-fa8043102e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fec7f0fa06941c3b97e17e4c3621b2f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:08.035530 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:08.036743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-37ee561e-3be2-4b99-a6b1-fa8043102e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fec7f0fa06941c3b97e17e4c3621b2f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:08.071855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 977/1931] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:07 2022] DELETE /identity/v3/users/7fec7f0fa06941c3b97e17e4c3621b2f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:08.071855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee561e-3be2-4b99-a6b1-fa8043102e00 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:08.073003 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-37ee561e-3be2-4b99-a6b1-fa8043102e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:08.127787 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f24e5fa8-0d84-4cdf-9ff7-abb4e171a405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ee1def0a19c4ff18f17de7bd13dbea6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:08.144490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f24e5fa8-0d84-4cdf-9ff7-abb4e171a405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ee1def0a19c4ff18f17de7bd13dbea6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:08.197599 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee561e-3be2-4b99-a6b1-fa8043102e00 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:08.202098 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f24e5fa8-0d84-4cdf-9ff7-abb4e171a405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ee1def0a19c4ff18f17de7bd13dbea6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:08.203045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f24e5fa8-0d84-4cdf-9ff7-abb4e171a405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ee1def0a19c4ff18f17de7bd13dbea6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:08.208203 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1926a-2317-47b3-a706-ae7dc60af877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:08.212535 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1926a-2317-47b3-a706-ae7dc60af877 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:08.212830 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1926a-2317-47b3-a706-ae7dc60af877 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:08.213100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1926a-2317-47b3-a706-ae7dc60af877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:08.219340 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f24e5fa8-0d84-4cdf-9ff7-abb4e171a405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ee1def0a19c4ff18f17de7bd13dbea6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:08.220783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8bb1926a-2317-47b3-a706-ae7dc60af877 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:08.242466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 955/1932] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:07 2022] DELETE /identity/v3/users/9ee1def0a19c4ff18f17de7bd13dbea6 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:08.248782 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1b548-e371-4913-95af-dd0e6051581f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:08.249084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1b548-e371-4913-95af-dd0e6051581f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:08.249337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1b548-e371-4913-95af-dd0e6051581f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:08.276673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-bcf1b548-e371-4913-95af-dd0e6051581f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:08.278340 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bcf1b548-e371-4913-95af-dd0e6051581f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:08.384253 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1926a-2317-47b3-a706-ae7dc60af877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:08.388092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1926a-2317-47b3-a706-ae7dc60af877 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:08.392767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 956/1933] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:08.397887 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef117d4-bd70-48ce-b5d2-98f2800b3b2a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:08.398179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef117d4-bd70-48ce-b5d2-98f2800b3b2a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:08.398487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef117d4-bd70-48ce-b5d2-98f2800b3b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:08.423358 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-eef117d4-bd70-48ce-b5d2-98f2800b3b2a None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:08.424812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-eef117d4-bd70-48ce-b5d2-98f2800b3b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:08.429149 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 978/1934] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:08.435882 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 957/1935] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:08.477382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1926a-2317-47b3-a706-ae7dc60af877 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:08.478444 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef117d4-bd70-48ce-b5d2-98f2800b3b2a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:08.479883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-eef117d4-bd70-48ce-b5d2-98f2800b3b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:08.482351 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8bb1926a-2317-47b3-a706-ae7dc60af877 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:08.584906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1926a-2317-47b3-a706-ae7dc60af877 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:08.611808 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef117d4-bd70-48ce-b5d2-98f2800b3b2a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:08.614082 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:08.622659 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a166331-4a89-43c5-b7c0-e6cd5d2375b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:08.623516 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a166331-4a89-43c5-b7c0-e6cd5d2375b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:08.623794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a166331-4a89-43c5-b7c0-e6cd5d2375b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:08.624054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a166331-4a89-43c5-b7c0-e6cd5d2375b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:08.638979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a166331-4a89-43c5-b7c0-e6cd5d2375b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:08.642901 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a166331-4a89-43c5-b7c0-e6cd5d2375b4 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:08.656151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 958/1936] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:08.721502 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb5fe5-18eb-43f3-9f6d-61e92074e94a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:08.724554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb5fe5-18eb-43f3-9f6d-61e92074e94a service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:08.724702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb5fe5-18eb-43f3-9f6d-61e92074e94a service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:08.724887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb5fe5-18eb-43f3-9f6d-61e92074e94a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:08.752667 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb5fe5-18eb-43f3-9f6d-61e92074e94a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:08.755208 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb5fe5-18eb-43f3-9f6d-61e92074e94a service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:08.772286 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 979/1937] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:08.984310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a166331-4a89-43c5-b7c0-e6cd5d2375b4 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:09.044640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:09.077258 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a166331-4a89-43c5-b7c0-e6cd5d2375b4 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:09.083846 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9dc60-bf44-4baa-b912-542570095168 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6beb90351c054df48169b8d887754179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a6e3b1aeabf4d9d90557ded22939751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:09.085043 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9dc60-bf44-4baa-b912-542570095168 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:09.085535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9dc60-bf44-4baa-b912-542570095168 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:09.086207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9dc60-bf44-4baa-b912-542570095168 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:09.087300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9dc60-bf44-4baa-b912-542570095168 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:09.087815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9dc60-bf44-4baa-b912-542570095168 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:09.089731 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9dc60-bf44-4baa-b912-542570095168 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:09.108256 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 959/1938] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:29:09.112269 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb5fe5-18eb-43f3-9f6d-61e92074e94a service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:09.125020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb5fe5-18eb-43f3-9f6d-61e92074e94a service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:09.131291 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc01f8c-7cfa-4435-80c0-0b7d948205fe tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6beb90351c054df48169b8d887754179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a6e3b1aeabf4d9d90557ded22939751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:09.132278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc01f8c-7cfa-4435-80c0-0b7d948205fe tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:09.132957 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc01f8c-7cfa-4435-80c0-0b7d948205fe tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:09.133728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc01f8c-7cfa-4435-80c0-0b7d948205fe tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:09.134658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc01f8c-7cfa-4435-80c0-0b7d948205fe tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:09.149345 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc01f8c-7cfa-4435-80c0-0b7d948205fe tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:09.206330 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 980/1939] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:09 2022] POST /identity/v3/projects => generated 353 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:09.206589 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9dc60-bf44-4baa-b912-542570095168 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:09.217521 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9dc60-bf44-4baa-b912-542570095168 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:09.290178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc01f8c-7cfa-4435-80c0-0b7d948205fe tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:09.293001 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8dc01f8c-7cfa-4435-80c0-0b7d948205fe tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:09.321607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe16db3-f276-41bd-8bb9-2b6484ff3c41 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6beb90351c054df48169b8d887754179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a6e3b1aeabf4d9d90557ded22939751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:09.322291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe16db3-f276-41bd-8bb9-2b6484ff3c41 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:09.322598 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe16db3-f276-41bd-8bb9-2b6484ff3c41 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:09.322888 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe16db3-f276-41bd-8bb9-2b6484ff3c41 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:09.323599 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe16db3-f276-41bd-8bb9-2b6484ff3c41 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:09.324012 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe16db3-f276-41bd-8bb9-2b6484ff3c41 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:09.326115 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe16db3-f276-41bd-8bb9-2b6484ff3c41 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:09.342474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 960/1940] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:29:09.371833 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe16db3-f276-41bd-8bb9-2b6484ff3c41 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:09.373933 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cbe16db3-f276-41bd-8bb9-2b6484ff3c41 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:09.407289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc01f8c-7cfa-4435-80c0-0b7d948205fe tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:09.413412 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe1539-8a0c-4687-9493-b76423c3bd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:09.414380 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe1539-8a0c-4687-9493-b76423c3bd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:09.414793 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe1539-8a0c-4687-9493-b76423c3bd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:09.415069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe1539-8a0c-4687-9493-b76423c3bd0f admin admin] PATH_INFO: `/v3/projects/85ea4e24c0eb4948830c85cd19468e2e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:09.417572 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe1539-8a0c-4687-9493-b76423c3bd0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ea4e24c0eb4948830c85cd19468e2e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:09.420600 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe1539-8a0c-4687-9493-b76423c3bd0f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:09.466266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe16db3-f276-41bd-8bb9-2b6484ff3c41 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:09.486779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-48fe1539-8a0c-4687-9493-b76423c3bd0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ea4e24c0eb4948830c85cd19468e2e', 'request_id': 'req-48fe1539-8a0c-4687-9493-b76423c3bd0f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.498373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-48fe1539-8a0c-4687-9493-b76423c3bd0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ea4e24c0eb4948830c85cd19468e2e', 'request_id': 'req-48fe1539-8a0c-4687-9493-b76423c3bd0f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.506200 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-48fe1539-8a0c-4687-9493-b76423c3bd0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ea4e24c0eb4948830c85cd19468e2e', 'request_id': 'req-48fe1539-8a0c-4687-9493-b76423c3bd0f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.519589 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-48fe1539-8a0c-4687-9493-b76423c3bd0f admin admin] The token cache is being invalidate because project 85ea4e24c0eb4948830c85cd19468e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:09.520068 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-48fe1539-8a0c-4687-9493-b76423c3bd0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.520906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-48fe1539-8a0c-4687-9493-b76423c3bd0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.523032 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 981/1941] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:09 2022] DELETE /identity/v3/projects/85ea4e24c0eb4948830c85cd19468e2e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:09.524156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe1539-8a0c-4687-9493-b76423c3bd0f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:09.525635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-48fe1539-8a0c-4687-9493-b76423c3bd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:09.546600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:09.547475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:09.547758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:09.548030 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b admin admin] PATH_INFO: `/v3/projects/7cfc6649121246f5b1ab40a1cbc9506a` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:09.551590 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cfc6649121246f5b1ab40a1cbc9506a)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:09.553577 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:09.558420 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:09.568011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:09.603428 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe1539-8a0c-4687-9493-b76423c3bd0f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:09.611575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cfc6649121246f5b1ab40a1cbc9506a', 'request_id': 'req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.621486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cfc6649121246f5b1ab40a1cbc9506a', 'request_id': 'req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.635355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cfc6649121246f5b1ab40a1cbc9506a', 'request_id': 'req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.649561 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b admin admin] The token cache is being invalidate because project 7cfc6649121246f5b1ab40a1cbc9506a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:09.649961 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.650885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.656438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 961/1942] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:09 2022] DELETE /identity/v3/projects/7cfc6649121246f5b1ab40a1cbc9506a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:09.657453 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:09.659988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:09.689617 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6beb90351c054df48169b8d887754179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a6e3b1aeabf4d9d90557ded22939751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:09.690646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:09.690928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:09.691209 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] PATH_INFO: `/v3/projects/0656cdb83f0449da91829cdd381f1643` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:09.692507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0656cdb83f0449da91829cdd381f1643)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:09.695128 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:09.745110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ef9cb-8b84-4c11-84f4-08ee5f9c883b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:09.760491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0656cdb83f0449da91829cdd381f1643', 'request_id': 'req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.772955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0656cdb83f0449da91829cdd381f1643', 'request_id': 'req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.779190 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0656cdb83f0449da91829cdd381f1643', 'request_id': 'req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.791006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] The token cache is being invalidate because project 0656cdb83f0449da91829cdd381f1643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:09.791373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.792094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.796964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 982/1943] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:09 2022] DELETE /identity/v3/projects/0656cdb83f0449da91829cdd381f1643 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:09.796964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:09.797779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:09.819700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2704f-89b0-4230-bf4d-d63553cfefaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:09.820828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2704f-89b0-4230-bf4d-d63553cfefaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:09.821311 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2704f-89b0-4230-bf4d-d63553cfefaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:09.821589 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2704f-89b0-4230-bf4d-d63553cfefaf admin admin] PATH_INFO: `/v3/users/ddacf7e807404907bea3395eb8d31f48` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:09.822823 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2704f-89b0-4230-bf4d-d63553cfefaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddacf7e807404907bea3395eb8d31f48)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:09.824842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2704f-89b0-4230-bf4d-d63553cfefaf admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:09.890620 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1dc7f4-c1d3-4922-8bd0-b54c36c26e04 tempest-VolumeQuotaClassesTest-509831330 tempest-VolumeQuotaClassesTest-509831330-project-admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:09.893178 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-08a2704f-89b0-4230-bf4d-d63553cfefaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddacf7e807404907bea3395eb8d31f48'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.896239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:09.905353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-08a2704f-89b0-4230-bf4d-d63553cfefaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddacf7e807404907bea3395eb8d31f48'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.913088 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442a5c3-5a0c-4b29-be6c-928ea5073394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:09.915291 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442a5c3-5a0c-4b29-be6c-928ea5073394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:09.916223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442a5c3-5a0c-4b29-be6c-928ea5073394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:09.916956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442a5c3-5a0c-4b29-be6c-928ea5073394 admin admin] PATH_INFO: `/v3/users/ad0b044212ef48f59f279dfc86fe3edf` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:09.918646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442a5c3-5a0c-4b29-be6c-928ea5073394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad0b044212ef48f59f279dfc86fe3edf)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:09.921278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442a5c3-5a0c-4b29-be6c-928ea5073394 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:09.925298 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:09.928255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-08a2704f-89b0-4230-bf4d-d63553cfefaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddacf7e807404907bea3395eb8d31f48'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.929240 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-08a2704f-89b0-4230-bf4d-d63553cfefaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddacf7e807404907bea3395eb8d31f48'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.963416 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-08a2704f-89b0-4230-bf4d-d63553cfefaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddacf7e807404907bea3395eb8d31f48'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:09.981028 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 962/1944] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:09 2022] DELETE /identity/v3/users/ddacf7e807404907bea3395eb8d31f48 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:10.018300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f442a5c3-5a0c-4b29-be6c-928ea5073394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad0b044212ef48f59f279dfc86fe3edf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:10.060003 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f442a5c3-5a0c-4b29-be6c-928ea5073394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad0b044212ef48f59f279dfc86fe3edf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:10.072062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f442a5c3-5a0c-4b29-be6c-928ea5073394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad0b044212ef48f59f279dfc86fe3edf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:10.073308 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f442a5c3-5a0c-4b29-be6c-928ea5073394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad0b044212ef48f59f279dfc86fe3edf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:10.097913 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f442a5c3-5a0c-4b29-be6c-928ea5073394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad0b044212ef48f59f279dfc86fe3edf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:10.109425 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 983/1945] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:09 2022] DELETE /identity/v3/users/ad0b044212ef48f59f279dfc86fe3edf => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:10.218068 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2704f-89b0-4230-bf4d-d63553cfefaf admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:10.219909 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-08a2704f-89b0-4230-bf4d-d63553cfefaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:10.353296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2704f-89b0-4230-bf4d-d63553cfefaf admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:10.461044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f4571-6032-4e00-9c2f-80d9ce9a90b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:10.462242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f4571-6032-4e00-9c2f-80d9ce9a90b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:10.462652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f4571-6032-4e00-9c2f-80d9ce9a90b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:10.464038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f4571-6032-4e00-9c2f-80d9ce9a90b0 admin admin] PATH_INFO: `/v3/users/8d8c5596546a4b01a2a794460ec7073e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:10.466121 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f4571-6032-4e00-9c2f-80d9ce9a90b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d8c5596546a4b01a2a794460ec7073e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:10.473618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f4571-6032-4e00-9c2f-80d9ce9a90b0 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:10.539195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-194f4571-6032-4e00-9c2f-80d9ce9a90b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d8c5596546a4b01a2a794460ec7073e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:10.556038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-194f4571-6032-4e00-9c2f-80d9ce9a90b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d8c5596546a4b01a2a794460ec7073e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:10.576124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-194f4571-6032-4e00-9c2f-80d9ce9a90b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d8c5596546a4b01a2a794460ec7073e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:10.577510 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-194f4571-6032-4e00-9c2f-80d9ce9a90b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d8c5596546a4b01a2a794460ec7073e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:10.585243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:10.595108 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-194f4571-6032-4e00-9c2f-80d9ce9a90b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d8c5596546a4b01a2a794460ec7073e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:10.616500 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 963/1946] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:10 2022] DELETE /identity/v3/users/8d8c5596546a4b01a2a794460ec7073e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:10.622494 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d968a-c7ae-41ed-8b21-24b1b3d4e3a8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:10.623865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d968a-c7ae-41ed-8b21-24b1b3d4e3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:10.624373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d968a-c7ae-41ed-8b21-24b1b3d4e3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:10.686462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d21d968a-c7ae-41ed-8b21-24b1b3d4e3a8 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:10.687810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d21d968a-c7ae-41ed-8b21-24b1b3d4e3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:10.693725 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f4571-6032-4e00-9c2f-80d9ce9a90b0 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:10.695116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-194f4571-6032-4e00-9c2f-80d9ce9a90b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:10.881407 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 984/1947] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:10.882553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d968a-c7ae-41ed-8b21-24b1b3d4e3a8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:10.885163 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d21d968a-c7ae-41ed-8b21-24b1b3d4e3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:10.894071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f4571-6032-4e00-9c2f-80d9ce9a90b0 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:10.909835 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf13ff3-eac2-4f92-a586-901bf1175fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:10.912229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf13ff3-eac2-4f92-a586-901bf1175fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:10.912497 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf13ff3-eac2-4f92-a586-901bf1175fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:10.912801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf13ff3-eac2-4f92-a586-901bf1175fa7 admin admin] PATH_INFO: `/v3/projects/a70d87f07d7c4ef6b3400ef7c26d5f93` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:10.915346 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d968a-c7ae-41ed-8b21-24b1b3d4e3a8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:10.918571 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf13ff3-eac2-4f92-a586-901bf1175fa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a70d87f07d7c4ef6b3400ef7c26d5f93)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:10.926262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf13ff3-eac2-4f92-a586-901bf1175fa7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:10.930668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44272011-779b-4473-9cde-d800d50b6668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:10.931564 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44272011-779b-4473-9cde-d800d50b6668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:10.931840 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44272011-779b-4473-9cde-d800d50b6668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:10.932115 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44272011-779b-4473-9cde-d800d50b6668 admin admin] PATH_INFO: `/v3/projects/ad96e898e07e4d7583c6634123710f83` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:10.936883 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44272011-779b-4473-9cde-d800d50b6668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad96e898e07e4d7583c6634123710f83)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:10.940817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44272011-779b-4473-9cde-d800d50b6668 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:11.052123 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-faf13ff3-eac2-4f92-a586-901bf1175fa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a70d87f07d7c4ef6b3400ef7c26d5f93', 'request_id': 'req-faf13ff3-eac2-4f92-a586-901bf1175fa7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:11.069767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-faf13ff3-eac2-4f92-a586-901bf1175fa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a70d87f07d7c4ef6b3400ef7c26d5f93', 'request_id': 'req-faf13ff3-eac2-4f92-a586-901bf1175fa7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:11.074457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-44272011-779b-4473-9cde-d800d50b6668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad96e898e07e4d7583c6634123710f83', 'request_id': 'req-44272011-779b-4473-9cde-d800d50b6668'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:11.086320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-faf13ff3-eac2-4f92-a586-901bf1175fa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a70d87f07d7c4ef6b3400ef7c26d5f93', 'request_id': 'req-faf13ff3-eac2-4f92-a586-901bf1175fa7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:11.089544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-44272011-779b-4473-9cde-d800d50b6668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad96e898e07e4d7583c6634123710f83', 'request_id': 'req-44272011-779b-4473-9cde-d800d50b6668'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:11.103952 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-44272011-779b-4473-9cde-d800d50b6668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad96e898e07e4d7583c6634123710f83', 'request_id': 'req-44272011-779b-4473-9cde-d800d50b6668'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:11.115260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-faf13ff3-eac2-4f92-a586-901bf1175fa7 admin admin] The token cache is being invalidate because project a70d87f07d7c4ef6b3400ef7c26d5f93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:11.115586 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-faf13ff3-eac2-4f92-a586-901bf1175fa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:11.119070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-faf13ff3-eac2-4f92-a586-901bf1175fa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:11.124766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 964/1948] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:10 2022] DELETE /identity/v3/projects/a70d87f07d7c4ef6b3400ef7c26d5f93 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:11.124766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf13ff3-eac2-4f92-a586-901bf1175fa7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:11.124766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-faf13ff3-eac2-4f92-a586-901bf1175fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:11.177690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-44272011-779b-4473-9cde-d800d50b6668 admin admin] The token cache is being invalidate because project ad96e898e07e4d7583c6634123710f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:11.178457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-44272011-779b-4473-9cde-d800d50b6668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:11.180133 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-44272011-779b-4473-9cde-d800d50b6668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:11.184594 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 985/1949] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:10 2022] DELETE /identity/v3/projects/ad96e898e07e4d7583c6634123710f83 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:11.187288 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44272011-779b-4473-9cde-d800d50b6668 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:11.191899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-44272011-779b-4473-9cde-d800d50b6668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:11.210467 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:11.298140 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf13ff3-eac2-4f92-a586-901bf1175fa7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:11.368725 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:11.383047 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e64f8b-eb27-414e-ac3b-cd439862a957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:11.384291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e64f8b-eb27-414e-ac3b-cd439862a957 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:11.384291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e64f8b-eb27-414e-ac3b-cd439862a957 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:11.385019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e64f8b-eb27-414e-ac3b-cd439862a957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:11.388054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-41e64f8b-eb27-414e-ac3b-cd439862a957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:11.398048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44272011-779b-4473-9cde-d800d50b6668 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:11.410665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c66a42-cf17-470b-89e2-4c479c24850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:11.411657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c66a42-cf17-470b-89e2-4c479c24850a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:11.411940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c66a42-cf17-470b-89e2-4c479c24850a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:11.412218 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c66a42-cf17-470b-89e2-4c479c24850a admin admin] PATH_INFO: `/v3/users/b5607fd2f94d4bb3b8d2c1384cad6f3e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:11.413597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e64f8b-eb27-414e-ac3b-cd439862a957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:11.415213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c66a42-cf17-470b-89e2-4c479c24850a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5607fd2f94d4bb3b8d2c1384cad6f3e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:11.417211 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c66a42-cf17-470b-89e2-4c479c24850a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:11.423839 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e64f8b-eb27-414e-ac3b-cd439862a957 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:11.442722 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 965/1950] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:11.444071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c501b17-1ae0-4fd8-85ed-3a04c2db418f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:11.446537 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c501b17-1ae0-4fd8-85ed-3a04c2db418f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:11.446739 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c501b17-1ae0-4fd8-85ed-3a04c2db418f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:11.490114 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9c501b17-1ae0-4fd8-85ed-3a04c2db418f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:11.492878 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9c501b17-1ae0-4fd8-85ed-3a04c2db418f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:11.521299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 966/1951] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:11.528318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab912a7-b56a-4dbf-8a05-b15163d5b13d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:11.529502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab912a7-b56a-4dbf-8a05-b15163d5b13d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:11.530931 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-56c66a42-cf17-470b-89e2-4c479c24850a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5607fd2f94d4bb3b8d2c1384cad6f3e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:11.534219 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab912a7-b56a-4dbf-8a05-b15163d5b13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:11.573113 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-56c66a42-cf17-470b-89e2-4c479c24850a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5607fd2f94d4bb3b8d2c1384cad6f3e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:11.589332 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-8ab912a7-b56a-4dbf-8a05-b15163d5b13d None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:11.590057 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-56c66a42-cf17-470b-89e2-4c479c24850a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5607fd2f94d4bb3b8d2c1384cad6f3e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:11.591360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-56c66a42-cf17-470b-89e2-4c479c24850a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5607fd2f94d4bb3b8d2c1384cad6f3e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:11.600874 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8ab912a7-b56a-4dbf-8a05-b15163d5b13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:11.635797 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-56c66a42-cf17-470b-89e2-4c479c24850a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5607fd2f94d4bb3b8d2c1384cad6f3e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:11.639575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 967/1952] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:29:11.640548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab912a7-b56a-4dbf-8a05-b15163d5b13d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:11.647740 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 986/1953] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:11 2022] DELETE /identity/v3/users/b5607fd2f94d4bb3b8d2c1384cad6f3e => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:11.663625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab912a7-b56a-4dbf-8a05-b15163d5b13d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:11.783956 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f1316-bc40-485f-b6ee-2a033aa2f121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:11.784718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f1316-bc40-485f-b6ee-2a033aa2f121 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:11.785125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f1316-bc40-485f-b6ee-2a033aa2f121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:11.785406 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f1316-bc40-485f-b6ee-2a033aa2f121 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:11.786752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f1316-bc40-485f-b6ee-2a033aa2f121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:11.786752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f1316-bc40-485f-b6ee-2a033aa2f121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:11.788443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f1316-bc40-485f-b6ee-2a033aa2f121 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:11.828696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 968/1954] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:29:11.833318 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c66a42-cf17-470b-89e2-4c479c24850a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:11.851685 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c66a42-cf17-470b-89e2-4c479c24850a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:11.868244 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793ca4f-d541-450c-afee-33bd2c4bd258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:11.869000 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793ca4f-d541-450c-afee-33bd2c4bd258 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:11.869289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793ca4f-d541-450c-afee-33bd2c4bd258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:11.869566 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793ca4f-d541-450c-afee-33bd2c4bd258 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:11.870878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793ca4f-d541-450c-afee-33bd2c4bd258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:11.873082 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793ca4f-d541-450c-afee-33bd2c4bd258 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:11.933910 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 987/1955] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:11 2022] POST /identity/v3/projects => generated 407 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:11.935347 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f1316-bc40-485f-b6ee-2a033aa2f121 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:11.945888 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f1316-bc40-485f-b6ee-2a033aa2f121 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:12.016294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb05d8b-dc83-41c6-8b41-6f1edc86c7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:12.017070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb05d8b-dc83-41c6-8b41-6f1edc86c7fa admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:12.017355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb05d8b-dc83-41c6-8b41-6f1edc86c7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:12.017635 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb05d8b-dc83-41c6-8b41-6f1edc86c7fa admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:12.018434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb05d8b-dc83-41c6-8b41-6f1edc86c7fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:12.020390 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb05d8b-dc83-41c6-8b41-6f1edc86c7fa admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:12.045629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793ca4f-d541-450c-afee-33bd2c4bd258 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:12.051453 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0793ca4f-d541-450c-afee-33bd2c4bd258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:12.051723 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 969/1956] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:11 2022] POST /identity/v3/users => generated 304 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:12.055312 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb05d8b-dc83-41c6-8b41-6f1edc86c7fa admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:12.069368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb05d8b-dc83-41c6-8b41-6f1edc86c7fa admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:12.072559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793ca4f-d541-450c-afee-33bd2c4bd258 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:12.078934 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82b42e-611d-4fcb-813e-113a192ad3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:12.080146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82b42e-611d-4fcb-813e-113a192ad3f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:12.080979 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82b42e-611d-4fcb-813e-113a192ad3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:12.081190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb4903-8fbe-40ad-acb2-113f930ccab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:12.081774 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82b42e-611d-4fcb-813e-113a192ad3f0 admin admin] PATH_INFO: `/v3/projects/33045ca387a84ffbbd2cb9869071e1ea` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:12.083768 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb4903-8fbe-40ad-acb2-113f930ccab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:12.084204 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb4903-8fbe-40ad-acb2-113f930ccab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:12.084328 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82b42e-611d-4fcb-813e-113a192ad3f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33045ca387a84ffbbd2cb9869071e1ea)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:12.084496 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb4903-8fbe-40ad-acb2-113f930ccab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:12.085619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb4903-8fbe-40ad-acb2-113f930ccab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:12.087762 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82b42e-611d-4fcb-813e-113a192ad3f0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:12.089368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb4903-8fbe-40ad-acb2-113f930ccab6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:12.109134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 970/1957] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:12.116808 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb4903-8fbe-40ad-acb2-113f930ccab6 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:12.128307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb4903-8fbe-40ad-acb2-113f930ccab6 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:12.133757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a566d23-d8df-47d5-86b6-328c15f7e948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:12.134634 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a566d23-d8df-47d5-86b6-328c15f7e948 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:12.134792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a566d23-d8df-47d5-86b6-328c15f7e948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:12.135998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a566d23-d8df-47d5-86b6-328c15f7e948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:12.135998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a566d23-d8df-47d5-86b6-328c15f7e948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:12.138036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a566d23-d8df-47d5-86b6-328c15f7e948 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:12.150822 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 971/1958] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:12.155080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a566d23-d8df-47d5-86b6-328c15f7e948 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:12.169168 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a566d23-d8df-47d5-86b6-328c15f7e948 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:12.190573 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2a82b42e-611d-4fcb-813e-113a192ad3f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33045ca387a84ffbbd2cb9869071e1ea', 'request_id': 'req-2a82b42e-611d-4fcb-813e-113a192ad3f0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:12.209101 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2a82b42e-611d-4fcb-813e-113a192ad3f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33045ca387a84ffbbd2cb9869071e1ea', 'request_id': 'req-2a82b42e-611d-4fcb-813e-113a192ad3f0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:12.211784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:12.224475 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2a82b42e-611d-4fcb-813e-113a192ad3f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33045ca387a84ffbbd2cb9869071e1ea', 'request_id': 'req-2a82b42e-611d-4fcb-813e-113a192ad3f0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:12.229569 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:12.240873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2a82b42e-611d-4fcb-813e-113a192ad3f0 admin admin] The token cache is being invalidate because project 33045ca387a84ffbbd2cb9869071e1ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:12.241166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2a82b42e-611d-4fcb-813e-113a192ad3f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:12.241838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2a82b42e-611d-4fcb-813e-113a192ad3f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:12.244040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 988/1959] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:12 2022] DELETE /identity/v3/projects/33045ca387a84ffbbd2cb9869071e1ea => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:12.247206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82b42e-611d-4fcb-813e-113a192ad3f0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:12.247206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2a82b42e-611d-4fcb-813e-113a192ad3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:12.264823 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b6c01-efa3-4cea-9443-1a1bcc5d0136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:12.265636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b6c01-efa3-4cea-9443-1a1bcc5d0136 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:12.265972 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b6c01-efa3-4cea-9443-1a1bcc5d0136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:12.266546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b6c01-efa3-4cea-9443-1a1bcc5d0136 admin admin] PATH_INFO: `/v3/projects/93365d44e15b4338b269ea9e14ea0b2b/users/69319aa245cd46198f0c771169be49a4/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:12.282164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b6c01-efa3-4cea-9443-1a1bcc5d0136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93365d44e15b4338b269ea9e14ea0b2b, user_id=69319aa245cd46198f0c771169be49a4, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:12.284909 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b6c01-efa3-4cea-9443-1a1bcc5d0136 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:12.299580 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 972/1960] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:12 2022] PUT /identity/v3/projects/93365d44e15b4338b269ea9e14ea0b2b/users/69319aa245cd46198f0c771169be49a4/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:12.300338 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b6c01-efa3-4cea-9443-1a1bcc5d0136 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:12.302147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bc9b6c01-efa3-4cea-9443-1a1bcc5d0136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:12.316453 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82b42e-611d-4fcb-813e-113a192ad3f0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:12.370386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b6c01-efa3-4cea-9443-1a1bcc5d0136 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:12.373869 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6b7dc-a0ac-4f45-b227-8a4a222af1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:12.374745 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6b7dc-a0ac-4f45-b227-8a4a222af1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:12.375023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6b7dc-a0ac-4f45-b227-8a4a222af1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:12.375293 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6b7dc-a0ac-4f45-b227-8a4a222af1a4 admin admin] PATH_INFO: `/v3/projects/184feb6b0d8e4a1fa7ca1560fe04a347` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:12.375510 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dc90d-3393-4a70-90af-18e8e80450db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:12.376404 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dc90d-3393-4a70-90af-18e8e80450db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:12.376512 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6b7dc-a0ac-4f45-b227-8a4a222af1a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=184feb6b0d8e4a1fa7ca1560fe04a347)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:12.376835 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dc90d-3393-4a70-90af-18e8e80450db admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:12.377107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dc90d-3393-4a70-90af-18e8e80450db admin admin] PATH_INFO: `/v3/users/6beb90351c054df48169b8d887754179` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:12.378403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2dc90d-3393-4a70-90af-18e8e80450db admin admin] RBAC: Authorizing `identity:delete_user(user_id=6beb90351c054df48169b8d887754179)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:12.378517 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6b7dc-a0ac-4f45-b227-8a4a222af1a4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:12.380403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2dc90d-3393-4a70-90af-18e8e80450db admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:12.443547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3c2dc90d-3393-4a70-90af-18e8e80450db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6beb90351c054df48169b8d887754179'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:12.452596 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3c2dc90d-3393-4a70-90af-18e8e80450db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6beb90351c054df48169b8d887754179'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:12.462262 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-eeb6b7dc-a0ac-4f45-b227-8a4a222af1a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '184feb6b0d8e4a1fa7ca1560fe04a347', 'request_id': 'req-eeb6b7dc-a0ac-4f45-b227-8a4a222af1a4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:12.469419 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3c2dc90d-3393-4a70-90af-18e8e80450db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6beb90351c054df48169b8d887754179'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:12.470323 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3c2dc90d-3393-4a70-90af-18e8e80450db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6beb90351c054df48169b8d887754179'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:12.472740 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-eeb6b7dc-a0ac-4f45-b227-8a4a222af1a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '184feb6b0d8e4a1fa7ca1560fe04a347', 'request_id': 'req-eeb6b7dc-a0ac-4f45-b227-8a4a222af1a4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:12.479629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3c2dc90d-3393-4a70-90af-18e8e80450db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6beb90351c054df48169b8d887754179'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:12.484206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-eeb6b7dc-a0ac-4f45-b227-8a4a222af1a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '184feb6b0d8e4a1fa7ca1560fe04a347', 'request_id': 'req-eeb6b7dc-a0ac-4f45-b227-8a4a222af1a4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:12.487153 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 973/1961] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:12 2022] DELETE /identity/v3/users/6beb90351c054df48169b8d887754179 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:12.490277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9167c-a8e8-4a25-aed2-18436f4cf46e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:12.490277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9167c-a8e8-4a25-aed2-18436f4cf46e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:12.490277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9167c-a8e8-4a25-aed2-18436f4cf46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:12.507849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-eeb6b7dc-a0ac-4f45-b227-8a4a222af1a4 admin admin] The token cache is being invalidate because project 184feb6b0d8e4a1fa7ca1560fe04a347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:12.508625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-eeb6b7dc-a0ac-4f45-b227-8a4a222af1a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:12.510390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-eeb6b7dc-a0ac-4f45-b227-8a4a222af1a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:12.512216 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 989/1962] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:12 2022] DELETE /identity/v3/projects/184feb6b0d8e4a1fa7ca1560fe04a347 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:12.518463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4998d3-50fe-491d-a0f7-09d2ae2308d5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:12.518757 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4998d3-50fe-491d-a0f7-09d2ae2308d5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:12.519059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4998d3-50fe-491d-a0f7-09d2ae2308d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:12.539806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0b4998d3-50fe-491d-a0f7-09d2ae2308d5 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:12.541107 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0b4998d3-50fe-491d-a0f7-09d2ae2308d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:12.547706 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-38c9167c-a8e8-4a25-aed2-18436f4cf46e None None] MFA Rules not processed for user `69319aa245cd46198f0c771169be49a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:12.549716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-38c9167c-a8e8-4a25-aed2-18436f4cf46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:12.562829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:12.585034 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:12.632690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 990/1963] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:12.649045 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a1f38-6670-410a-ba87-ce945f3ab7ba None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:12.649687 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a1f38-6670-410a-ba87-ce945f3ab7ba None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:12.649687 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a1f38-6670-410a-ba87-ce945f3ab7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:12.681460 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 974/1964] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:12.685737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9167c-a8e8-4a25-aed2-18436f4cf46e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:12.687260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-38c9167c-a8e8-4a25-aed2-18436f4cf46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:12.688117 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-330a1f38-6670-410a-ba87-ce945f3ab7ba None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:12.690190 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-330a1f38-6670-410a-ba87-ce945f3ab7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:12.702923 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 991/1965] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:12.712649 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a1f38-6670-410a-ba87-ce945f3ab7ba None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:12.719559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9167c-a8e8-4a25-aed2-18436f4cf46e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:12.738522 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a86fab-5a79-4906-8117-a56332958c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:12.739362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a86fab-5a79-4906-8117-a56332958c6b admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:12.739651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a86fab-5a79-4906-8117-a56332958c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:12.739930 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a86fab-5a79-4906-8117-a56332958c6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:12.740673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a86fab-5a79-4906-8117-a56332958c6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:12.741300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a1f38-6670-410a-ba87-ce945f3ab7ba None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:12.742648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a86fab-5a79-4906-8117-a56332958c6b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:12.755352 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c3843-b112-4b39-aace-b8916c3ae8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:12.756264 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c3843-b112-4b39-aace-b8916c3ae8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:12.759208 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c3843-b112-4b39-aace-b8916c3ae8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:12.759623 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c3843-b112-4b39-aace-b8916c3ae8e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:12.763717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c3843-b112-4b39-aace-b8916c3ae8e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:12.764179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c3843-b112-4b39-aace-b8916c3ae8e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:12.769428 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c3843-b112-4b39-aace-b8916c3ae8e0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:12.795094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 975/1966] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:12 2022] POST /identity/v3/projects => generated 409 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:12.798462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 992/1967] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:29:12.803409 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a86fab-5a79-4906-8117-a56332958c6b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:12.804756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c3843-b112-4b39-aace-b8916c3ae8e0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:12.825633 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c3843-b112-4b39-aace-b8916c3ae8e0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:12.890403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a86fab-5a79-4906-8117-a56332958c6b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:12.898100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06990a2-b71e-4deb-a9c3-18f962d98079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:12.899353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06990a2-b71e-4deb-a9c3-18f962d98079 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:12.899811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06990a2-b71e-4deb-a9c3-18f962d98079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:12.900269 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06990a2-b71e-4deb-a9c3-18f962d98079 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:12.901190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06990a2-b71e-4deb-a9c3-18f962d98079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:12.903485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06990a2-b71e-4deb-a9c3-18f962d98079 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:12.955640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 976/1968] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:12 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:12.959614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06990a2-b71e-4deb-a9c3-18f962d98079 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:12.975718 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0d3a4-f00b-4b52-b54d-a57b1fa82944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:12.976562 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0d3a4-f00b-4b52-b54d-a57b1fa82944 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:12.976879 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0d3a4-f00b-4b52-b54d-a57b1fa82944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:12.977155 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0d3a4-f00b-4b52-b54d-a57b1fa82944 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:12.977847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0d3a4-f00b-4b52-b54d-a57b1fa82944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:12.979757 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0d3a4-f00b-4b52-b54d-a57b1fa82944 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:12.980866 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06990a2-b71e-4deb-a9c3-18f962d98079 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:12.996639 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eee97e-0ad8-446f-88ec-19fc63cdebaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:12.997337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eee97e-0ad8-446f-88ec-19fc63cdebaf admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:12.997633 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eee97e-0ad8-446f-88ec-19fc63cdebaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:12.997895 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eee97e-0ad8-446f-88ec-19fc63cdebaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:12.998636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eee97e-0ad8-446f-88ec-19fc63cdebaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:13.000404 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eee97e-0ad8-446f-88ec-19fc63cdebaf admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:13.031094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 977/1969] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:13.032071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eee97e-0ad8-446f-88ec-19fc63cdebaf admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:13.044257 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 993/1970] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:12 2022] POST /identity/v3/projects => generated 383 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:13.049109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0d3a4-f00b-4b52-b54d-a57b1fa82944 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:13.054835 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eee97e-0ad8-446f-88ec-19fc63cdebaf admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:13.185035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e796b2-ba91-4df0-851c-bc748ff4b745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:13.186337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e796b2-ba91-4df0-851c-bc748ff4b745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:13.186337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e796b2-ba91-4df0-851c-bc748ff4b745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:13.186596 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e796b2-ba91-4df0-851c-bc748ff4b745 admin admin] PATH_INFO: `/v3/projects/3a0e91c14fed42cf97efaac2769dda1d/users/86d58c9a14bb4a17b0b9d96c1d9d011e/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:13.201282 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0d3a4-f00b-4b52-b54d-a57b1fa82944 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:13.212441 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5294e1b-3dee-47d4-8006-c9dddfd1be27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:13.218507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5294e1b-3dee-47d4-8006-c9dddfd1be27 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:13.218995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5294e1b-3dee-47d4-8006-c9dddfd1be27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:13.219416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5294e1b-3dee-47d4-8006-c9dddfd1be27 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:13.220839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5294e1b-3dee-47d4-8006-c9dddfd1be27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:13.230666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5294e1b-3dee-47d4-8006-c9dddfd1be27 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:13.241529 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e796b2-ba91-4df0-851c-bc748ff4b745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0e91c14fed42cf97efaac2769dda1d, user_id=86d58c9a14bb4a17b0b9d96c1d9d011e, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:13.244229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e796b2-ba91-4df0-851c-bc748ff4b745 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:13.290798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 994/1971] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:13 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:13.291946 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5294e1b-3dee-47d4-8006-c9dddfd1be27 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:13.295230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d5294e1b-3dee-47d4-8006-c9dddfd1be27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:13.302019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 978/1972] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:13 2022] PUT /identity/v3/projects/3a0e91c14fed42cf97efaac2769dda1d/users/86d58c9a14bb4a17b0b9d96c1d9d011e/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:13.302973 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e796b2-ba91-4df0-851c-bc748ff4b745 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:13.314362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:13.318716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5294e1b-3dee-47d4-8006-c9dddfd1be27 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:13.336987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:13.452205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3940b-88cb-455f-8cd4-a1810349e723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:13.453686 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3940b-88cb-455f-8cd4-a1810349e723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:13.454563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3940b-88cb-455f-8cd4-a1810349e723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:13.454563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3940b-88cb-455f-8cd4-a1810349e723 admin admin] PATH_INFO: `/v3/projects/2a6e3b1aeabf4d9d90557ded22939751` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:13.469686 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3940b-88cb-455f-8cd4-a1810349e723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a6e3b1aeabf4d9d90557ded22939751)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:13.487336 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3940b-88cb-455f-8cd4-a1810349e723 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:13.521436 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e796b2-ba91-4df0-851c-bc748ff4b745 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:13.528027 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79712958-0997-4901-b8dd-3c5928441425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:13.528951 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79712958-0997-4901-b8dd-3c5928441425 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:13.529238 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79712958-0997-4901-b8dd-3c5928441425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:13.529621 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79712958-0997-4901-b8dd-3c5928441425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:13.531371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79712958-0997-4901-b8dd-3c5928441425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:13.534584 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79712958-0997-4901-b8dd-3c5928441425 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:13.553381 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 979/1973] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:13.557971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79712958-0997-4901-b8dd-3c5928441425 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:13.560223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-61d3940b-88cb-455f-8cd4-a1810349e723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a6e3b1aeabf4d9d90557ded22939751', 'request_id': 'req-61d3940b-88cb-455f-8cd4-a1810349e723'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:13.572469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-61d3940b-88cb-455f-8cd4-a1810349e723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a6e3b1aeabf4d9d90557ded22939751', 'request_id': 'req-61d3940b-88cb-455f-8cd4-a1810349e723'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:13.575247 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79712958-0997-4901-b8dd-3c5928441425 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:13.579304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-61d3940b-88cb-455f-8cd4-a1810349e723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a6e3b1aeabf4d9d90557ded22939751', 'request_id': 'req-61d3940b-88cb-455f-8cd4-a1810349e723'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:13.592356 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-61d3940b-88cb-455f-8cd4-a1810349e723 admin admin] The token cache is being invalidate because project 2a6e3b1aeabf4d9d90557ded22939751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:13.592726 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-61d3940b-88cb-455f-8cd4-a1810349e723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:13.593511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-61d3940b-88cb-455f-8cd4-a1810349e723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:13.595102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 995/1974] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:13 2022] DELETE /identity/v3/projects/2a6e3b1aeabf4d9d90557ded22939751 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:13.597401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3940b-88cb-455f-8cd4-a1810349e723 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:13.599841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-61d3940b-88cb-455f-8cd4-a1810349e723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:13.664007 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc45345-becd-4238-a0e1-760e312f811f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:13.664796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc45345-becd-4238-a0e1-760e312f811f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:13.664997 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc45345-becd-4238-a0e1-760e312f811f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:13.665332 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc45345-becd-4238-a0e1-760e312f811f admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:13.666127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc45345-becd-4238-a0e1-760e312f811f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:13.668330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc45345-becd-4238-a0e1-760e312f811f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:13.679581 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 980/1975] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:13.679732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3940b-88cb-455f-8cd4-a1810349e723 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:13.682462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc45345-becd-4238-a0e1-760e312f811f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:13.683169 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1cc45345-becd-4238-a0e1-760e312f811f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:13.685851 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96b89c-accc-41c5-af82-cc302c1ba23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:13.686070 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96b89c-accc-41c5-af82-cc302c1ba23f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:13.686354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96b89c-accc-41c5-af82-cc302c1ba23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:13.686628 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96b89c-accc-41c5-af82-cc302c1ba23f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:13.687486 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96b89c-accc-41c5-af82-cc302c1ba23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:13.689131 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96b89c-accc-41c5-af82-cc302c1ba23f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:13.696862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc45345-becd-4238-a0e1-760e312f811f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:13.701506 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 996/1976] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:13.702627 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b6434-052c-4cc9-9ef7-fd7866887ece None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:13.702911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b6434-052c-4cc9-9ef7-fd7866887ece None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:13.703184 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b6434-052c-4cc9-9ef7-fd7866887ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:13.708640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a42cd-f9f5-470f-b782-6cf16022b0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:13.709705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a42cd-f9f5-470f-b782-6cf16022b0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:13.710144 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a42cd-f9f5-470f-b782-6cf16022b0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:13.710422 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a42cd-f9f5-470f-b782-6cf16022b0bc admin admin] PATH_INFO: `/v3/users/fd488305d28c4477b2a14ccfd3ccaeb7` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:13.711648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a42cd-f9f5-470f-b782-6cf16022b0bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd488305d28c4477b2a14ccfd3ccaeb7)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:13.713615 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a42cd-f9f5-470f-b782-6cf16022b0bc admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:13.722394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e83b6434-052c-4cc9-9ef7-fd7866887ece None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:13.723459 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e83b6434-052c-4cc9-9ef7-fd7866887ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:13.737674 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 997/1977] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:13.737674 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b6434-052c-4cc9-9ef7-fd7866887ece None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:13.737674 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e83b6434-052c-4cc9-9ef7-fd7866887ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:13.745651 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b6434-052c-4cc9-9ef7-fd7866887ece None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:13.751037 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4b5f6-0688-415a-a001-2823517810d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:13.752065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4b5f6-0688-415a-a001-2823517810d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:13.753420 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4b5f6-0688-415a-a001-2823517810d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:13.753663 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4b5f6-0688-415a-a001-2823517810d8 admin admin] PATH_INFO: `/v3/projects/3a0e91c14fed42cf97efaac2769dda1d/users/86d58c9a14bb4a17b0b9d96c1d9d011e/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:13.757348 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4b5f6-0688-415a-a001-2823517810d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0e91c14fed42cf97efaac2769dda1d, user_id=86d58c9a14bb4a17b0b9d96c1d9d011e, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:13.760110 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4b5f6-0688-415a-a001-2823517810d8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:13.772183 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 998/1978] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:13 2022] PUT /identity/v3/projects/3a0e91c14fed42cf97efaac2769dda1d/users/86d58c9a14bb4a17b0b9d96c1d9d011e/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:13.777704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4b5f6-0688-415a-a001-2823517810d8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:13.783900 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-324a42cd-f9f5-470f-b782-6cf16022b0bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd488305d28c4477b2a14ccfd3ccaeb7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:13.793273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-324a42cd-f9f5-470f-b782-6cf16022b0bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd488305d28c4477b2a14ccfd3ccaeb7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:13.807673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-324a42cd-f9f5-470f-b782-6cf16022b0bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd488305d28c4477b2a14ccfd3ccaeb7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:13.808689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-324a42cd-f9f5-470f-b782-6cf16022b0bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd488305d28c4477b2a14ccfd3ccaeb7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:13.812334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:13.817147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-324a42cd-f9f5-470f-b782-6cf16022b0bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd488305d28c4477b2a14ccfd3ccaeb7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:13.828352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 981/1979] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:13 2022] DELETE /identity/v3/users/fd488305d28c4477b2a14ccfd3ccaeb7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:13.828352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9ab4c-ed8a-4297-8e9e-12d894789f64 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:13.828352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9ab4c-ed8a-4297-8e9e-12d894789f64 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:13.828352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9ab4c-ed8a-4297-8e9e-12d894789f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:13.855183 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:13.862130 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-62d9ab4c-ed8a-4297-8e9e-12d894789f64 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:13.864498 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-62d9ab4c-ed8a-4297-8e9e-12d894789f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:13.864836 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4b5f6-0688-415a-a001-2823517810d8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:13.921824 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8bb7f-9d4a-4ff9-bf0c-0fbb05fd6860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:13.922660 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8bb7f-9d4a-4ff9-bf0c-0fbb05fd6860 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:13.922939 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8bb7f-9d4a-4ff9-bf0c-0fbb05fd6860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:13.923212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8bb7f-9d4a-4ff9-bf0c-0fbb05fd6860 admin admin] PATH_INFO: `/v3/projects/1d3a2829a2f7410a97246a3f01cf0a0b/users/c1cbbdbdda154fbe942d98160d353b4a/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:13.923791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 982/1980] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:13.925319 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8338c1-fa24-4687-8526-0023f863d014 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:13.925602 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8338c1-fa24-4687-8526-0023f863d014 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:13.925900 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8338c1-fa24-4687-8526-0023f863d014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:13.938179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8bb7f-9d4a-4ff9-bf0c-0fbb05fd6860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3a2829a2f7410a97246a3f01cf0a0b, user_id=c1cbbdbdda154fbe942d98160d353b4a, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:13.941525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8bb7f-9d4a-4ff9-bf0c-0fbb05fd6860 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:13.953123 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ea8338c1-fa24-4687-8526-0023f863d014 None None] MFA Rules not processed for user `86d58c9a14bb4a17b0b9d96c1d9d011e`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:13.954335 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ea8338c1-fa24-4687-8526-0023f863d014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:13.955169 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 999/1981] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:13 2022] PUT /identity/v3/projects/1d3a2829a2f7410a97246a3f01cf0a0b/users/c1cbbdbdda154fbe942d98160d353b4a/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:13.956633 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba8330-072f-4244-914a-f52fab8b8922 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:13.956918 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba8330-072f-4244-914a-f52fab8b8922 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:13.957205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba8330-072f-4244-914a-f52fab8b8922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:13.978580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-69ba8330-072f-4244-914a-f52fab8b8922 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:13.979714 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-69ba8330-072f-4244-914a-f52fab8b8922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:14.043392 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1000/1982] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:14.043600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 983/1983] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:13 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:14.044632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba8330-072f-4244-914a-f52fab8b8922 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:14.049064 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fa8f8-9cab-4450-867f-b21b8fd33ac2 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:14.049151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fa8f8-9cab-4450-867f-b21b8fd33ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:14.049579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fa8f8-9cab-4450-867f-b21b8fd33ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:14.055524 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba8330-072f-4244-914a-f52fab8b8922 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:14.061698 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502f7c2-5c42-48d4-a345-4bf5edcbde04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:14.062515 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502f7c2-5c42-48d4-a345-4bf5edcbde04 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:14.062818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502f7c2-5c42-48d4-a345-4bf5edcbde04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:14.063167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502f7c2-5c42-48d4-a345-4bf5edcbde04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:14.064265 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502f7c2-5c42-48d4-a345-4bf5edcbde04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:14.065019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502f7c2-5c42-48d4-a345-4bf5edcbde04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:14.066987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502f7c2-5c42-48d4-a345-4bf5edcbde04 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:14.079651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-674fa8f8-9cab-4450-867f-b21b8fd33ac2 None None] MFA Rules not processed for user `c1cbbdbdda154fbe942d98160d353b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:14.079862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1001/1984] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:29:14.080341 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502f7c2-5c42-48d4-a345-4bf5edcbde04 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:14.080897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-674fa8f8-9cab-4450-867f-b21b8fd33ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:14.082104 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6502f7c2-5c42-48d4-a345-4bf5edcbde04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:14.131195 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:14.148932 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502f7c2-5c42-48d4-a345-4bf5edcbde04 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:14.155257 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e3f36-466f-4da3-9ddb-140c0d44dcce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:14.155549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 984/1985] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:14.156138 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e3f36-466f-4da3-9ddb-140c0d44dcce service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:14.156499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e3f36-466f-4da3-9ddb-140c0d44dcce service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:14.156878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e3f36-466f-4da3-9ddb-140c0d44dcce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:14.157658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fa8f8-9cab-4450-867f-b21b8fd33ac2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:14.161117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-674fa8f8-9cab-4450-867f-b21b8fd33ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:14.171563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e3f36-466f-4da3-9ddb-140c0d44dcce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:14.173139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e3f36-466f-4da3-9ddb-140c0d44dcce service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:14.183414 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1002/1986] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:14.184276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e3f36-466f-4da3-9ddb-140c0d44dcce service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:14.192474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:14.193575 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e3f36-466f-4da3-9ddb-140c0d44dcce service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:14.200947 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a22cc-ff39-4d86-833e-bc7414d853d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:14.201652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a22cc-ff39-4d86-833e-bc7414d853d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:14.201891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a22cc-ff39-4d86-833e-bc7414d853d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:14.202168 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a22cc-ff39-4d86-833e-bc7414d853d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:14.202871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a22cc-ff39-4d86-833e-bc7414d853d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:14.204832 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a22cc-ff39-4d86-833e-bc7414d853d4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:14.233282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fa8f8-9cab-4450-867f-b21b8fd33ac2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:14.237752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96f724-5925-4292-8af1-2cb9e4cc1d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:14.238547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96f724-5925-4292-8af1-2cb9e4cc1d60 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:14.239155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96f724-5925-4292-8af1-2cb9e4cc1d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:14.239498 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96f724-5925-4292-8af1-2cb9e4cc1d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:14.250341 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96f724-5925-4292-8af1-2cb9e4cc1d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:14.250823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1003/1987] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:14 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:14.252027 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96f724-5925-4292-8af1-2cb9e4cc1d60 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:14.252336 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a22cc-ff39-4d86-833e-bc7414d853d4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:14.255848 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4a5a22cc-ff39-4d86-833e-bc7414d853d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:14.263916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 985/1988] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:14 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:14.264930 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96f724-5925-4292-8af1-2cb9e4cc1d60 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:14.276233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96f724-5925-4292-8af1-2cb9e4cc1d60 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:14.338340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a22cc-ff39-4d86-833e-bc7414d853d4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:14.346706 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674821f-418c-42c9-a113-4ac0142f6ef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:14.348250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674821f-418c-42c9-a113-4ac0142f6ef5 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:14.348589 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674821f-418c-42c9-a113-4ac0142f6ef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:14.349207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674821f-418c-42c9-a113-4ac0142f6ef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:14.376494 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaed0c-0720-4725-9daf-4dc484fa5c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:14.378231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaed0c-0720-4725-9daf-4dc484fa5c74 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:14.379501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaed0c-0720-4725-9daf-4dc484fa5c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:14.380359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaed0c-0720-4725-9daf-4dc484fa5c74 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:14.382094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceaed0c-0720-4725-9daf-4dc484fa5c74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:14.385242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceaed0c-0720-4725-9daf-4dc484fa5c74 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:14.416113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 986/1989] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:14 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:14.420264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaed0c-0720-4725-9daf-4dc484fa5c74 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:14.450510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674821f-418c-42c9-a113-4ac0142f6ef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:14.453283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaed0c-0720-4725-9daf-4dc484fa5c74 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:14.461247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674821f-418c-42c9-a113-4ac0142f6ef5 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:14.461940 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4c36a-e6c3-40a7-a2a3-7e93b367e389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:14.462975 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4c36a-e6c3-40a7-a2a3-7e93b367e389 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:14.463315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4c36a-e6c3-40a7-a2a3-7e93b367e389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:14.464162 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4c36a-e6c3-40a7-a2a3-7e93b367e389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:14.465053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4c36a-e6c3-40a7-a2a3-7e93b367e389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:14.466853 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4c36a-e6c3-40a7-a2a3-7e93b367e389 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:14.479880 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1004/1990] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:14.484950 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 987/1991] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:14.498151 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674821f-418c-42c9-a113-4ac0142f6ef5 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:14.500294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4c36a-e6c3-40a7-a2a3-7e93b367e389 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:14.524015 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4c36a-e6c3-40a7-a2a3-7e93b367e389 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:14.526528 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674821f-418c-42c9-a113-4ac0142f6ef5 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:14.532487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c3427-4758-4bcf-a0cb-324ff01892e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:14.534980 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c3427-4758-4bcf-a0cb-324ff01892e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:14.535266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c3427-4758-4bcf-a0cb-324ff01892e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:14.535546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c3427-4758-4bcf-a0cb-324ff01892e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:14.539523 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475450f-5781-4345-9b53-5694ef44ddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:14.540681 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475450f-5781-4345-9b53-5694ef44ddbc admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:14.540960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475450f-5781-4345-9b53-5694ef44ddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:14.541230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475450f-5781-4345-9b53-5694ef44ddbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:14.542892 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5a2c3427-4758-4bcf-a0cb-324ff01892e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:14.544725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475450f-5781-4345-9b53-5694ef44ddbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:14.546775 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475450f-5781-4345-9b53-5694ef44ddbc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:14.571530 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1005/1992] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:14.577759 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475450f-5781-4345-9b53-5694ef44ddbc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:14.589775 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475450f-5781-4345-9b53-5694ef44ddbc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:14.595092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ede62-6f91-4547-b548-804232d9778a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:14.596343 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ede62-6f91-4547-b548-804232d9778a admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:14.596663 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ede62-6f91-4547-b548-804232d9778a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:14.596935 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ede62-6f91-4547-b548-804232d9778a admin admin] PATH_INFO: `/v3/projects/0bd11aa806a6450ea4bd802b932885a2/users/ff4a9cb3caae45949658d170afe92290/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:14.614668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ede62-6f91-4547-b548-804232d9778a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bd11aa806a6450ea4bd802b932885a2, user_id=ff4a9cb3caae45949658d170afe92290, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:14.617986 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ede62-6f91-4547-b548-804232d9778a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:14.647814 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1006/1993] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:14 2022] PUT /identity/v3/projects/0bd11aa806a6450ea4bd802b932885a2/users/ff4a9cb3caae45949658d170afe92290/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:14.658946 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0950a-5c63-4a20-8f6c-b02bf7610a77 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:14.659251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0950a-5c63-4a20-8f6c-b02bf7610a77 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:14.659363 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c3427-4758-4bcf-a0cb-324ff01892e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:14.659681 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0950a-5c63-4a20-8f6c-b02bf7610a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:14.660931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c3427-4758-4bcf-a0cb-324ff01892e1 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:14.671412 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 988/1994] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:14 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:29:14.706589 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0db0950a-5c63-4a20-8f6c-b02bf7610a77 None None] MFA Rules not processed for user `ff4a9cb3caae45949658d170afe92290`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:14.707975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0db0950a-5c63-4a20-8f6c-b02bf7610a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:14.713949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c3427-4758-4bcf-a0cb-324ff01892e1 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:14.715474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5a2c3427-4758-4bcf-a0cb-324ff01892e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:14.739357 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c3427-4758-4bcf-a0cb-324ff01892e1 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:14.794834 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:14.815742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:14.836740 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:14.843467 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1007/1995] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:29:14.848436 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0950a-5c63-4a20-8f6c-b02bf7610a77 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:14.850138 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:14.852440 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:14.852793 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6 admin admin] PATH_INFO: `/v3/projects/64d732a171c24db5881488cda0f95b29` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:14.854328 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d732a171c24db5881488cda0f95b29)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:14.856625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:14.869311 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0950a-5c63-4a20-8f6c-b02bf7610a77 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:14.875761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdb2da-c564-40c7-9284-63be29e8fabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:14.877045 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdb2da-c564-40c7-9284-63be29e8fabc admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:14.878135 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdb2da-c564-40c7-9284-63be29e8fabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:14.878623 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdb2da-c564-40c7-9284-63be29e8fabc admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:14.879643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdb2da-c564-40c7-9284-63be29e8fabc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:14.882157 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdb2da-c564-40c7-9284-63be29e8fabc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:14.932474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1008/1996] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:14 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:14.936834 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdb2da-c564-40c7-9284-63be29e8fabc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:14.965820 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d732a171c24db5881488cda0f95b29', 'request_id': 'req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:14.989077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d732a171c24db5881488cda0f95b29', 'request_id': 'req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:14.999091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d732a171c24db5881488cda0f95b29', 'request_id': 'req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:15.016232 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6 admin admin] The token cache is being invalidate because project 64d732a171c24db5881488cda0f95b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:15.016664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:15.020207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:15.023212 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 989/1997] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:14 2022] DELETE /identity/v3/projects/64d732a171c24db5881488cda0f95b29 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:15.027833 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:15.029512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:15.066811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdb2da-c564-40c7-9284-63be29e8fabc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:15.129209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e09d5-9e84-416d-ab7e-5b0d605b3ef6 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:15.133915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5954018-2839-4440-8f5c-0c9f89be8626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:15.134796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5954018-2839-4440-8f5c-0c9f89be8626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:15.135072 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5954018-2839-4440-8f5c-0c9f89be8626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:15.135343 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5954018-2839-4440-8f5c-0c9f89be8626 admin admin] PATH_INFO: `/v3/users/3911135c0e634b0da66812cfda6aa065` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:15.136582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5954018-2839-4440-8f5c-0c9f89be8626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3911135c0e634b0da66812cfda6aa065)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:15.138498 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5954018-2839-4440-8f5c-0c9f89be8626 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:15.152045 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ee210-82c9-4823-b018-1f3798c3abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:15.153005 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ee210-82c9-4823-b018-1f3798c3abc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:15.153432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ee210-82c9-4823-b018-1f3798c3abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:15.153731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ee210-82c9-4823-b018-1f3798c3abc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:15.154495 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ee210-82c9-4823-b018-1f3798c3abc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:15.156807 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ee210-82c9-4823-b018-1f3798c3abc5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:15.187605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1009/1998] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:14 2022] POST /identity/v3/users => generated 298 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:15.193082 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ee210-82c9-4823-b018-1f3798c3abc5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:15.198349 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ad8ee210-82c9-4823-b018-1f3798c3abc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:15.203915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f5954018-2839-4440-8f5c-0c9f89be8626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3911135c0e634b0da66812cfda6aa065'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:15.214579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ee210-82c9-4823-b018-1f3798c3abc5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:15.215303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f5954018-2839-4440-8f5c-0c9f89be8626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3911135c0e634b0da66812cfda6aa065'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:15.222432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa2c69-2cd6-4ca7-bce8-d1c5de05a797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:15.223286 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2c69-2cd6-4ca7-bce8-d1c5de05a797 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:15.223758 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2c69-2cd6-4ca7-bce8-d1c5de05a797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:15.224295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2c69-2cd6-4ca7-bce8-d1c5de05a797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:15.225415 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa2c69-2cd6-4ca7-bce8-d1c5de05a797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:15.227455 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa2c69-2cd6-4ca7-bce8-d1c5de05a797 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:15.232492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f5954018-2839-4440-8f5c-0c9f89be8626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3911135c0e634b0da66812cfda6aa065'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:15.233272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f5954018-2839-4440-8f5c-0c9f89be8626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3911135c0e634b0da66812cfda6aa065'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:15.236512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:15.242665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1010/1999] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:29:15.243953 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f5954018-2839-4440-8f5c-0c9f89be8626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3911135c0e634b0da66812cfda6aa065'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:15.247401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa2c69-2cd6-4ca7-bce8-d1c5de05a797 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:15.250409 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bcaa2c69-2cd6-4ca7-bce8-d1c5de05a797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:15.252677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 990/2000] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:15 2022] DELETE /identity/v3/users/3911135c0e634b0da66812cfda6aa065 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:15.271312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa2c69-2cd6-4ca7-bce8-d1c5de05a797 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:15.313850 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:15.357397 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0ce1c-5f72-4989-8ea9-dd9a5a48b603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:15.358552 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0ce1c-5f72-4989-8ea9-dd9a5a48b603 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:15.358938 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0ce1c-5f72-4989-8ea9-dd9a5a48b603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:15.359116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0ce1c-5f72-4989-8ea9-dd9a5a48b603 admin admin] PATH_INFO: `/v3/projects/5aed13ac09524a318b227985fc8f061b/users/e0386ba6b8a445ffaa29e80576284185/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:15.379488 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0ce1c-5f72-4989-8ea9-dd9a5a48b603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aed13ac09524a318b227985fc8f061b, user_id=e0386ba6b8a445ffaa29e80576284185, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:15.384691 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0ce1c-5f72-4989-8ea9-dd9a5a48b603 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:15.403368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1011/2001] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:15 2022] PUT /identity/v3/projects/5aed13ac09524a318b227985fc8f061b/users/e0386ba6b8a445ffaa29e80576284185/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:15.407346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5954018-2839-4440-8f5c-0c9f89be8626 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:15.431897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5954018-2839-4440-8f5c-0c9f89be8626 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:15.504112 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863b5e-c7af-4e77-9716-b8e392e610c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:15.505455 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863b5e-c7af-4e77-9716-b8e392e610c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:15.505883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863b5e-c7af-4e77-9716-b8e392e610c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:15.506302 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863b5e-c7af-4e77-9716-b8e392e610c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:15.507658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84863b5e-c7af-4e77-9716-b8e392e610c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:15.511402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84863b5e-c7af-4e77-9716-b8e392e610c5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:15.524778 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 991/2002] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:15.528489 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0ce1c-5f72-4989-8ea9-dd9a5a48b603 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:15.542585 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0ce1c-5f72-4989-8ea9-dd9a5a48b603 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:15.549009 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06c055-d2a1-4388-9219-90ae4e7a4d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:15.550255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06c055-d2a1-4388-9219-90ae4e7a4d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:15.550765 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06c055-d2a1-4388-9219-90ae4e7a4d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:15.551916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06c055-d2a1-4388-9219-90ae4e7a4d11 admin admin] PATH_INFO: `/v3/projects/5aed13ac09524a318b227985fc8f061b/users/e0386ba6b8a445ffaa29e80576284185/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:15.558015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06c055-d2a1-4388-9219-90ae4e7a4d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aed13ac09524a318b227985fc8f061b, user_id=e0386ba6b8a445ffaa29e80576284185, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:15.569451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06c055-d2a1-4388-9219-90ae4e7a4d11 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:15.589558 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863b5e-c7af-4e77-9716-b8e392e610c5 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:15.591322 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-84863b5e-c7af-4e77-9716-b8e392e610c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:15.592124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1012/2003] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:15 2022] PUT /identity/v3/projects/5aed13ac09524a318b227985fc8f061b/users/e0386ba6b8a445ffaa29e80576284185/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:15.607062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d7cf3-0a89-4a15-8c81-e2e24648231c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:15.607442 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d7cf3-0a89-4a15-8c81-e2e24648231c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:15.607841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d7cf3-0a89-4a15-8c81-e2e24648231c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:15.621807 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863b5e-c7af-4e77-9716-b8e392e610c5 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:15.641573 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-662d7cf3-0a89-4a15-8c81-e2e24648231c None None] MFA Rules not processed for user `e0386ba6b8a445ffaa29e80576284185`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:15.643185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-662d7cf3-0a89-4a15-8c81-e2e24648231c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:15.695320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fb9f8-ea57-47a7-be52-0a21b98ffbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:15.695855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb9f8-ea57-47a7-be52-0a21b98ffbe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:15.696132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb9f8-ea57-47a7-be52-0a21b98ffbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:15.696420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb9f8-ea57-47a7-be52-0a21b98ffbe5 admin admin] PATH_INFO: `/v3/projects/773b3f289d814587833a89460344a582` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:15.697750 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fb9f8-ea57-47a7-be52-0a21b98ffbe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=773b3f289d814587833a89460344a582)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:15.699676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fb9f8-ea57-47a7-be52-0a21b98ffbe5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:15.730167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1013/2004] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:15.741379 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d7cf3-0a89-4a15-8c81-e2e24648231c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:15.742717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-662d7cf3-0a89-4a15-8c81-e2e24648231c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:15.753401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-931fb9f8-ea57-47a7-be52-0a21b98ffbe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '773b3f289d814587833a89460344a582', 'request_id': 'req-931fb9f8-ea57-47a7-be52-0a21b98ffbe5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:15.762189 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-931fb9f8-ea57-47a7-be52-0a21b98ffbe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '773b3f289d814587833a89460344a582', 'request_id': 'req-931fb9f8-ea57-47a7-be52-0a21b98ffbe5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:15.768410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-931fb9f8-ea57-47a7-be52-0a21b98ffbe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '773b3f289d814587833a89460344a582', 'request_id': 'req-931fb9f8-ea57-47a7-be52-0a21b98ffbe5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:15.786935 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-931fb9f8-ea57-47a7-be52-0a21b98ffbe5 admin admin] The token cache is being invalidate because project 773b3f289d814587833a89460344a582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:15.787236 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-931fb9f8-ea57-47a7-be52-0a21b98ffbe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:15.787935 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-931fb9f8-ea57-47a7-be52-0a21b98ffbe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:15.789735 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 992/2005] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:15 2022] DELETE /identity/v3/projects/773b3f289d814587833a89460344a582 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:15.794442 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03902b-b9e4-41eb-a901-96e560e4c432 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:15.794574 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03902b-b9e4-41eb-a901-96e560e4c432 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:15.794853 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03902b-b9e4-41eb-a901-96e560e4c432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:15.810702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d7cf3-0a89-4a15-8c81-e2e24648231c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:15.818919 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3a03902b-b9e4-41eb-a901-96e560e4c432 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:15.820159 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3a03902b-b9e4-41eb-a901-96e560e4c432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:15.834565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:15.864686 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:15.873064 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7496276-5f9d-4842-80c5-d291d49e533c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:15.873739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7496276-5f9d-4842-80c5-d291d49e533c service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:15.874025 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7496276-5f9d-4842-80c5-d291d49e533c service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:15.874302 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7496276-5f9d-4842-80c5-d291d49e533c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:15.877542 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f7496276-5f9d-4842-80c5-d291d49e533c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:15.905178 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 993/2006] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:29:15.906961 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a56f8-0ba4-4f61-9538-f3dfcac0c30c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:15.907359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a56f8-0ba4-4f61-9538-f3dfcac0c30c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:15.907727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a56f8-0ba4-4f61-9538-f3dfcac0c30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:15.931705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ab8a56f8-0ba4-4f61-9538-f3dfcac0c30c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:15.933240 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ab8a56f8-0ba4-4f61-9538-f3dfcac0c30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:15.944681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 994/2007] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:15.951413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a56f8-0ba4-4f61-9538-f3dfcac0c30c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:15.963894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a56f8-0ba4-4f61-9538-f3dfcac0c30c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:15.973206 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a528acb-9fca-4e53-9aa2-0f99847678e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:15.973905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a528acb-9fca-4e53-9aa2-0f99847678e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:15.974189 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a528acb-9fca-4e53-9aa2-0f99847678e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:15.974489 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a528acb-9fca-4e53-9aa2-0f99847678e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:15.975221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a528acb-9fca-4e53-9aa2-0f99847678e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:15.975530 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a528acb-9fca-4e53-9aa2-0f99847678e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:15.977480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a528acb-9fca-4e53-9aa2-0f99847678e1 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:15.993179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 995/2008] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:29:15.997124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7496276-5f9d-4842-80c5-d291d49e533c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:15.997312 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a528acb-9fca-4e53-9aa2-0f99847678e1 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:15.998596 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7496276-5f9d-4842-80c5-d291d49e533c service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:16.012827 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a528acb-9fca-4e53-9aa2-0f99847678e1 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:16.019184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75ebbf-487d-447e-9121-714c8d4f75d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:16.020455 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75ebbf-487d-447e-9121-714c8d4f75d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:16.020836 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75ebbf-487d-447e-9121-714c8d4f75d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:16.021304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75ebbf-487d-447e-9121-714c8d4f75d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:16.022372 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75ebbf-487d-447e-9121-714c8d4f75d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:16.025429 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75ebbf-487d-447e-9121-714c8d4f75d4 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:16.041192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1014/2009] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:29:16.091863 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 996/2010] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:15 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:29:16.093214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7496276-5f9d-4842-80c5-d291d49e533c service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:16.109555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7496276-5f9d-4842-80c5-d291d49e533c service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:16.183515 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75ebbf-487d-447e-9121-714c8d4f75d4 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:16.186895 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ea75ebbf-487d-447e-9121-714c8d4f75d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:16.254109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d24406-1b4c-4100-9639-51e7d72c4913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:16.255719 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d24406-1b4c-4100-9639-51e7d72c4913 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:16.256138 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d24406-1b4c-4100-9639-51e7d72c4913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:16.256641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d24406-1b4c-4100-9639-51e7d72c4913 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:16.257693 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d24406-1b4c-4100-9639-51e7d72c4913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:16.261047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d24406-1b4c-4100-9639-51e7d72c4913 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:16.295400 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1015/2011] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:16 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:16.308180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75ebbf-487d-447e-9121-714c8d4f75d4 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:16.309698 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d24406-1b4c-4100-9639-51e7d72c4913 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:16.317956 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b2d05-4b3a-4809-a73d-ed9a05767008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:16.318626 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b2d05-4b3a-4809-a73d-ed9a05767008 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:16.318905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b2d05-4b3a-4809-a73d-ed9a05767008 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:16.319170 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b2d05-4b3a-4809-a73d-ed9a05767008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:16.328248 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-df6b2d05-4b3a-4809-a73d-ed9a05767008 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:16.329089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d24406-1b4c-4100-9639-51e7d72c4913 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:16.340326 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f4efe-a5e4-418c-8ada-939e5f689a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:16.341076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f4efe-a5e4-418c-8ada-939e5f689a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:16.341372 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f4efe-a5e4-418c-8ada-939e5f689a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:16.341629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f4efe-a5e4-418c-8ada-939e5f689a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:16.342641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f4efe-a5e4-418c-8ada-939e5f689a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:16.344363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f4efe-a5e4-418c-8ada-939e5f689a43 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:16.361116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1016/2012] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:16.369894 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f4efe-a5e4-418c-8ada-939e5f689a43 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:16.383255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f4efe-a5e4-418c-8ada-939e5f689a43 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:16.401669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a2233-ee97-4b9e-8d5b-349ec11e9833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:16.402368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a2233-ee97-4b9e-8d5b-349ec11e9833 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:16.403066 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a2233-ee97-4b9e-8d5b-349ec11e9833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:16.403066 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a2233-ee97-4b9e-8d5b-349ec11e9833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:16.403664 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a2233-ee97-4b9e-8d5b-349ec11e9833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:16.405378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a2233-ee97-4b9e-8d5b-349ec11e9833 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:16.556698 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1017/2013] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:16.568029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a2233-ee97-4b9e-8d5b-349ec11e9833 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:16.571020 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b2d05-4b3a-4809-a73d-ed9a05767008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:16.574804 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b2d05-4b3a-4809-a73d-ed9a05767008 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:16.598939 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 997/2014] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:16.604449 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a2233-ee97-4b9e-8d5b-349ec11e9833 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:16.614454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50b52d-b503-4366-a6ee-a12b92d5cbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:16.615621 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50b52d-b503-4366-a6ee-a12b92d5cbe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:16.616036 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50b52d-b503-4366-a6ee-a12b92d5cbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:16.616410 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50b52d-b503-4366-a6ee-a12b92d5cbe7 admin admin] PATH_INFO: `/v3/projects/32ef6c0a4e76499c95757904df4e6e1e/users/31bd41139867408b8cdc6b7f6be968de/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:16.638939 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50b52d-b503-4366-a6ee-a12b92d5cbe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ef6c0a4e76499c95757904df4e6e1e, user_id=31bd41139867408b8cdc6b7f6be968de, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:16.642311 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50b52d-b503-4366-a6ee-a12b92d5cbe7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:16.668017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1018/2015] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:16 2022] PUT /identity/v3/projects/32ef6c0a4e76499c95757904df4e6e1e/users/31bd41139867408b8cdc6b7f6be968de/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:16.691216 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec02e72-45c8-46ff-bb9a-f75938d98860 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:16.691659 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec02e72-45c8-46ff-bb9a-f75938d98860 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:16.691941 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec02e72-45c8-46ff-bb9a-f75938d98860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:16.733357 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-cec02e72-45c8-46ff-bb9a-f75938d98860 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:16.734669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cec02e72-45c8-46ff-bb9a-f75938d98860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:16.827379 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:16.970729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 998/2016] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:16.989476 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50b52d-b503-4366-a6ee-a12b92d5cbe7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:16.993185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-eb50b52d-b503-4366-a6ee-a12b92d5cbe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:17.066102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:17.084727 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50b52d-b503-4366-a6ee-a12b92d5cbe7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:17.089321 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194efbe3-d0c1-4165-b406-3f87fadbdee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:17.089955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194efbe3-d0c1-4165-b406-3f87fadbdee0 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:17.090234 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194efbe3-d0c1-4165-b406-3f87fadbdee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:17.090508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194efbe3-d0c1-4165-b406-3f87fadbdee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:17.102888 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194efbe3-d0c1-4165-b406-3f87fadbdee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:17.104723 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194efbe3-d0c1-4165-b406-3f87fadbdee0 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:17.116015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1019/2017] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:18.041332 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29523e-59dc-41f4-bf55-cc638c673de2 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:18.041332 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29523e-59dc-41f4-bf55-cc638c673de2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:18.041961 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29523e-59dc-41f4-bf55-cc638c673de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:18.070020 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ff29523e-59dc-41f4-bf55-cc638c673de2 None None] MFA Rules not processed for user `31bd41139867408b8cdc6b7f6be968de`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:18.071238 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ff29523e-59dc-41f4-bf55-cc638c673de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:18.217942 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 999/2018] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:18.335100 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194efbe3-d0c1-4165-b406-3f87fadbdee0 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:18.336823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-194efbe3-d0c1-4165-b406-3f87fadbdee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:18.448471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194efbe3-d0c1-4165-b406-3f87fadbdee0 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:18.457046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8ea5c-4069-4823-a35e-e822185ccb10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:18.458643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8ea5c-4069-4823-a35e-e822185ccb10 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:18.459125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8ea5c-4069-4823-a35e-e822185ccb10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:18.459786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8ea5c-4069-4823-a35e-e822185ccb10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:18.474122 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8ea5c-4069-4823-a35e-e822185ccb10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:18.475720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8ea5c-4069-4823-a35e-e822185ccb10 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:18.492802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1020/2019] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:20.176727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a77c41-2338-4de9-a514-cc219005f3f5 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:20.177656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a77c41-2338-4de9-a514-cc219005f3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:20.178135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a77c41-2338-4de9-a514-cc219005f3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:20.211481 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e7a77c41-2338-4de9-a514-cc219005f3f5 None None] MFA Rules not processed for user `31bd41139867408b8cdc6b7f6be968de`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:20.213171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e7a77c41-2338-4de9-a514-cc219005f3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:20.228715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8ea5c-4069-4823-a35e-e822185ccb10 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:20.233822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2ba8ea5c-4069-4823-a35e-e822185ccb10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:20.256765 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1000/2020] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:20.271932 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8ea5c-4069-4823-a35e-e822185ccb10 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:20.283489 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271ddfb-ddad-4661-ac04-6fe5de37848d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:20.285863 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271ddfb-ddad-4661-ac04-6fe5de37848d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:20.287251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271ddfb-ddad-4661-ac04-6fe5de37848d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:20.288006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271ddfb-ddad-4661-ac04-6fe5de37848d admin admin] PATH_INFO: `/v3/users/ff4a9cb3caae45949658d170afe92290` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:20.289797 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271ddfb-ddad-4661-ac04-6fe5de37848d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4a9cb3caae45949658d170afe92290)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:20.292139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271ddfb-ddad-4661-ac04-6fe5de37848d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:20.421759 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8271ddfb-ddad-4661-ac04-6fe5de37848d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4a9cb3caae45949658d170afe92290'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:20.443350 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8271ddfb-ddad-4661-ac04-6fe5de37848d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4a9cb3caae45949658d170afe92290'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:20.459343 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8271ddfb-ddad-4661-ac04-6fe5de37848d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4a9cb3caae45949658d170afe92290'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:20.460049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8271ddfb-ddad-4661-ac04-6fe5de37848d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4a9cb3caae45949658d170afe92290'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:20.484379 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8271ddfb-ddad-4661-ac04-6fe5de37848d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4a9cb3caae45949658d170afe92290'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:20.493365 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1021/2021] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:20 2022] DELETE /identity/v3/users/ff4a9cb3caae45949658d170afe92290 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:20.499420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd77f2-0c3c-41e5-a3be-08859b628eb8 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:20.500127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd77f2-0c3c-41e5-a3be-08859b628eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:20.500752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd77f2-0c3c-41e5-a3be-08859b628eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:20.527254 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e3dd77f2-0c3c-41e5-a3be-08859b628eb8 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:20.529176 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e3dd77f2-0c3c-41e5-a3be-08859b628eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:20.667436 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1001/2022] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:20.717124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271ddfb-ddad-4661-ac04-6fe5de37848d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:20.718783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8271ddfb-ddad-4661-ac04-6fe5de37848d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:20.833601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271ddfb-ddad-4661-ac04-6fe5de37848d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:20.838125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b645a-686d-4cc0-abf7-681deb7c0e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:20.838845 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b645a-686d-4cc0-abf7-681deb7c0e65 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:20.839132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b645a-686d-4cc0-abf7-681deb7c0e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:20.839409 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b645a-686d-4cc0-abf7-681deb7c0e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:20.852356 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b645a-686d-4cc0-abf7-681deb7c0e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:20.854226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b645a-686d-4cc0-abf7-681deb7c0e65 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:20.860555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:20.878627 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1022/2023] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:21.514615 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd77f2-0c3c-41e5-a3be-08859b628eb8 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:21.516279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e3dd77f2-0c3c-41e5-a3be-08859b628eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:21.517901 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b645a-686d-4cc0-abf7-681deb7c0e65 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:21.519883 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8d7b645a-686d-4cc0-abf7-681deb7c0e65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:21.538826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd77f2-0c3c-41e5-a3be-08859b628eb8 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:21.545162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b645a-686d-4cc0-abf7-681deb7c0e65 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:21.547340 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45426ae3-0515-43ae-9dc4-9ace1eb85552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:21.549251 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45426ae3-0515-43ae-9dc4-9ace1eb85552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:21.549682 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45426ae3-0515-43ae-9dc4-9ace1eb85552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:21.549982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45426ae3-0515-43ae-9dc4-9ace1eb85552 admin admin] PATH_INFO: `/v3/projects/0bd11aa806a6450ea4bd802b932885a2` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:21.552158 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45426ae3-0515-43ae-9dc4-9ace1eb85552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bd11aa806a6450ea4bd802b932885a2)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:21.554462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb336c-2386-48f8-9bc6-d488da2eb819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:21.555153 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45426ae3-0515-43ae-9dc4-9ace1eb85552 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:21.569718 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb336c-2386-48f8-9bc6-d488da2eb819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:21.570068 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb336c-2386-48f8-9bc6-d488da2eb819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:21.570256 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb336c-2386-48f8-9bc6-d488da2eb819 admin admin] PATH_INFO: `/v3/users/c1cbbdbdda154fbe942d98160d353b4a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:21.571961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb336c-2386-48f8-9bc6-d488da2eb819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1cbbdbdda154fbe942d98160d353b4a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:21.577709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb336c-2386-48f8-9bc6-d488da2eb819 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:21.654523 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-45426ae3-0515-43ae-9dc4-9ace1eb85552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bd11aa806a6450ea4bd802b932885a2', 'request_id': 'req-45426ae3-0515-43ae-9dc4-9ace1eb85552'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:21.665194 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:21.688328 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-45426ae3-0515-43ae-9dc4-9ace1eb85552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bd11aa806a6450ea4bd802b932885a2', 'request_id': 'req-45426ae3-0515-43ae-9dc4-9ace1eb85552'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:21.706029 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-45426ae3-0515-43ae-9dc4-9ace1eb85552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bd11aa806a6450ea4bd802b932885a2', 'request_id': 'req-45426ae3-0515-43ae-9dc4-9ace1eb85552'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:21.723824 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-83bb336c-2386-48f8-9bc6-d488da2eb819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1cbbdbdda154fbe942d98160d353b4a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:21.742492 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-83bb336c-2386-48f8-9bc6-d488da2eb819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1cbbdbdda154fbe942d98160d353b4a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:21.746103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-45426ae3-0515-43ae-9dc4-9ace1eb85552 admin admin] The token cache is being invalidate because project 0bd11aa806a6450ea4bd802b932885a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:21.746657 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-45426ae3-0515-43ae-9dc4-9ace1eb85552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:21.748493 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-45426ae3-0515-43ae-9dc4-9ace1eb85552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:21.752865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1002/2024] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:21 2022] DELETE /identity/v3/projects/0bd11aa806a6450ea4bd802b932885a2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:21.757638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45426ae3-0515-43ae-9dc4-9ace1eb85552 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:21.757814 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-83bb336c-2386-48f8-9bc6-d488da2eb819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1cbbdbdda154fbe942d98160d353b4a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:21.758567 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-83bb336c-2386-48f8-9bc6-d488da2eb819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1cbbdbdda154fbe942d98160d353b4a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:21.761715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-45426ae3-0515-43ae-9dc4-9ace1eb85552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:21.786020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-83bb336c-2386-48f8-9bc6-d488da2eb819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1cbbdbdda154fbe942d98160d353b4a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:21.830398 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1023/2025] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:21 2022] DELETE /identity/v3/users/c1cbbdbdda154fbe942d98160d353b4a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:21.836543 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca57fe0-7b92-4e5f-869d-1e04cddf16cc None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:21.836995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca57fe0-7b92-4e5f-869d-1e04cddf16cc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:21.838602 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca57fe0-7b92-4e5f-869d-1e04cddf16cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:21.885743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-eca57fe0-7b92-4e5f-869d-1e04cddf16cc None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:21.889278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-eca57fe0-7b92-4e5f-869d-1e04cddf16cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:21.931116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45426ae3-0515-43ae-9dc4-9ace1eb85552 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:22.017616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1024/2026] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:22.025826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca57fe0-7b92-4e5f-869d-1e04cddf16cc None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:22.028608 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-eca57fe0-7b92-4e5f-869d-1e04cddf16cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:22.057347 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41126d-481d-4554-88e6-0c8a823c8ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:22.058367 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41126d-481d-4554-88e6-0c8a823c8ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:22.058718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41126d-481d-4554-88e6-0c8a823c8ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:22.059066 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41126d-481d-4554-88e6-0c8a823c8ffb admin admin] PATH_INFO: `/v3/users/e0386ba6b8a445ffaa29e80576284185` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:22.060464 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41126d-481d-4554-88e6-0c8a823c8ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0386ba6b8a445ffaa29e80576284185)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:22.062582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41126d-481d-4554-88e6-0c8a823c8ffb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:22.141707 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca57fe0-7b92-4e5f-869d-1e04cddf16cc None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:22.148783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142b2d0-65bb-4ab5-8730-45da2aedb0c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:22.150717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142b2d0-65bb-4ab5-8730-45da2aedb0c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:22.151947 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142b2d0-65bb-4ab5-8730-45da2aedb0c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:22.152464 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142b2d0-65bb-4ab5-8730-45da2aedb0c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:22.162234 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ec41126d-481d-4554-88e6-0c8a823c8ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0386ba6b8a445ffaa29e80576284185'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:22.168611 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142b2d0-65bb-4ab5-8730-45da2aedb0c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:22.170509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142b2d0-65bb-4ab5-8730-45da2aedb0c8 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:22.185635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1025/2027] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:29:22.187571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142b2d0-65bb-4ab5-8730-45da2aedb0c8 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:22.189357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4142b2d0-65bb-4ab5-8730-45da2aedb0c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:22.198864 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ec41126d-481d-4554-88e6-0c8a823c8ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0386ba6b8a445ffaa29e80576284185'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:22.215905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142b2d0-65bb-4ab5-8730-45da2aedb0c8 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:22.221575 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e198ec0-a5a1-4055-bf4f-82c775444a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:22.224029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e198ec0-a5a1-4055-bf4f-82c775444a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:22.224468 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e198ec0-a5a1-4055-bf4f-82c775444a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:22.224777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e198ec0-a5a1-4055-bf4f-82c775444a15 admin admin] PATH_INFO: `/v3/users/69319aa245cd46198f0c771169be49a4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:22.226330 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e198ec0-a5a1-4055-bf4f-82c775444a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69319aa245cd46198f0c771169be49a4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:22.228362 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e198ec0-a5a1-4055-bf4f-82c775444a15 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:22.235502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ec41126d-481d-4554-88e6-0c8a823c8ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0386ba6b8a445ffaa29e80576284185'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:22.237676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ec41126d-481d-4554-88e6-0c8a823c8ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0386ba6b8a445ffaa29e80576284185'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:22.242269 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:22.251443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ec41126d-481d-4554-88e6-0c8a823c8ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0386ba6b8a445ffaa29e80576284185'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:22.270367 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1003/2028] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:21 2022] DELETE /identity/v3/users/e0386ba6b8a445ffaa29e80576284185 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:22.344432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7e198ec0-a5a1-4055-bf4f-82c775444a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69319aa245cd46198f0c771169be49a4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:22.357897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7e198ec0-a5a1-4055-bf4f-82c775444a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69319aa245cd46198f0c771169be49a4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:22.371492 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7e198ec0-a5a1-4055-bf4f-82c775444a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69319aa245cd46198f0c771169be49a4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:22.372335 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7e198ec0-a5a1-4055-bf4f-82c775444a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69319aa245cd46198f0c771169be49a4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:22.389035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7e198ec0-a5a1-4055-bf4f-82c775444a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69319aa245cd46198f0c771169be49a4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:22.397530 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1026/2029] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:22 2022] DELETE /identity/v3/users/69319aa245cd46198f0c771169be49a4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:22.402400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6b276-c581-4628-982d-7fdea734d100 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:22.403610 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6b276-c581-4628-982d-7fdea734d100 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:22.403902 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6b276-c581-4628-982d-7fdea734d100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:22.413464 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:22.434519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-8ed6b276-c581-4628-982d-7fdea734d100 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:22.436022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8ed6b276-c581-4628-982d-7fdea734d100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:22.513333 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1004/2030] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:22.527478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e198ec0-a5a1-4055-bf4f-82c775444a15 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:22.529231 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7e198ec0-a5a1-4055-bf4f-82c775444a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:22.637289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e198ec0-a5a1-4055-bf4f-82c775444a15 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:22.645044 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744f9ad-e3f4-47f4-98cc-0dc70f3b7977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:22.645890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744f9ad-e3f4-47f4-98cc-0dc70f3b7977 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:22.647066 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744f9ad-e3f4-47f4-98cc-0dc70f3b7977 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:22.647354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744f9ad-e3f4-47f4-98cc-0dc70f3b7977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:22.671112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744f9ad-e3f4-47f4-98cc-0dc70f3b7977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:22.673258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744f9ad-e3f4-47f4-98cc-0dc70f3b7977 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:22.726635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1027/2031] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:23.180042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6b276-c581-4628-982d-7fdea734d100 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:23.183645 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8ed6b276-c581-4628-982d-7fdea734d100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:23.202647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6b276-c581-4628-982d-7fdea734d100 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:23.207826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97397ec3-5d70-4c21-a600-6ceac0d5e56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:23.208809 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97397ec3-5d70-4c21-a600-6ceac0d5e56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:23.209008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97397ec3-5d70-4c21-a600-6ceac0d5e56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:23.209272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97397ec3-5d70-4c21-a600-6ceac0d5e56d admin admin] PATH_INFO: `/v3/projects/1d3a2829a2f7410a97246a3f01cf0a0b` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:23.212378 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97397ec3-5d70-4c21-a600-6ceac0d5e56d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3a2829a2f7410a97246a3f01cf0a0b)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:23.213473 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97397ec3-5d70-4c21-a600-6ceac0d5e56d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:23.213602 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744f9ad-e3f4-47f4-98cc-0dc70f3b7977 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:23.214898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6744f9ad-e3f4-47f4-98cc-0dc70f3b7977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:23.238191 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744f9ad-e3f4-47f4-98cc-0dc70f3b7977 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:23.249851 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92c369-622c-4703-86c5-e532e2ca2f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:23.250643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92c369-622c-4703-86c5-e532e2ca2f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:23.250866 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92c369-622c-4703-86c5-e532e2ca2f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:23.251141 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92c369-622c-4703-86c5-e532e2ca2f3c admin admin] PATH_INFO: `/v3/projects/5aed13ac09524a318b227985fc8f061b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:23.252761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92c369-622c-4703-86c5-e532e2ca2f3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aed13ac09524a318b227985fc8f061b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:23.258652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92c369-622c-4703-86c5-e532e2ca2f3c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:23.326559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-97397ec3-5d70-4c21-a600-6ceac0d5e56d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3a2829a2f7410a97246a3f01cf0a0b', 'request_id': 'req-97397ec3-5d70-4c21-a600-6ceac0d5e56d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:23.344435 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9a92c369-622c-4703-86c5-e532e2ca2f3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aed13ac09524a318b227985fc8f061b', 'request_id': 'req-9a92c369-622c-4703-86c5-e532e2ca2f3c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:23.356144 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-97397ec3-5d70-4c21-a600-6ceac0d5e56d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3a2829a2f7410a97246a3f01cf0a0b', 'request_id': 'req-97397ec3-5d70-4c21-a600-6ceac0d5e56d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:23.365273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9a92c369-622c-4703-86c5-e532e2ca2f3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aed13ac09524a318b227985fc8f061b', 'request_id': 'req-9a92c369-622c-4703-86c5-e532e2ca2f3c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:23.370308 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-97397ec3-5d70-4c21-a600-6ceac0d5e56d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3a2829a2f7410a97246a3f01cf0a0b', 'request_id': 'req-97397ec3-5d70-4c21-a600-6ceac0d5e56d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:23.386060 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9a92c369-622c-4703-86c5-e532e2ca2f3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aed13ac09524a318b227985fc8f061b', 'request_id': 'req-9a92c369-622c-4703-86c5-e532e2ca2f3c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:23.391566 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-97397ec3-5d70-4c21-a600-6ceac0d5e56d admin admin] The token cache is being invalidate because project 1d3a2829a2f7410a97246a3f01cf0a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:23.392134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-97397ec3-5d70-4c21-a600-6ceac0d5e56d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:23.393751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-97397ec3-5d70-4c21-a600-6ceac0d5e56d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:23.397917 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1005/2032] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:23 2022] DELETE /identity/v3/projects/1d3a2829a2f7410a97246a3f01cf0a0b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:23.402824 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca3f1-891d-4dea-8f6f-8ab905050fe3 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:23.403446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca3f1-891d-4dea-8f6f-8ab905050fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:23.405325 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca3f1-891d-4dea-8f6f-8ab905050fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:23.411209 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9a92c369-622c-4703-86c5-e532e2ca2f3c admin admin] The token cache is being invalidate because project 5aed13ac09524a318b227985fc8f061b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:23.411697 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9a92c369-622c-4703-86c5-e532e2ca2f3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:23.412423 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9a92c369-622c-4703-86c5-e532e2ca2f3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:23.414709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1028/2033] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:23 2022] DELETE /identity/v3/projects/5aed13ac09524a318b227985fc8f061b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:23.421390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f80df-6b21-4d69-9ae5-d1cb7eef37fc None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:23.421900 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f80df-6b21-4d69-9ae5-d1cb7eef37fc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:23.422285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f80df-6b21-4d69-9ae5-d1cb7eef37fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:23.431911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ee5ca3f1-891d-4dea-8f6f-8ab905050fe3 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:23.433705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ee5ca3f1-891d-4dea-8f6f-8ab905050fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:23.447770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ea6f80df-6b21-4d69-9ae5-d1cb7eef37fc None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:23.449182 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ea6f80df-6b21-4d69-9ae5-d1cb7eef37fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:23.459882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:23.538135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1006/2034] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:23.540061 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c3d51-1221-43a1-affc-94accd8b3b27 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:23.540321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c3d51-1221-43a1-affc-94accd8b3b27 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:23.540550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c3d51-1221-43a1-affc-94accd8b3b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:23.546717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1029/2035] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:23.555339 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e39d2-c373-4464-a113-f7b9c04bdecd None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:23.555339 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e39d2-c373-4464-a113-f7b9c04bdecd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:23.555651 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e39d2-c373-4464-a113-f7b9c04bdecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:23.561355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6a5c3d51-1221-43a1-affc-94accd8b3b27 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:23.562572 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6a5c3d51-1221-43a1-affc-94accd8b3b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:23.575499 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1007/2036] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:23.576916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c3d51-1221-43a1-affc-94accd8b3b27 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:23.587040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-245e39d2-c373-4464-a113-f7b9c04bdecd None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:23.588271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-245e39d2-c373-4464-a113-f7b9c04bdecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:23.594380 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c3d51-1221-43a1-affc-94accd8b3b27 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:23.602984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0f2d9-bcc5-49a1-88dd-49c2d6467bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:23.604047 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0f2d9-bcc5-49a1-88dd-49c2d6467bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:23.604330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0f2d9-bcc5-49a1-88dd-49c2d6467bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:23.604705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0f2d9-bcc5-49a1-88dd-49c2d6467bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:23.605629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0f2d9-bcc5-49a1-88dd-49c2d6467bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:23.606113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0f2d9-bcc5-49a1-88dd-49c2d6467bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:23.608116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0f2d9-bcc5-49a1-88dd-49c2d6467bd2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:23.613026 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1030/2037] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:23.621565 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e39d2-c373-4464-a113-f7b9c04bdecd None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:23.627425 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1008/2038] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:29:23.628474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0f2d9-bcc5-49a1-88dd-49c2d6467bd2 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:23.641716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0f2d9-bcc5-49a1-88dd-49c2d6467bd2 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:23.645565 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e39d2-c373-4464-a113-f7b9c04bdecd None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:23.648198 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e7e6b-bbe3-441d-b058-a0aa75317247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:23.648913 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e7e6b-bbe3-441d-b058-a0aa75317247 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:23.649192 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e7e6b-bbe3-441d-b058-a0aa75317247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:23.649602 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e7e6b-bbe3-441d-b058-a0aa75317247 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:23.650302 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e7e6b-bbe3-441d-b058-a0aa75317247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:23.652107 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9841a1-871b-463a-b34f-b0748a3a1918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:23.652415 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e7e6b-bbe3-441d-b058-a0aa75317247 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:23.653510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9841a1-871b-463a-b34f-b0748a3a1918 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:23.654214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9841a1-871b-463a-b34f-b0748a3a1918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:23.654503 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9841a1-871b-463a-b34f-b0748a3a1918 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:23.655353 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9841a1-871b-463a-b34f-b0748a3a1918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:23.655776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9841a1-871b-463a-b34f-b0748a3a1918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:23.658623 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:23.661690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9841a1-871b-463a-b34f-b0748a3a1918 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:23.681464 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1031/2039] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:29:23.685521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9841a1-871b-463a-b34f-b0748a3a1918 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:23.700093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9841a1-871b-463a-b34f-b0748a3a1918 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:23.716127 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f34ec-e8ac-4201-b2cb-41560d523104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:23.716882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f34ec-e8ac-4201-b2cb-41560d523104 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:23.717162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f34ec-e8ac-4201-b2cb-41560d523104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:23.717436 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f34ec-e8ac-4201-b2cb-41560d523104 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:23.718403 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f34ec-e8ac-4201-b2cb-41560d523104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:23.720879 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f34ec-e8ac-4201-b2cb-41560d523104 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:23.731368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1009/2040] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:23 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:23.736103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e7e6b-bbe3-441d-b058-a0aa75317247 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:23.776232 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1032/2041] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:23 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:23.779972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f34ec-e8ac-4201-b2cb-41560d523104 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:23.863934 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e7e6b-bbe3-441d-b058-a0aa75317247 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:23.868842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af692f5-e29d-4342-82f3-5f9f2f7c0426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:23.869522 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af692f5-e29d-4342-82f3-5f9f2f7c0426 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:23.870221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af692f5-e29d-4342-82f3-5f9f2f7c0426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:23.870221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af692f5-e29d-4342-82f3-5f9f2f7c0426 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:23.871521 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af692f5-e29d-4342-82f3-5f9f2f7c0426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:23.873600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af692f5-e29d-4342-82f3-5f9f2f7c0426 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:23.886463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f34ec-e8ac-4201-b2cb-41560d523104 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:23.896154 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac088e-faed-47fa-a18a-75bac7b3d296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:23.896874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac088e-faed-47fa-a18a-75bac7b3d296 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:23.897151 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac088e-faed-47fa-a18a-75bac7b3d296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:23.897419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac088e-faed-47fa-a18a-75bac7b3d296 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:23.898139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac088e-faed-47fa-a18a-75bac7b3d296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:23.900061 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac088e-faed-47fa-a18a-75bac7b3d296 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:23.904694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1010/2042] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:23 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:23.909175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af692f5-e29d-4342-82f3-5f9f2f7c0426 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:23.921422 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7af692f5-e29d-4342-82f3-5f9f2f7c0426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:23.944327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1033/2043] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:23 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:29:23.944327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac088e-faed-47fa-a18a-75bac7b3d296 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:23.953435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af692f5-e29d-4342-82f3-5f9f2f7c0426 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:23.961637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac088e-faed-47fa-a18a-75bac7b3d296 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:23.965327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84118e-5360-45d8-b859-2eeffa18a4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:23.966486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84118e-5360-45d8-b859-2eeffa18a4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:23.966766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84118e-5360-45d8-b859-2eeffa18a4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:23.967036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84118e-5360-45d8-b859-2eeffa18a4fc admin admin] PATH_INFO: `/v3/projects/93365d44e15b4338b269ea9e14ea0b2b` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:23.968973 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84118e-5360-45d8-b859-2eeffa18a4fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=93365d44e15b4338b269ea9e14ea0b2b)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:23.972117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84118e-5360-45d8-b859-2eeffa18a4fc admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:23.977928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c4109-88a6-41fe-8166-2f3686a5e53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:23.978661 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c4109-88a6-41fe-8166-2f3686a5e53b admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:23.978922 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c4109-88a6-41fe-8166-2f3686a5e53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:23.979194 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c4109-88a6-41fe-8166-2f3686a5e53b admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:23.980053 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c4109-88a6-41fe-8166-2f3686a5e53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:23.981623 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c4109-88a6-41fe-8166-2f3686a5e53b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:24.001855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1034/2044] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:24.007309 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c4109-88a6-41fe-8166-2f3686a5e53b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:24.027625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c4109-88a6-41fe-8166-2f3686a5e53b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:24.037312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071157a-56e5-4684-9429-a2326e3785ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:24.038196 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071157a-56e5-4684-9429-a2326e3785ac admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:24.039080 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071157a-56e5-4684-9429-a2326e3785ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:24.039366 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071157a-56e5-4684-9429-a2326e3785ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:24.040338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071157a-56e5-4684-9429-a2326e3785ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:24.042667 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071157a-56e5-4684-9429-a2326e3785ac admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:24.062991 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1035/2045] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:24.064178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071157a-56e5-4684-9429-a2326e3785ac admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:24.074130 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6f84118e-5360-45d8-b859-2eeffa18a4fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93365d44e15b4338b269ea9e14ea0b2b', 'request_id': 'req-6f84118e-5360-45d8-b859-2eeffa18a4fc'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:24.081633 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6f84118e-5360-45d8-b859-2eeffa18a4fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93365d44e15b4338b269ea9e14ea0b2b', 'request_id': 'req-6f84118e-5360-45d8-b859-2eeffa18a4fc'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:24.088362 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071157a-56e5-4684-9429-a2326e3785ac admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:24.089550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6f84118e-5360-45d8-b859-2eeffa18a4fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93365d44e15b4338b269ea9e14ea0b2b', 'request_id': 'req-6f84118e-5360-45d8-b859-2eeffa18a4fc'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:24.124306 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6f84118e-5360-45d8-b859-2eeffa18a4fc admin admin] The token cache is being invalidate because project 93365d44e15b4338b269ea9e14ea0b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:24.124638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6f84118e-5360-45d8-b859-2eeffa18a4fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:24.127081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6f84118e-5360-45d8-b859-2eeffa18a4fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:24.131282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1011/2046] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:23 2022] DELETE /identity/v3/projects/93365d44e15b4338b269ea9e14ea0b2b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:24.136938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84118e-5360-45d8-b859-2eeffa18a4fc admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:24.138530 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6f84118e-5360-45d8-b859-2eeffa18a4fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:24.141676 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:24.179578 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820e50e-df55-403b-9be9-741a195daa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:24.180159 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820e50e-df55-403b-9be9-741a195daa99 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:24.180445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820e50e-df55-403b-9be9-741a195daa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:24.180754 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820e50e-df55-403b-9be9-741a195daa99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:24.181495 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820e50e-df55-403b-9be9-741a195daa99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:24.183841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820e50e-df55-403b-9be9-741a195daa99 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:24.198719 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1036/2047] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:24.199765 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820e50e-df55-403b-9be9-741a195daa99 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:24.203186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8820e50e-df55-403b-9be9-741a195daa99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:24.234497 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84118e-5360-45d8-b859-2eeffa18a4fc admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:24.237500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820e50e-df55-403b-9be9-741a195daa99 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:24.240002 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27c819-6d6f-48a1-87cc-5bfd69d8b551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:24.241884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27c819-6d6f-48a1-87cc-5bfd69d8b551 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:24.242236 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27c819-6d6f-48a1-87cc-5bfd69d8b551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:24.242586 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27c819-6d6f-48a1-87cc-5bfd69d8b551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:24.243385 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0360bf-a7f5-4731-b402-e3d27df32a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:24.243558 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27c819-6d6f-48a1-87cc-5bfd69d8b551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:24.244289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0360bf-a7f5-4731-b402-e3d27df32a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:24.244773 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0360bf-a7f5-4731-b402-e3d27df32a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:24.245047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0360bf-a7f5-4731-b402-e3d27df32a45 admin admin] PATH_INFO: `/v3/users/86d58c9a14bb4a17b0b9d96c1d9d011e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:24.245454 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27c819-6d6f-48a1-87cc-5bfd69d8b551 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:24.247694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:24.248902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0360bf-a7f5-4731-b402-e3d27df32a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d58c9a14bb4a17b0b9d96c1d9d011e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:24.250876 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0360bf-a7f5-4731-b402-e3d27df32a45 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:24.269927 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1012/2048] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:24.270965 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27c819-6d6f-48a1-87cc-5bfd69d8b551 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:24.273663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0b27c819-6d6f-48a1-87cc-5bfd69d8b551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:24.286819 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27c819-6d6f-48a1-87cc-5bfd69d8b551 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:24.291867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3e560-c101-4193-a6c5-746fa1c00e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:24.293114 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3e560-c101-4193-a6c5-746fa1c00e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:24.293408 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3e560-c101-4193-a6c5-746fa1c00e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:24.293757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3e560-c101-4193-a6c5-746fa1c00e84 admin admin] PATH_INFO: `/v3/projects/e4f6bba638da445c9e04acacd9f69763/users/1bac4832e25c4c1c855a51bfa8ac36d7/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:24.311880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3e560-c101-4193-a6c5-746fa1c00e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4f6bba638da445c9e04acacd9f69763, user_id=1bac4832e25c4c1c855a51bfa8ac36d7, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:24.315292 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3e560-c101-4193-a6c5-746fa1c00e84 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:24.341364 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3f0360bf-a7f5-4731-b402-e3d27df32a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d58c9a14bb4a17b0b9d96c1d9d011e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:24.341582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1013/2049] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:24 2022] PUT /identity/v3/projects/e4f6bba638da445c9e04acacd9f69763/users/1bac4832e25c4c1c855a51bfa8ac36d7/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:24.342301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3e560-c101-4193-a6c5-746fa1c00e84 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:24.358572 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3f0360bf-a7f5-4731-b402-e3d27df32a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d58c9a14bb4a17b0b9d96c1d9d011e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:24.379428 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3f0360bf-a7f5-4731-b402-e3d27df32a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d58c9a14bb4a17b0b9d96c1d9d011e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:24.380253 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3f0360bf-a7f5-4731-b402-e3d27df32a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d58c9a14bb4a17b0b9d96c1d9d011e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:24.399542 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3f0360bf-a7f5-4731-b402-e3d27df32a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d58c9a14bb4a17b0b9d96c1d9d011e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:24.407035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1037/2050] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:24 2022] DELETE /identity/v3/users/86d58c9a14bb4a17b0b9d96c1d9d011e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:24.411308 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbc66b-f513-4c18-a110-c4ae43d3c93c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:24.411593 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbc66b-f513-4c18-a110-c4ae43d3c93c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:24.411918 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbc66b-f513-4c18-a110-c4ae43d3c93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:24.446235 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3e560-c101-4193-a6c5-746fa1c00e84 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:24.449049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-93cbc66b-f513-4c18-a110-c4ae43d3c93c None None] MFA Rules not processed for user `1bac4832e25c4c1c855a51bfa8ac36d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:24.450577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-93cbc66b-f513-4c18-a110-c4ae43d3c93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:24.514963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bad18-ab37-452b-ab55-300edf0d718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:24.516167 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bad18-ab37-452b-ab55-300edf0d718f admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:24.516257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bad18-ab37-452b-ab55-300edf0d718f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:24.516614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bad18-ab37-452b-ab55-300edf0d718f admin admin] PATH_INFO: `/v3/projects/1edf83b692d74c48ae620474c413f8c5/users/04f813bc6ffb49af9b14f7c7eb9dba44/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:24.538414 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bad18-ab37-452b-ab55-300edf0d718f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1edf83b692d74c48ae620474c413f8c5, user_id=04f813bc6ffb49af9b14f7c7eb9dba44, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:24.541394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bad18-ab37-452b-ab55-300edf0d718f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:24.575129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1014/2051] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:24 2022] PUT /identity/v3/projects/1edf83b692d74c48ae620474c413f8c5/users/04f813bc6ffb49af9b14f7c7eb9dba44/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:24.576615 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1038/2052] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:24.577696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7dfc1-71cb-40da-8a2e-282a26454c8e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:24.577993 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7dfc1-71cb-40da-8a2e-282a26454c8e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:24.578270 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7dfc1-71cb-40da-8a2e-282a26454c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:24.581145 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbc66b-f513-4c18-a110-c4ae43d3c93c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:24.583825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-93cbc66b-f513-4c18-a110-c4ae43d3c93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:24.601881 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbc66b-f513-4c18-a110-c4ae43d3c93c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:24.617386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-50d7dfc1-71cb-40da-8a2e-282a26454c8e None None] MFA Rules not processed for user `04f813bc6ffb49af9b14f7c7eb9dba44`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:24.618745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-50d7dfc1-71cb-40da-8a2e-282a26454c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:24.669467 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:24.693078 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:24.711274 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731a33f-4be9-4997-83e9-58ecb5a31361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:24.712144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731a33f-4be9-4997-83e9-58ecb5a31361 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:24.712431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731a33f-4be9-4997-83e9-58ecb5a31361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:24.713003 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731a33f-4be9-4997-83e9-58ecb5a31361 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:24.714576 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731a33f-4be9-4997-83e9-58ecb5a31361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:24.719903 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731a33f-4be9-4997-83e9-58ecb5a31361 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:24.721655 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1015/2053] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:24.738986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7dfc1-71cb-40da-8a2e-282a26454c8e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:24.740946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-50d7dfc1-71cb-40da-8a2e-282a26454c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:24.779089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1039/2054] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:24 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:24.780791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731a33f-4be9-4997-83e9-58ecb5a31361 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:24.828175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7dfc1-71cb-40da-8a2e-282a26454c8e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:24.907518 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731a33f-4be9-4997-83e9-58ecb5a31361 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:24.918055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137225bc-0fa0-4493-941a-35a3b21d060b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:24.919003 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137225bc-0fa0-4493-941a-35a3b21d060b admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:24.919453 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137225bc-0fa0-4493-941a-35a3b21d060b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:24.919869 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137225bc-0fa0-4493-941a-35a3b21d060b admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:24.921934 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137225bc-0fa0-4493-941a-35a3b21d060b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:24.922195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b317c95-d059-4dab-9595-50456298b28f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:24.923482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b317c95-d059-4dab-9595-50456298b28f service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:24.924042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b317c95-d059-4dab-9595-50456298b28f service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:24.925414 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b317c95-d059-4dab-9595-50456298b28f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:24.927202 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137225bc-0fa0-4493-941a-35a3b21d060b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:24.963588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1040/2055] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:24 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:24.967934 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137225bc-0fa0-4493-941a-35a3b21d060b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:24.990374 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137225bc-0fa0-4493-941a-35a3b21d060b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:24.999689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595c48b-7195-4bb6-890a-7f6cbaa75889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:25.001696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595c48b-7195-4bb6-890a-7f6cbaa75889 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:25.002401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595c48b-7195-4bb6-890a-7f6cbaa75889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:25.003241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595c48b-7195-4bb6-890a-7f6cbaa75889 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:25.005313 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595c48b-7195-4bb6-890a-7f6cbaa75889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:25.008156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595c48b-7195-4bb6-890a-7f6cbaa75889 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:25.027273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b317c95-d059-4dab-9595-50456298b28f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:25.028773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b317c95-d059-4dab-9595-50456298b28f service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:25.041199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1041/2056] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:25.044050 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595c48b-7195-4bb6-890a-7f6cbaa75889 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:25.060384 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1016/2057] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:25.073368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595c48b-7195-4bb6-890a-7f6cbaa75889 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:25.077559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b317c95-d059-4dab-9595-50456298b28f service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:25.082568 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3f722-e99c-46dd-a6ae-bd1c2eb638bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:25.084727 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3f722-e99c-46dd-a6ae-bd1c2eb638bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:25.084727 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3f722-e99c-46dd-a6ae-bd1c2eb638bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:25.084980 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3f722-e99c-46dd-a6ae-bd1c2eb638bf admin admin] PATH_INFO: `/v3/projects/ea55ea448f854ee0a6b029c7da8c2665/users/acb450b4b19540578dbff482345fdbb3/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:25.086261 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6b317c95-d059-4dab-9595-50456298b28f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:25.106010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b317c95-d059-4dab-9595-50456298b28f service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:25.107652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3f722-e99c-46dd-a6ae-bd1c2eb638bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea55ea448f854ee0a6b029c7da8c2665, user_id=acb450b4b19540578dbff482345fdbb3, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:25.112148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3f722-e99c-46dd-a6ae-bd1c2eb638bf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:25.113948 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2844dd4-819a-4c16-b579-952bc3829561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:25.115084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2844dd4-819a-4c16-b579-952bc3829561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:25.115577 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2844dd4-819a-4c16-b579-952bc3829561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:25.116043 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2844dd4-819a-4c16-b579-952bc3829561 admin admin] PATH_INFO: `/v3/users/04f813bc6ffb49af9b14f7c7eb9dba44` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:25.117520 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2844dd4-819a-4c16-b579-952bc3829561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f813bc6ffb49af9b14f7c7eb9dba44)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:25.119964 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2844dd4-819a-4c16-b579-952bc3829561 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:25.146563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1042/2058] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:25 2022] PUT /identity/v3/projects/ea55ea448f854ee0a6b029c7da8c2665/users/acb450b4b19540578dbff482345fdbb3/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:25.147813 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3f722-e99c-46dd-a6ae-bd1c2eb638bf admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:25.152140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9bf3f722-e99c-46dd-a6ae-bd1c2eb638bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:25.255246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f2844dd4-819a-4c16-b579-952bc3829561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f813bc6ffb49af9b14f7c7eb9dba44'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:25.267807 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f2844dd4-819a-4c16-b579-952bc3829561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f813bc6ffb49af9b14f7c7eb9dba44'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:25.274015 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:25.287668 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f2844dd4-819a-4c16-b579-952bc3829561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f813bc6ffb49af9b14f7c7eb9dba44'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:25.288789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f2844dd4-819a-4c16-b579-952bc3829561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f813bc6ffb49af9b14f7c7eb9dba44'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:25.294806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3f722-e99c-46dd-a6ae-bd1c2eb638bf admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:25.302645 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f2844dd4-819a-4c16-b579-952bc3829561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f813bc6ffb49af9b14f7c7eb9dba44'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:25.303558 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40d246-253d-4014-982c-330139e79406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:25.312724 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40d246-253d-4014-982c-330139e79406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:25.312829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1017/2059] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:25 2022] DELETE /identity/v3/users/04f813bc6ffb49af9b14f7c7eb9dba44 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:25.313231 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40d246-253d-4014-982c-330139e79406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:25.313564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2844dd4-819a-4c16-b579-952bc3829561 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:25.313674 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40d246-253d-4014-982c-330139e79406 admin admin] PATH_INFO: `/v3/projects/3a0e91c14fed42cf97efaac2769dda1d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:25.315829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40d246-253d-4014-982c-330139e79406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0e91c14fed42cf97efaac2769dda1d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:25.316883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f2844dd4-819a-4c16-b579-952bc3829561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:25.318950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40d246-253d-4014-982c-330139e79406 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:25.352396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:25.397319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bd40d246-253d-4014-982c-330139e79406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0e91c14fed42cf97efaac2769dda1d', 'request_id': 'req-bd40d246-253d-4014-982c-330139e79406'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:25.398591 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2844dd4-819a-4c16-b579-952bc3829561 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:25.413886 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bd40d246-253d-4014-982c-330139e79406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0e91c14fed42cf97efaac2769dda1d', 'request_id': 'req-bd40d246-253d-4014-982c-330139e79406'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:25.426874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bd40d246-253d-4014-982c-330139e79406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0e91c14fed42cf97efaac2769dda1d', 'request_id': 'req-bd40d246-253d-4014-982c-330139e79406'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:25.442825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bd40d246-253d-4014-982c-330139e79406 admin admin] The token cache is being invalidate because project 3a0e91c14fed42cf97efaac2769dda1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:25.442825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bd40d246-253d-4014-982c-330139e79406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:25.443480 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bd40d246-253d-4014-982c-330139e79406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:25.445265 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1043/2060] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:25 2022] DELETE /identity/v3/projects/3a0e91c14fed42cf97efaac2769dda1d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:25.446929 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fae9d3-3d5d-4eb6-9dcd-9ee4cb06f930 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:25.447312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fae9d3-3d5d-4eb6-9dcd-9ee4cb06f930 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:25.450569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fae9d3-3d5d-4eb6-9dcd-9ee4cb06f930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:25.491572 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e3fae9d3-3d5d-4eb6-9dcd-9ee4cb06f930 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:25.493970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e3fae9d3-3d5d-4eb6-9dcd-9ee4cb06f930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:25.495606 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4d65a-462f-4d52-9291-3c50b947b14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:25.496414 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4d65a-462f-4d52-9291-3c50b947b14b admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:25.496622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4d65a-462f-4d52-9291-3c50b947b14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:25.496889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4d65a-462f-4d52-9291-3c50b947b14b admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:25.497747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4d65a-462f-4d52-9291-3c50b947b14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:25.499832 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4d65a-462f-4d52-9291-3c50b947b14b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:25.507434 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1044/2061] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:25.509466 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d170d-e740-48a7-9303-d398fe80c551 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:25.510006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d170d-e740-48a7-9303-d398fe80c551 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:25.512416 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1018/2062] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:25.516453 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4d65a-462f-4d52-9291-3c50b947b14b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:25.517755 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d170d-e740-48a7-9303-d398fe80c551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:25.518777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b6e4d65a-462f-4d52-9291-3c50b947b14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:25.536788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4d65a-462f-4d52-9291-3c50b947b14b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:25.546791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae7dbf-773c-46ac-8a6a-91682f88259c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:25.547712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae7dbf-773c-46ac-8a6a-91682f88259c admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:25.548003 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae7dbf-773c-46ac-8a6a-91682f88259c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:25.548279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae7dbf-773c-46ac-8a6a-91682f88259c admin admin] PATH_INFO: `/v3/projects/ea55ea448f854ee0a6b029c7da8c2665/users/acb450b4b19540578dbff482345fdbb3/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:25.552051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae7dbf-773c-46ac-8a6a-91682f88259c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea55ea448f854ee0a6b029c7da8c2665, user_id=acb450b4b19540578dbff482345fdbb3, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:25.554746 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae7dbf-773c-46ac-8a6a-91682f88259c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:25.558701 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4b2d170d-e740-48a7-9303-d398fe80c551 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:25.559901 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4b2d170d-e740-48a7-9303-d398fe80c551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:25.578365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1019/2063] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:25 2022] PUT /identity/v3/projects/ea55ea448f854ee0a6b029c7da8c2665/users/acb450b4b19540578dbff482345fdbb3/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:25.579370 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae7dbf-773c-46ac-8a6a-91682f88259c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:25.581258 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-89ae7dbf-773c-46ac-8a6a-91682f88259c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:25.643355 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1045/2064] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:25.644551 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3507c2-8dbb-4f3c-9f98-5ba4620951f6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:25.644845 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3507c2-8dbb-4f3c-9f98-5ba4620951f6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:25.645116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3507c2-8dbb-4f3c-9f98-5ba4620951f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:25.649503 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae7dbf-773c-46ac-8a6a-91682f88259c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:25.660169 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25570df0-cb5c-4561-834d-3bf91bc6568f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:25.660870 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25570df0-cb5c-4561-834d-3bf91bc6568f service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:25.661152 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25570df0-cb5c-4561-834d-3bf91bc6568f service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:25.661425 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25570df0-cb5c-4561-834d-3bf91bc6568f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:25.675020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9a3507c2-8dbb-4f3c-9f98-5ba4620951f6 None None] MFA Rules not processed for user `acb450b4b19540578dbff482345fdbb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:25.681446 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9a3507c2-8dbb-4f3c-9f98-5ba4620951f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:25.683016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25570df0-cb5c-4561-834d-3bf91bc6568f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:25.687372 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25570df0-cb5c-4561-834d-3bf91bc6568f service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:25.701093 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1020/2065] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:25.702632 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3d864-a2c4-4512-99a5-a23f4f7023f7 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:25.702929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3d864-a2c4-4512-99a5-a23f4f7023f7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:25.703208 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3d864-a2c4-4512-99a5-a23f4f7023f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:25.717733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:25.726193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-fcb3d864-a2c4-4512-99a5-a23f4f7023f7 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:25.727768 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fcb3d864-a2c4-4512-99a5-a23f4f7023f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:25.739714 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1021/2066] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:25.744353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3d864-a2c4-4512-99a5-a23f4f7023f7 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:25.766512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3d864-a2c4-4512-99a5-a23f4f7023f7 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:25.779861 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce60c7f-09aa-4496-8715-a804fc0fe0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:25.782810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce60c7f-09aa-4496-8715-a804fc0fe0cf admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:25.784761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce60c7f-09aa-4496-8715-a804fc0fe0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:25.786785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce60c7f-09aa-4496-8715-a804fc0fe0cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:25.788058 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce60c7f-09aa-4496-8715-a804fc0fe0cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:25.789790 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce60c7f-09aa-4496-8715-a804fc0fe0cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:25.791914 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce60c7f-09aa-4496-8715-a804fc0fe0cf admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:25.824386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1022/2067] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:29:25.830657 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce60c7f-09aa-4496-8715-a804fc0fe0cf admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:25.845804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1046/2068] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:25.853521 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce60c7f-09aa-4496-8715-a804fc0fe0cf admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:25.860992 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3507c2-8dbb-4f3c-9f98-5ba4620951f6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:25.862895 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9a3507c2-8dbb-4f3c-9f98-5ba4620951f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:25.866502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa49a7d-c2cd-4de9-8f0b-3b0838bdf470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:25.867531 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa49a7d-c2cd-4de9-8f0b-3b0838bdf470 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:25.869431 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa49a7d-c2cd-4de9-8f0b-3b0838bdf470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:25.869780 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa49a7d-c2cd-4de9-8f0b-3b0838bdf470 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:25.870671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa49a7d-c2cd-4de9-8f0b-3b0838bdf470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:25.873359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa49a7d-c2cd-4de9-8f0b-3b0838bdf470 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:25.909214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:25.937913 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1023/2069] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:25 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:25.941623 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa49a7d-c2cd-4de9-8f0b-3b0838bdf470 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:25.987345 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3507c2-8dbb-4f3c-9f98-5ba4620951f6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:26.096044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa49a7d-c2cd-4de9-8f0b-3b0838bdf470 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:26.112324 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e0e77-a01a-4b55-9c97-43cae5e14c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:26.113296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e0e77-a01a-4b55-9c97-43cae5e14c6a admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:26.113644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e0e77-a01a-4b55-9c97-43cae5e14c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:26.113999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e0e77-a01a-4b55-9c97-43cae5e14c6a admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:26.114800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e0e77-a01a-4b55-9c97-43cae5e14c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:26.117537 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e0e77-a01a-4b55-9c97-43cae5e14c6a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:26.139681 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66dd4c-3806-47e5-b27f-8f58c3bcbc5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:26.140363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66dd4c-3806-47e5-b27f-8f58c3bcbc5f service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:26.140704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66dd4c-3806-47e5-b27f-8f58c3bcbc5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:26.140964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66dd4c-3806-47e5-b27f-8f58c3bcbc5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:26.147038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dd66dd4c-3806-47e5-b27f-8f58c3bcbc5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:26.162868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1024/2070] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:25 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:29:26.166700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e0e77-a01a-4b55-9c97-43cae5e14c6a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:26.177287 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e0e77-a01a-4b55-9c97-43cae5e14c6a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:26.182927 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b524874-0dec-48c1-bd69-c53a7d783cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:26.183736 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b524874-0dec-48c1-bd69-c53a7d783cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:26.184019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b524874-0dec-48c1-bd69-c53a7d783cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:26.184290 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b524874-0dec-48c1-bd69-c53a7d783cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:26.185066 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b524874-0dec-48c1-bd69-c53a7d783cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:26.187178 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b524874-0dec-48c1-bd69-c53a7d783cf8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:26.203987 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1025/2071] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:29:26.205829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b524874-0dec-48c1-bd69-c53a7d783cf8 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:26.216783 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b524874-0dec-48c1-bd69-c53a7d783cf8 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:26.224840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26fa80-31a0-4cd7-812a-eee4fb817268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:26.225638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26fa80-31a0-4cd7-812a-eee4fb817268 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:26.225778 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26fa80-31a0-4cd7-812a-eee4fb817268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:26.226050 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26fa80-31a0-4cd7-812a-eee4fb817268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:26.226777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26fa80-31a0-4cd7-812a-eee4fb817268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:26.229922 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26fa80-31a0-4cd7-812a-eee4fb817268 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:26.248792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1026/2072] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:26.251027 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26fa80-31a0-4cd7-812a-eee4fb817268 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:26.253955 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8d26fa80-31a0-4cd7-812a-eee4fb817268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:26.272153 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26fa80-31a0-4cd7-812a-eee4fb817268 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:26.279690 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f0428-8c18-4846-91c2-ba5cc5836d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:26.281037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f0428-8c18-4846-91c2-ba5cc5836d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:26.281702 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f0428-8c18-4846-91c2-ba5cc5836d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:26.282185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f0428-8c18-4846-91c2-ba5cc5836d68 admin admin] PATH_INFO: `/v3/projects/1edf83b692d74c48ae620474c413f8c5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:26.283935 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f0428-8c18-4846-91c2-ba5cc5836d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1edf83b692d74c48ae620474c413f8c5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:26.285625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66dd4c-3806-47e5-b27f-8f58c3bcbc5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:26.286324 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f0428-8c18-4846-91c2-ba5cc5836d68 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:26.287075 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66dd4c-3806-47e5-b27f-8f58c3bcbc5f service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:26.297281 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1047/2073] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:26.298405 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66dd4c-3806-47e5-b27f-8f58c3bcbc5f service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:26.312554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66dd4c-3806-47e5-b27f-8f58c3bcbc5f service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:26.317666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24961d19-91ca-4c4f-a186-a6b5721e5e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:26.318831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24961d19-91ca-4c4f-a186-a6b5721e5e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:26.319476 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24961d19-91ca-4c4f-a186-a6b5721e5e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:26.319597 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24961d19-91ca-4c4f-a186-a6b5721e5e76 admin admin] PATH_INFO: `/v3/projects/be45ea581aaf45f98d072d2b4ac4e4cb/users/cd356b025c6041d8bcb0dd2b7d8b3c06/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:26.339712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24961d19-91ca-4c4f-a186-a6b5721e5e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be45ea581aaf45f98d072d2b4ac4e4cb, user_id=cd356b025c6041d8bcb0dd2b7d8b3c06, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:26.343811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24961d19-91ca-4c4f-a186-a6b5721e5e76 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:26.367261 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1048/2074] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:26 2022] PUT /identity/v3/projects/be45ea581aaf45f98d072d2b4ac4e4cb/users/cd356b025c6041d8bcb0dd2b7d8b3c06/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:26.377608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-fa2f0428-8c18-4846-91c2-ba5cc5836d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1edf83b692d74c48ae620474c413f8c5', 'request_id': 'req-fa2f0428-8c18-4846-91c2-ba5cc5836d68'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:26.379413 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5bd1e-4f69-4cf5-91ee-9a3c70b3add4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:26.379703 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5bd1e-4f69-4cf5-91ee-9a3c70b3add4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:26.379981 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5bd1e-4f69-4cf5-91ee-9a3c70b3add4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:26.399214 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-fa2f0428-8c18-4846-91c2-ba5cc5836d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1edf83b692d74c48ae620474c413f8c5', 'request_id': 'req-fa2f0428-8c18-4846-91c2-ba5cc5836d68'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:26.420980 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-eaf5bd1e-4f69-4cf5-91ee-9a3c70b3add4 None None] MFA Rules not processed for user `cd356b025c6041d8bcb0dd2b7d8b3c06`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:26.422279 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-eaf5bd1e-4f69-4cf5-91ee-9a3c70b3add4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:26.424062 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-fa2f0428-8c18-4846-91c2-ba5cc5836d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1edf83b692d74c48ae620474c413f8c5', 'request_id': 'req-fa2f0428-8c18-4846-91c2-ba5cc5836d68'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:26.447641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-fa2f0428-8c18-4846-91c2-ba5cc5836d68 admin admin] The token cache is being invalidate because project 1edf83b692d74c48ae620474c413f8c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:26.448814 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-fa2f0428-8c18-4846-91c2-ba5cc5836d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:26.450341 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-fa2f0428-8c18-4846-91c2-ba5cc5836d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:26.453380 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1027/2075] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:26 2022] DELETE /identity/v3/projects/1edf83b692d74c48ae620474c413f8c5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:26.463260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2e60b-4d5f-468f-8de0-f17e6915c78d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:26.463260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2e60b-4d5f-468f-8de0-f17e6915c78d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:26.463260 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2e60b-4d5f-468f-8de0-f17e6915c78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:26.495154 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-88e2e60b-4d5f-468f-8de0-f17e6915c78d None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:26.496782 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-88e2e60b-4d5f-468f-8de0-f17e6915c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:26.521275 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:26.565249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1049/2076] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:26.571947 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5bd1e-4f69-4cf5-91ee-9a3c70b3add4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:26.576411 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-eaf5bd1e-4f69-4cf5-91ee-9a3c70b3add4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:26.586769 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:26.650557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1028/2077] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:26.652963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab954f5-4c65-434f-a7ee-e82346372688 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:26.653302 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab954f5-4c65-434f-a7ee-e82346372688 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:26.653628 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab954f5-4c65-434f-a7ee-e82346372688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:26.702363 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-eab954f5-4c65-434f-a7ee-e82346372688 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:26.705444 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-eab954f5-4c65-434f-a7ee-e82346372688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:26.734547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1029/2078] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:26.737467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab954f5-4c65-434f-a7ee-e82346372688 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:26.779222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab954f5-4c65-434f-a7ee-e82346372688 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:26.800888 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd94719-6fbf-4ca8-a046-95837ca326f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:26.801575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd94719-6fbf-4ca8-a046-95837ca326f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:26.801871 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd94719-6fbf-4ca8-a046-95837ca326f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:26.803307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd94719-6fbf-4ca8-a046-95837ca326f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:26.806016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd94719-6fbf-4ca8-a046-95837ca326f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:26.809023 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd94719-6fbf-4ca8-a046-95837ca326f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:26.813520 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5bd1e-4f69-4cf5-91ee-9a3c70b3add4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:26.816251 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd94719-6fbf-4ca8-a046-95837ca326f5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:26.836337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60241560-d8fe-4278-a8e6-9b9c4188dc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:26.837623 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60241560-d8fe-4278-a8e6-9b9c4188dc91 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:26.838149 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60241560-d8fe-4278-a8e6-9b9c4188dc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:26.838820 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60241560-d8fe-4278-a8e6-9b9c4188dc91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:26.840569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60241560-d8fe-4278-a8e6-9b9c4188dc91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:26.848925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60241560-d8fe-4278-a8e6-9b9c4188dc91 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:26.864335 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1030/2079] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:29:26.870914 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd94719-6fbf-4ca8-a046-95837ca326f5 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:26.903245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd94719-6fbf-4ca8-a046-95837ca326f5 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:26.921333 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf961dc5-e38f-4569-8129-8c2c6b137cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:26.922028 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf961dc5-e38f-4569-8129-8c2c6b137cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:26.922307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf961dc5-e38f-4569-8129-8c2c6b137cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:26.922581 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf961dc5-e38f-4569-8129-8c2c6b137cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:26.923301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf961dc5-e38f-4569-8129-8c2c6b137cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:26.925455 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf961dc5-e38f-4569-8129-8c2c6b137cb1 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:26.948359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1050/2080] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:26 2022] POST /identity/v3/projects => generated 379 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:26.949468 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60241560-d8fe-4278-a8e6-9b9c4188dc91 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:26.989596 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1031/2081] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:26 2022] POST /identity/v3/projects => generated 361 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:26.991360 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf961dc5-e38f-4569-8129-8c2c6b137cb1 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:27.051348 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60241560-d8fe-4278-a8e6-9b9c4188dc91 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:27.089900 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf961dc5-e38f-4569-8129-8c2c6b137cb1 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:27.099141 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd37794-559d-4166-9367-b557f77d0cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:27.099854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd37794-559d-4166-9367-b557f77d0cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:27.100598 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd37794-559d-4166-9367-b557f77d0cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:27.100598 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd37794-559d-4166-9367-b557f77d0cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:27.101132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd37794-559d-4166-9367-b557f77d0cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:27.105018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd37794-559d-4166-9367-b557f77d0cb2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:27.125711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486d0b0-2614-4926-99e4-3aa95e0c0b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:27.126413 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486d0b0-2614-4926-99e4-3aa95e0c0b8f admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:27.126862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486d0b0-2614-4926-99e4-3aa95e0c0b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:27.128463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486d0b0-2614-4926-99e4-3aa95e0c0b8f admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:27.128463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486d0b0-2614-4926-99e4-3aa95e0c0b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:27.130015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486d0b0-2614-4926-99e4-3aa95e0c0b8f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:27.139878 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1032/2082] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:26 2022] POST /identity/v3/users => generated 281 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:27.144612 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd37794-559d-4166-9367-b557f77d0cb2 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:27.158173 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd37794-559d-4166-9367-b557f77d0cb2 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:27.160206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1051/2083] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:26 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:27.167037 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486d0b0-2614-4926-99e4-3aa95e0c0b8f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:27.172661 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9880b-cf37-47c9-9b7c-6827c2f88637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:27.173445 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9880b-cf37-47c9-9b7c-6827c2f88637 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:27.173731 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9880b-cf37-47c9-9b7c-6827c2f88637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:27.174110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9880b-cf37-47c9-9b7c-6827c2f88637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:27.174864 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9880b-cf37-47c9-9b7c-6827c2f88637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:27.176580 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9880b-cf37-47c9-9b7c-6827c2f88637 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:27.181968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486d0b0-2614-4926-99e4-3aa95e0c0b8f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:27.188115 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50290fe4-ce0c-40fe-82d1-c449ac527857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:27.188928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50290fe4-ce0c-40fe-82d1-c449ac527857 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:27.189291 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50290fe4-ce0c-40fe-82d1-c449ac527857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:27.190257 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50290fe4-ce0c-40fe-82d1-c449ac527857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:27.191560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50290fe4-ce0c-40fe-82d1-c449ac527857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:27.193539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50290fe4-ce0c-40fe-82d1-c449ac527857 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:27.196627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1033/2084] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:27.197741 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9880b-cf37-47c9-9b7c-6827c2f88637 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:27.210264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9880b-cf37-47c9-9b7c-6827c2f88637 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:27.212709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1052/2085] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:27.214921 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50290fe4-ce0c-40fe-82d1-c449ac527857 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:27.221084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac05b1-703f-4197-bb2b-c40ade8f730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:27.222016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac05b1-703f-4197-bb2b-c40ade8f730a admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:27.222402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac05b1-703f-4197-bb2b-c40ade8f730a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:27.222814 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac05b1-703f-4197-bb2b-c40ade8f730a admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:27.223635 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac05b1-703f-4197-bb2b-c40ade8f730a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:27.232874 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac05b1-703f-4197-bb2b-c40ade8f730a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:27.241720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50290fe4-ce0c-40fe-82d1-c449ac527857 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:27.249413 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98693979-5f8e-4e4d-848b-7aabbdcdd370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:27.250087 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98693979-5f8e-4e4d-848b-7aabbdcdd370 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:27.250370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98693979-5f8e-4e4d-848b-7aabbdcdd370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:27.250651 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98693979-5f8e-4e4d-848b-7aabbdcdd370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:27.251630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98693979-5f8e-4e4d-848b-7aabbdcdd370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:27.252677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1034/2086] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:27.253470 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98693979-5f8e-4e4d-848b-7aabbdcdd370 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:27.253895 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac05b1-703f-4197-bb2b-c40ade8f730a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:27.268142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac05b1-703f-4197-bb2b-c40ade8f730a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:27.272786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1053/2087] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:27.274575 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98693979-5f8e-4e4d-848b-7aabbdcdd370 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:27.274696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71eeb1-c485-41b9-bcc4-0fc6146fba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:27.275170 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71eeb1-c485-41b9-bcc4-0fc6146fba24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:27.275454 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71eeb1-c485-41b9-bcc4-0fc6146fba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:27.275728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71eeb1-c485-41b9-bcc4-0fc6146fba24 admin admin] PATH_INFO: `/v3/projects/438d5117a7f9494eab9b7838bf8001cd/users/14fdd8eec65c46239a42054771a23480/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:27.281704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:27.288003 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98693979-5f8e-4e4d-848b-7aabbdcdd370 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:27.296770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1164f-f5a8-4636-bb9c-370128615096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:27.298269 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1164f-f5a8-4636-bb9c-370128615096 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:27.298791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1164f-f5a8-4636-bb9c-370128615096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:27.299231 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1164f-f5a8-4636-bb9c-370128615096 admin admin] PATH_INFO: `/v3/projects/881fd2ec6fdf4c76b08b3b24fc16cf81/users/de682a9306a345a19c53c924e82773f8/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:27.302496 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71eeb1-c485-41b9-bcc4-0fc6146fba24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=438d5117a7f9494eab9b7838bf8001cd, user_id=14fdd8eec65c46239a42054771a23480, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:27.306185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71eeb1-c485-41b9-bcc4-0fc6146fba24 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:27.320040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1164f-f5a8-4636-bb9c-370128615096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=881fd2ec6fdf4c76b08b3b24fc16cf81, user_id=de682a9306a345a19c53c924e82773f8, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:27.322046 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1035/2088] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:27 2022] PUT /identity/v3/projects/438d5117a7f9494eab9b7838bf8001cd/users/14fdd8eec65c46239a42054771a23480/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:27.323001 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1164f-f5a8-4636-bb9c-370128615096 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:27.334333 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0edd2-d105-4eed-9db9-dded573040b3 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:27.334855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0edd2-d105-4eed-9db9-dded573040b3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:27.335284 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0edd2-d105-4eed-9db9-dded573040b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:27.365882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1054/2089] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:27 2022] PUT /identity/v3/projects/881fd2ec6fdf4c76b08b3b24fc16cf81/users/de682a9306a345a19c53c924e82773f8/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:27.367986 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff5329-fcfb-43e2-ab09-90bc96dd032b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:27.368459 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff5329-fcfb-43e2-ab09-90bc96dd032b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:27.368829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff5329-fcfb-43e2-ab09-90bc96dd032b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:27.380913 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-8eb0edd2-d105-4eed-9db9-dded573040b3 None None] MFA Rules not processed for user `14fdd8eec65c46239a42054771a23480`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:27.382142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8eb0edd2-d105-4eed-9db9-dded573040b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:27.389032 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:27.417449 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9aff5329-fcfb-43e2-ab09-90bc96dd032b None None] MFA Rules not processed for user `de682a9306a345a19c53c924e82773f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:27.418905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9aff5329-fcfb-43e2-ab09-90bc96dd032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:27.487537 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1036/2090] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:27.528109 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0edd2-d105-4eed-9db9-dded573040b3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:27.529799 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8eb0edd2-d105-4eed-9db9-dded573040b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:27.535079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1055/2091] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:29:27.536167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff5329-fcfb-43e2-ab09-90bc96dd032b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:27.602867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0edd2-d105-4eed-9db9-dded573040b3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:27.606845 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01868e2c-29aa-4ea8-b812-2fd390336529 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:27.607616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01868e2c-29aa-4ea8-b812-2fd390336529 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:27.607896 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01868e2c-29aa-4ea8-b812-2fd390336529 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:27.608264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01868e2c-29aa-4ea8-b812-2fd390336529 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:27.611798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff5329-fcfb-43e2-ab09-90bc96dd032b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:27.618560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b76aa-962d-4a23-bc46-12b044c38e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:27.619247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b76aa-962d-4a23-bc46-12b044c38e82 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:27.619380 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01868e2c-29aa-4ea8-b812-2fd390336529 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:27.619609 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b76aa-962d-4a23-bc46-12b044c38e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:27.619798 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b76aa-962d-4a23-bc46-12b044c38e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:27.620504 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b76aa-962d-4a23-bc46-12b044c38e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:27.621061 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01868e2c-29aa-4ea8-b812-2fd390336529 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:27.622725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b76aa-962d-4a23-bc46-12b044c38e82 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:27.631942 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1037/2092] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:27.652849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01868e2c-29aa-4ea8-b812-2fd390336529 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:27.655532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1056/2093] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:27 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:27.662318 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b76aa-962d-4a23-bc46-12b044c38e82 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:27.665153 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01868e2c-29aa-4ea8-b812-2fd390336529 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:27.754589 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:27.758171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f460a-500f-469b-8a1a-52e6f37cdbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:27.759130 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f460a-500f-469b-8a1a-52e6f37cdbf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:27.759470 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f460a-500f-469b-8a1a-52e6f37cdbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:27.759793 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f460a-500f-469b-8a1a-52e6f37cdbf6 admin admin] PATH_INFO: `/v3/users/14fdd8eec65c46239a42054771a23480` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:27.761626 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f460a-500f-469b-8a1a-52e6f37cdbf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14fdd8eec65c46239a42054771a23480)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:27.764005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f460a-500f-469b-8a1a-52e6f37cdbf6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:27.771289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b76aa-962d-4a23-bc46-12b044c38e82 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:27.780434 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dcfaf-7aae-4fa5-83c9-47f6f1b30ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:27.781487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dcfaf-7aae-4fa5-83c9-47f6f1b30ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:27.781917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dcfaf-7aae-4fa5-83c9-47f6f1b30ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:27.782337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dcfaf-7aae-4fa5-83c9-47f6f1b30ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:27.783297 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281dcfaf-7aae-4fa5-83c9-47f6f1b30ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:27.785718 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281dcfaf-7aae-4fa5-83c9-47f6f1b30ff8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:27.824783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1057/2094] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:27 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:27.825805 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dcfaf-7aae-4fa5-83c9-47f6f1b30ff8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:27.838752 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dcfaf-7aae-4fa5-83c9-47f6f1b30ff8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:27.845840 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8e58c-ed4c-4028-b092-c86514278571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:27.847148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8e58c-ed4c-4028-b092-c86514278571 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:27.847489 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8e58c-ed4c-4028-b092-c86514278571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:27.847877 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8e58c-ed4c-4028-b092-c86514278571 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:27.848916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8e58c-ed4c-4028-b092-c86514278571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:27.851246 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8e58c-ed4c-4028-b092-c86514278571 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:27.866692 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-fb5f460a-500f-469b-8a1a-52e6f37cdbf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14fdd8eec65c46239a42054771a23480'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:27.866920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1058/2095] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:27.867818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8e58c-ed4c-4028-b092-c86514278571 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:27.871458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:27.880344 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-fb5f460a-500f-469b-8a1a-52e6f37cdbf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14fdd8eec65c46239a42054771a23480'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:27.882818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8e58c-ed4c-4028-b092-c86514278571 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:27.889863 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebcf30-1f75-49ef-abf5-8bd98297c95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:27.891133 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebcf30-1f75-49ef-abf5-8bd98297c95d admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:27.892165 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebcf30-1f75-49ef-abf5-8bd98297c95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:27.892602 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebcf30-1f75-49ef-abf5-8bd98297c95d admin admin] PATH_INFO: `/v3/projects/4ff846c54e4a42a89d7a71d5c0d9e1f5/users/f11a661a81c9494c9220e21ba437c54a/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:27.939393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-fb5f460a-500f-469b-8a1a-52e6f37cdbf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14fdd8eec65c46239a42054771a23480'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:27.940355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-fb5f460a-500f-469b-8a1a-52e6f37cdbf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14fdd8eec65c46239a42054771a23480'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:27.951404 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-fb5f460a-500f-469b-8a1a-52e6f37cdbf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14fdd8eec65c46239a42054771a23480'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:27.963941 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1038/2096] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:27 2022] DELETE /identity/v3/users/14fdd8eec65c46239a42054771a23480 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:27.967627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae025b-b207-4500-88fc-90dc50ce36df None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:27.967923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae025b-b207-4500-88fc-90dc50ce36df None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:27.968148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebcf30-1f75-49ef-abf5-8bd98297c95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff846c54e4a42a89d7a71d5c0d9e1f5, user_id=f11a661a81c9494c9220e21ba437c54a, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:27.968256 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae025b-b207-4500-88fc-90dc50ce36df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:27.974004 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebcf30-1f75-49ef-abf5-8bd98297c95d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:27.995618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-fcae025b-b207-4500-88fc-90dc50ce36df None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:27.997457 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fcae025b-b207-4500-88fc-90dc50ce36df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:28.006857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1059/2097] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:27 2022] PUT /identity/v3/projects/4ff846c54e4a42a89d7a71d5c0d9e1f5/users/f11a661a81c9494c9220e21ba437c54a/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:28.011914 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebcf30-1f75-49ef-abf5-8bd98297c95d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:28.014629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b2ebcf30-1f75-49ef-abf5-8bd98297c95d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:28.097512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1039/2098] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:28.108414 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae025b-b207-4500-88fc-90dc50ce36df None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:28.111890 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fcae025b-b207-4500-88fc-90dc50ce36df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:28.124970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebcf30-1f75-49ef-abf5-8bd98297c95d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:28.131196 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681771b4-ffe2-40d5-bee6-7a839480fb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:28.131879 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681771b4-ffe2-40d5-bee6-7a839480fb26 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:28.132250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681771b4-ffe2-40d5-bee6-7a839480fb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:28.132422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681771b4-ffe2-40d5-bee6-7a839480fb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:28.133354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681771b4-ffe2-40d5-bee6-7a839480fb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:28.136477 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681771b4-ffe2-40d5-bee6-7a839480fb26 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:28.150791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1060/2099] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:28.154850 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681771b4-ffe2-40d5-bee6-7a839480fb26 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:28.171670 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681771b4-ffe2-40d5-bee6-7a839480fb26 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:28.178284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ebceb-07bb-419f-9aac-ece7e520e804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:28.179624 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ebceb-07bb-419f-9aac-ece7e520e804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:28.179925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ebceb-07bb-419f-9aac-ece7e520e804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:28.180259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ebceb-07bb-419f-9aac-ece7e520e804 admin admin] PATH_INFO: `/v3/projects/4ff846c54e4a42a89d7a71d5c0d9e1f5/users/f11a661a81c9494c9220e21ba437c54a/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:28.183210 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ebceb-07bb-419f-9aac-ece7e520e804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff846c54e4a42a89d7a71d5c0d9e1f5, user_id=f11a661a81c9494c9220e21ba437c54a, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:28.193096 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ebceb-07bb-419f-9aac-ece7e520e804 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:28.213818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1061/2100] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:28 2022] PUT /identity/v3/projects/4ff846c54e4a42a89d7a71d5c0d9e1f5/users/f11a661a81c9494c9220e21ba437c54a/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:28.225595 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789d165-49b0-4565-8251-2bc90e71f369 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:28.227095 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789d165-49b0-4565-8251-2bc90e71f369 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:28.227589 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789d165-49b0-4565-8251-2bc90e71f369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:28.232370 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae025b-b207-4500-88fc-90dc50ce36df None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:28.269917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9789d165-49b0-4565-8251-2bc90e71f369 None None] MFA Rules not processed for user `f11a661a81c9494c9220e21ba437c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:28.271742 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9789d165-49b0-4565-8251-2bc90e71f369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:28.303096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef61478-cf13-42ff-a5fb-b32ffada03c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:28.304106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef61478-cf13-42ff-a5fb-b32ffada03c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:28.304434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef61478-cf13-42ff-a5fb-b32ffada03c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:28.304760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef61478-cf13-42ff-a5fb-b32ffada03c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:28.382574 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:28.412872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef61478-cf13-42ff-a5fb-b32ffada03c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:28.415475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef61478-cf13-42ff-a5fb-b32ffada03c9 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:28.438016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1040/2101] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:29:28.458846 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1062/2102] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:29:28.472394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef61478-cf13-42ff-a5fb-b32ffada03c9 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:28.476346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5ef61478-cf13-42ff-a5fb-b32ffada03c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:28.639222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef61478-cf13-42ff-a5fb-b32ffada03c9 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:28.661056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf33ed-6604-4c01-ba7d-fa8263b37b57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:28.661744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf33ed-6604-4c01-ba7d-fa8263b37b57 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:28.662025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf33ed-6604-4c01-ba7d-fa8263b37b57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:28.662321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf33ed-6604-4c01-ba7d-fa8263b37b57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:28.674809 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf33ed-6604-4c01-ba7d-fa8263b37b57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:28.677239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf33ed-6604-4c01-ba7d-fa8263b37b57 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:28.688186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1041/2103] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:28.750098 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789d165-49b0-4565-8251-2bc90e71f369 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:28.751975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9789d165-49b0-4565-8251-2bc90e71f369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:28.779229 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789d165-49b0-4565-8251-2bc90e71f369 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:28.784837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00438693-1bd2-49eb-9b83-e54b95262409 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:28.785519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00438693-1bd2-49eb-9b83-e54b95262409 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:28.785801 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00438693-1bd2-49eb-9b83-e54b95262409 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:28.786075 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00438693-1bd2-49eb-9b83-e54b95262409 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:28.787949 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-00438693-1bd2-49eb-9b83-e54b95262409 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:28.802072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:28.864967 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00438693-1bd2-49eb-9b83-e54b95262409 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:28.866927 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00438693-1bd2-49eb-9b83-e54b95262409 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:28.878744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1063/2104] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:28.935890 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf33ed-6604-4c01-ba7d-fa8263b37b57 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:28.937401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2cbf33ed-6604-4c01-ba7d-fa8263b37b57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:28.966648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf33ed-6604-4c01-ba7d-fa8263b37b57 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:28.973285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd0621-a667-4d2c-9e4f-44c901b02351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:28.974279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd0621-a667-4d2c-9e4f-44c901b02351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:28.974654 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd0621-a667-4d2c-9e4f-44c901b02351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:28.975464 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd0621-a667-4d2c-9e4f-44c901b02351 admin admin] PATH_INFO: `/v3/users/64d12add4bcf4da08cd5e8d68e13c3a6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:28.976878 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd0621-a667-4d2c-9e4f-44c901b02351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64d12add4bcf4da08cd5e8d68e13c3a6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:28.979692 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd0621-a667-4d2c-9e4f-44c901b02351 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:29.039021 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0bcd0621-a667-4d2c-9e4f-44c901b02351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d12add4bcf4da08cd5e8d68e13c3a6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.048691 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0bcd0621-a667-4d2c-9e4f-44c901b02351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d12add4bcf4da08cd5e8d68e13c3a6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.066674 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0bcd0621-a667-4d2c-9e4f-44c901b02351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d12add4bcf4da08cd5e8d68e13c3a6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.067622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0bcd0621-a667-4d2c-9e4f-44c901b02351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d12add4bcf4da08cd5e8d68e13c3a6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.076229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0bcd0621-a667-4d2c-9e4f-44c901b02351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d12add4bcf4da08cd5e8d68e13c3a6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.082765 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1042/2105] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:28 2022] DELETE /identity/v3/users/64d12add4bcf4da08cd5e8d68e13c3a6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:29.192098 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00438693-1bd2-49eb-9b83-e54b95262409 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:29.193587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-00438693-1bd2-49eb-9b83-e54b95262409 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:29.219337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00438693-1bd2-49eb-9b83-e54b95262409 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:29.220721 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd0621-a667-4d2c-9e4f-44c901b02351 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:29.222427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0bcd0621-a667-4d2c-9e4f-44c901b02351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:29.292635 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:29.323382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd0621-a667-4d2c-9e4f-44c901b02351 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:29.336614 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2426b-03e6-4d5e-a767-59d1e529e8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:29.337669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2426b-03e6-4d5e-a767-59d1e529e8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:29.337986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2426b-03e6-4d5e-a767-59d1e529e8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:29.339003 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2426b-03e6-4d5e-a767-59d1e529e8a5 admin admin] PATH_INFO: `/v3/projects/438d5117a7f9494eab9b7838bf8001cd` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:29.340421 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2426b-03e6-4d5e-a767-59d1e529e8a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=438d5117a7f9494eab9b7838bf8001cd)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:29.342858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2426b-03e6-4d5e-a767-59d1e529e8a5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:29.376564 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41ab46-c785-4e40-a888-fc31fb40e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:29.377781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41ab46-c785-4e40-a888-fc31fb40e114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:29.377781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41ab46-c785-4e40-a888-fc31fb40e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:29.378065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41ab46-c785-4e40-a888-fc31fb40e114 admin admin] PATH_INFO: `/v3/users/1bac4832e25c4c1c855a51bfa8ac36d7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:29.381255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41ab46-c785-4e40-a888-fc31fb40e114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bac4832e25c4c1c855a51bfa8ac36d7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:29.383209 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41ab46-c785-4e40-a888-fc31fb40e114 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:29.432292 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-26c2426b-03e6-4d5e-a767-59d1e529e8a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '438d5117a7f9494eab9b7838bf8001cd', 'request_id': 'req-26c2426b-03e6-4d5e-a767-59d1e529e8a5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.451439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-26c2426b-03e6-4d5e-a767-59d1e529e8a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '438d5117a7f9494eab9b7838bf8001cd', 'request_id': 'req-26c2426b-03e6-4d5e-a767-59d1e529e8a5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.474952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-26c2426b-03e6-4d5e-a767-59d1e529e8a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '438d5117a7f9494eab9b7838bf8001cd', 'request_id': 'req-26c2426b-03e6-4d5e-a767-59d1e529e8a5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.477771 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2b41ab46-c785-4e40-a888-fc31fb40e114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bac4832e25c4c1c855a51bfa8ac36d7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.489166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2b41ab46-c785-4e40-a888-fc31fb40e114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bac4832e25c4c1c855a51bfa8ac36d7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.490343 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-26c2426b-03e6-4d5e-a767-59d1e529e8a5 admin admin] The token cache is being invalidate because project 438d5117a7f9494eab9b7838bf8001cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:29.490640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-26c2426b-03e6-4d5e-a767-59d1e529e8a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.491544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-26c2426b-03e6-4d5e-a767-59d1e529e8a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.504711 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1043/2106] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:29 2022] DELETE /identity/v3/projects/438d5117a7f9494eab9b7838bf8001cd => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:29.504711 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2426b-03e6-4d5e-a767-59d1e529e8a5 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:29.504711 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-26c2426b-03e6-4d5e-a767-59d1e529e8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:29.505365 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2b41ab46-c785-4e40-a888-fc31fb40e114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bac4832e25c4c1c855a51bfa8ac36d7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.505365 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2b41ab46-c785-4e40-a888-fc31fb40e114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bac4832e25c4c1c855a51bfa8ac36d7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.520819 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2b41ab46-c785-4e40-a888-fc31fb40e114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bac4832e25c4c1c855a51bfa8ac36d7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.528940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1064/2107] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:29 2022] DELETE /identity/v3/users/1bac4832e25c4c1c855a51bfa8ac36d7 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:29.536577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61d53f-4e24-41dc-90ee-3ab6bc56aab1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:29.536577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61d53f-4e24-41dc-90ee-3ab6bc56aab1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:29.536577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61d53f-4e24-41dc-90ee-3ab6bc56aab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:29.574050 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ef61d53f-4e24-41dc-90ee-3ab6bc56aab1 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:29.575567 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ef61d53f-4e24-41dc-90ee-3ab6bc56aab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:29.627805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2426b-03e6-4d5e-a767-59d1e529e8a5 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:29.654579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:29.712617 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1065/2108] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:29.721012 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe3f0d-251a-4150-8da0-cc87fcaf2039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:29.721990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe3f0d-251a-4150-8da0-cc87fcaf2039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:29.722272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe3f0d-251a-4150-8da0-cc87fcaf2039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:29.722548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe3f0d-251a-4150-8da0-cc87fcaf2039 admin admin] PATH_INFO: `/v3/projects/96f5b55d00a9462a8da10f95ff58bf9a` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:29.723014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61d53f-4e24-41dc-90ee-3ab6bc56aab1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:29.723767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe3f0d-251a-4150-8da0-cc87fcaf2039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f5b55d00a9462a8da10f95ff58bf9a)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:29.724612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ef61d53f-4e24-41dc-90ee-3ab6bc56aab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:29.725729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe3f0d-251a-4150-8da0-cc87fcaf2039 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:29.762184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:29.776291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-58fe3f0d-251a-4150-8da0-cc87fcaf2039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f5b55d00a9462a8da10f95ff58bf9a', 'request_id': 'req-58fe3f0d-251a-4150-8da0-cc87fcaf2039'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.783237 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61d53f-4e24-41dc-90ee-3ab6bc56aab1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:29.785374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-58fe3f0d-251a-4150-8da0-cc87fcaf2039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f5b55d00a9462a8da10f95ff58bf9a', 'request_id': 'req-58fe3f0d-251a-4150-8da0-cc87fcaf2039'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.791605 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-58fe3f0d-251a-4150-8da0-cc87fcaf2039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f5b55d00a9462a8da10f95ff58bf9a', 'request_id': 'req-58fe3f0d-251a-4150-8da0-cc87fcaf2039'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.803100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-58fe3f0d-251a-4150-8da0-cc87fcaf2039 admin admin] The token cache is being invalidate because project 96f5b55d00a9462a8da10f95ff58bf9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:29.803388 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-58fe3f0d-251a-4150-8da0-cc87fcaf2039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.804051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-58fe3f0d-251a-4150-8da0-cc87fcaf2039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:29.805692 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1044/2109] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:29 2022] DELETE /identity/v3/projects/96f5b55d00a9462a8da10f95ff58bf9a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:29.811486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b3a4d-b6b5-4f82-bff4-2f900916152d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:29.811888 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b3a4d-b6b5-4f82-bff4-2f900916152d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:29.812177 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b3a4d-b6b5-4f82-bff4-2f900916152d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:29.832079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-004b3a4d-b6b5-4f82-bff4-2f900916152d None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:29.833393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-004b3a4d-b6b5-4f82-bff4-2f900916152d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:29.833960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f8dfb-2ab8-44d8-994e-150067704574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:29.834620 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f8dfb-2ab8-44d8-994e-150067704574 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:29.834902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f8dfb-2ab8-44d8-994e-150067704574 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:29.835178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f8dfb-2ab8-44d8-994e-150067704574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:29.837035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e88f8dfb-2ab8-44d8-994e-150067704574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:29.897551 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1045/2110] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:29:29.903188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f8dfb-2ab8-44d8-994e-150067704574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:29.904740 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f8dfb-2ab8-44d8-994e-150067704574 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:29.906437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214fc99-641f-458d-8e8b-aa6a842d9ded None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:29.906860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214fc99-641f-458d-8e8b-aa6a842d9ded None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:29.907110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214fc99-641f-458d-8e8b-aa6a842d9ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:29.915604 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1066/2111] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:29:29.926825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f214fc99-641f-458d-8e8b-aa6a842d9ded None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:29.928035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f214fc99-641f-458d-8e8b-aa6a842d9ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:29.937094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1046/2112] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:29.941550 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f8dfb-2ab8-44d8-994e-150067704574 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:29.951464 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f8dfb-2ab8-44d8-994e-150067704574 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:29.957091 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4278d68-230d-4ed1-a2b0-0b19a1ee25cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:29.957757 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4278d68-230d-4ed1-a2b0-0b19a1ee25cc admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:29.958033 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4278d68-230d-4ed1-a2b0-0b19a1ee25cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:29.958298 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4278d68-230d-4ed1-a2b0-0b19a1ee25cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:29.959025 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4278d68-230d-4ed1-a2b0-0b19a1ee25cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:29.959329 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4278d68-230d-4ed1-a2b0-0b19a1ee25cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:29.961139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4278d68-230d-4ed1-a2b0-0b19a1ee25cc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:29.974854 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1067/2113] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:29:29.979433 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214fc99-641f-458d-8e8b-aa6a842d9ded None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:29.989054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214fc99-641f-458d-8e8b-aa6a842d9ded None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:29.994126 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c5731-01e4-4b60-bed7-5dde356a3081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:29.995196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c5731-01e4-4b60-bed7-5dde356a3081 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:29.995686 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c5731-01e4-4b60-bed7-5dde356a3081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:29.996171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c5731-01e4-4b60-bed7-5dde356a3081 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:29.997525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c5731-01e4-4b60-bed7-5dde356a3081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:30.001219 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c5731-01e4-4b60-bed7-5dde356a3081 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:30.031871 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1047/2114] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:29 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:30.033394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4278d68-230d-4ed1-a2b0-0b19a1ee25cc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:30.043929 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4278d68-230d-4ed1-a2b0-0b19a1ee25cc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:30.071499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:30.106639 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb65b6-3a61-4182-ac51-55d31a6c04c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:30.107221 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb65b6-3a61-4182-ac51-55d31a6c04c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:30.107506 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb65b6-3a61-4182-ac51-55d31a6c04c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:30.107782 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb65b6-3a61-4182-ac51-55d31a6c04c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:30.108473 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb65b6-3a61-4182-ac51-55d31a6c04c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:30.110439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb65b6-3a61-4182-ac51-55d31a6c04c8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:30.133085 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1068/2115] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:30 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:30.137363 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c5731-01e4-4b60-bed7-5dde356a3081 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:30.148740 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c5731-01e4-4b60-bed7-5dde356a3081 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:30.153579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf4591-4290-49af-9165-51375f96fe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:30.154244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf4591-4290-49af-9165-51375f96fe5f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:30.154524 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf4591-4290-49af-9165-51375f96fe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:30.154796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf4591-4290-49af-9165-51375f96fe5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:30.155578 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf4591-4290-49af-9165-51375f96fe5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:30.157304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf4591-4290-49af-9165-51375f96fe5f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:30.168574 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1048/2116] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:30.172925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb65b6-3a61-4182-ac51-55d31a6c04c8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:30.183019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb65b6-3a61-4182-ac51-55d31a6c04c8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:30.187967 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada2f24-97b4-4d26-a7b3-d7878840cef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:30.188665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada2f24-97b4-4d26-a7b3-d7878840cef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:30.188941 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada2f24-97b4-4d26-a7b3-d7878840cef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:30.189342 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada2f24-97b4-4d26-a7b3-d7878840cef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:30.190017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada2f24-97b4-4d26-a7b3-d7878840cef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:30.191650 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada2f24-97b4-4d26-a7b3-d7878840cef2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:30.196619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf4591-4290-49af-9165-51375f96fe5f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:30.198297 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c1bf4591-4290-49af-9165-51375f96fe5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:30.207075 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1069/2117] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:29:30.211486 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada2f24-97b4-4d26-a7b3-d7878840cef2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:30.221634 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf4591-4290-49af-9165-51375f96fe5f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:30.224860 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada2f24-97b4-4d26-a7b3-d7878840cef2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:30.226839 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ac151-b01a-4c34-926a-3b661eb97ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:30.227695 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ac151-b01a-4c34-926a-3b661eb97ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:30.227993 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ac151-b01a-4c34-926a-3b661eb97ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:30.228238 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ac151-b01a-4c34-926a-3b661eb97ec6 admin admin] PATH_INFO: `/v3/projects/e4f6bba638da445c9e04acacd9f69763` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:30.229421 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ac151-b01a-4c34-926a-3b661eb97ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4f6bba638da445c9e04acacd9f69763)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:30.230724 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a8a6b-0688-4cbb-8be8-92de3d22aa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:30.231334 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ac151-b01a-4c34-926a-3b661eb97ec6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:30.232076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a8a6b-0688-4cbb-8be8-92de3d22aa0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:30.232364 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a8a6b-0688-4cbb-8be8-92de3d22aa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:30.232698 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a8a6b-0688-4cbb-8be8-92de3d22aa0e admin admin] PATH_INFO: `/v3/projects/53dbc1f4a71d431985cd4ef3af7f6d04/users/b2040ecea7f547c0a5a1909699f2a4f9/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:30.248878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a8a6b-0688-4cbb-8be8-92de3d22aa0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=53dbc1f4a71d431985cd4ef3af7f6d04, user_id=b2040ecea7f547c0a5a1909699f2a4f9, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:30.251711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a8a6b-0688-4cbb-8be8-92de3d22aa0e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:30.267853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1070/2118] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:30 2022] PUT /identity/v3/projects/53dbc1f4a71d431985cd4ef3af7f6d04/users/b2040ecea7f547c0a5a1909699f2a4f9/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:30.278660 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98ecc4-3cc9-49c9-aac7-72866d6eb8a2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:30.278830 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98ecc4-3cc9-49c9-aac7-72866d6eb8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:30.279020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98ecc4-3cc9-49c9-aac7-72866d6eb8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:30.291043 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d10ac151-b01a-4c34-926a-3b661eb97ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4f6bba638da445c9e04acacd9f69763', 'request_id': 'req-d10ac151-b01a-4c34-926a-3b661eb97ec6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:30.302312 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d10ac151-b01a-4c34-926a-3b661eb97ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4f6bba638da445c9e04acacd9f69763', 'request_id': 'req-d10ac151-b01a-4c34-926a-3b661eb97ec6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:30.307887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1b98ecc4-3cc9-49c9-aac7-72866d6eb8a2 None None] MFA Rules not processed for user `b2040ecea7f547c0a5a1909699f2a4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:30.309142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1b98ecc4-3cc9-49c9-aac7-72866d6eb8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:30.309709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d10ac151-b01a-4c34-926a-3b661eb97ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4f6bba638da445c9e04acacd9f69763', 'request_id': 'req-d10ac151-b01a-4c34-926a-3b661eb97ec6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:30.323069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d10ac151-b01a-4c34-926a-3b661eb97ec6 admin admin] The token cache is being invalidate because project e4f6bba638da445c9e04acacd9f69763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:30.323441 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d10ac151-b01a-4c34-926a-3b661eb97ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:30.324337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d10ac151-b01a-4c34-926a-3b661eb97ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:30.325794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1049/2119] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:30 2022] DELETE /identity/v3/projects/e4f6bba638da445c9e04acacd9f69763 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:30.330015 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ac151-b01a-4c34-926a-3b661eb97ec6 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:30.331475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d10ac151-b01a-4c34-926a-3b661eb97ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:30.339083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:30.396675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1071/2120] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:29:30.407651 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98ecc4-3cc9-49c9-aac7-72866d6eb8a2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:30.409485 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1b98ecc4-3cc9-49c9-aac7-72866d6eb8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:30.412316 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ac151-b01a-4c34-926a-3b661eb97ec6 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:30.416915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c5bc8-e199-4e1c-b561-825f8e7ed3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:30.417867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c5bc8-e199-4e1c-b561-825f8e7ed3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:30.418059 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c5bc8-e199-4e1c-b561-825f8e7ed3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:30.418494 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c5bc8-e199-4e1c-b561-825f8e7ed3a4 admin admin] PATH_INFO: `/v3/users/acb450b4b19540578dbff482345fdbb3` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:30.419696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c5bc8-e199-4e1c-b561-825f8e7ed3a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acb450b4b19540578dbff482345fdbb3)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:30.421641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c5bc8-e199-4e1c-b561-825f8e7ed3a4 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:30.476051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-616c5bc8-e199-4e1c-b561-825f8e7ed3a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acb450b4b19540578dbff482345fdbb3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:30.486281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-616c5bc8-e199-4e1c-b561-825f8e7ed3a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acb450b4b19540578dbff482345fdbb3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:30.500999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-616c5bc8-e199-4e1c-b561-825f8e7ed3a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acb450b4b19540578dbff482345fdbb3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:30.501791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-616c5bc8-e199-4e1c-b561-825f8e7ed3a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acb450b4b19540578dbff482345fdbb3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:30.502219 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98ecc4-3cc9-49c9-aac7-72866d6eb8a2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:30.508241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fba087-2778-41a7-b786-d36918ffd901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:30.508924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fba087-2778-41a7-b786-d36918ffd901 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:30.509206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fba087-2778-41a7-b786-d36918ffd901 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:30.509527 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fba087-2778-41a7-b786-d36918ffd901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:30.509642 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-616c5bc8-e199-4e1c-b561-825f8e7ed3a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acb450b4b19540578dbff482345fdbb3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:30.511339 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-69fba087-2778-41a7-b786-d36918ffd901 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:30.516002 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1050/2121] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:30 2022] DELETE /identity/v3/users/acb450b4b19540578dbff482345fdbb3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:30.522421 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:30.524865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fba087-2778-41a7-b786-d36918ffd901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:30.526629 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fba087-2778-41a7-b786-d36918ffd901 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:30.543788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1072/2122] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:29:30.865547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c5bc8-e199-4e1c-b561-825f8e7ed3a4 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:30.867113 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-616c5bc8-e199-4e1c-b561-825f8e7ed3a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:30.988778 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c5bc8-e199-4e1c-b561-825f8e7ed3a4 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:30.995862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5c0d5-d429-4836-87f9-ce5a4b2e5860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:30.997122 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5c0d5-d429-4836-87f9-ce5a4b2e5860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:30.997410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5c0d5-d429-4836-87f9-ce5a4b2e5860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:30.997711 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5c0d5-d429-4836-87f9-ce5a4b2e5860 admin admin] PATH_INFO: `/v3/projects/ea55ea448f854ee0a6b029c7da8c2665` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:30.998893 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5c0d5-d429-4836-87f9-ce5a4b2e5860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea55ea448f854ee0a6b029c7da8c2665)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:31.001226 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5c0d5-d429-4836-87f9-ce5a4b2e5860 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:31.043261 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:31.073146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-aea5c0d5-d429-4836-87f9-ce5a4b2e5860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea55ea448f854ee0a6b029c7da8c2665', 'request_id': 'req-aea5c0d5-d429-4836-87f9-ce5a4b2e5860'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:31.081515 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-aea5c0d5-d429-4836-87f9-ce5a4b2e5860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea55ea448f854ee0a6b029c7da8c2665', 'request_id': 'req-aea5c0d5-d429-4836-87f9-ce5a4b2e5860'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:31.086971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-aea5c0d5-d429-4836-87f9-ce5a4b2e5860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea55ea448f854ee0a6b029c7da8c2665', 'request_id': 'req-aea5c0d5-d429-4836-87f9-ce5a4b2e5860'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:31.098249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-aea5c0d5-d429-4836-87f9-ce5a4b2e5860 admin admin] The token cache is being invalidate because project ea55ea448f854ee0a6b029c7da8c2665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:31.098544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-aea5c0d5-d429-4836-87f9-ce5a4b2e5860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:31.099172 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-aea5c0d5-d429-4836-87f9-ce5a4b2e5860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:31.100764 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1051/2123] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:30 2022] DELETE /identity/v3/projects/ea55ea448f854ee0a6b029c7da8c2665 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:31.107028 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba8fcf-61d6-4e38-9c13-a6cd019ad76b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:31.107561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba8fcf-61d6-4e38-9c13-a6cd019ad76b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:31.107936 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba8fcf-61d6-4e38-9c13-a6cd019ad76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:31.128416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7bba8fcf-61d6-4e38-9c13-a6cd019ad76b None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:31.129603 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7bba8fcf-61d6-4e38-9c13-a6cd019ad76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:31.193630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1073/2124] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:31.202087 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209529b-e887-4ffe-adf7-6263d4e0b08e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:31.202370 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209529b-e887-4ffe-adf7-6263d4e0b08e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:31.202658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209529b-e887-4ffe-adf7-6263d4e0b08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:31.223035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c209529b-e887-4ffe-adf7-6263d4e0b08e None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:31.224246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c209529b-e887-4ffe-adf7-6263d4e0b08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:31.233771 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1052/2125] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:31.238860 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba8fcf-61d6-4e38-9c13-a6cd019ad76b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:31.249626 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba8fcf-61d6-4e38-9c13-a6cd019ad76b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:31.255665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a118f8-7ad2-4bde-afba-eb216de9e06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:31.256354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a118f8-7ad2-4bde-afba-eb216de9e06a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:31.256661 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a118f8-7ad2-4bde-afba-eb216de9e06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:31.256935 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a118f8-7ad2-4bde-afba-eb216de9e06a admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:31.257674 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a118f8-7ad2-4bde-afba-eb216de9e06a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:31.257976 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a118f8-7ad2-4bde-afba-eb216de9e06a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:31.259596 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a118f8-7ad2-4bde-afba-eb216de9e06a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:31.272658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1074/2126] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:29:31.277068 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209529b-e887-4ffe-adf7-6263d4e0b08e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:31.286750 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209529b-e887-4ffe-adf7-6263d4e0b08e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:31.291365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bd9a6-2a55-4255-a134-15db87e51f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:31.292009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd9a6-2a55-4255-a134-15db87e51f8c admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:31.292286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd9a6-2a55-4255-a134-15db87e51f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:31.292586 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd9a6-2a55-4255-a134-15db87e51f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:31.293292 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bd9a6-2a55-4255-a134-15db87e51f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:31.295199 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bd9a6-2a55-4255-a134-15db87e51f8c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:31.322750 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1053/2127] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:31 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:29:31.326954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a118f8-7ad2-4bde-afba-eb216de9e06a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:31.338816 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a118f8-7ad2-4bde-afba-eb216de9e06a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:31.402088 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0dbf5-6bc0-4c72-a9e2-f2bf588c0ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:31.402680 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0dbf5-6bc0-4c72-a9e2-f2bf588c0ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:31.402954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0dbf5-6bc0-4c72-a9e2-f2bf588c0ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:31.403220 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0dbf5-6bc0-4c72-a9e2-f2bf588c0ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:31.403901 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0dbf5-6bc0-4c72-a9e2-f2bf588c0ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:31.405850 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0dbf5-6bc0-4c72-a9e2-f2bf588c0ec7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:31.430440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1075/2128] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:31 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:31.432345 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bd9a6-2a55-4255-a134-15db87e51f8c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:31.444712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bd9a6-2a55-4255-a134-15db87e51f8c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:31.450737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0786348-4128-4c2c-8bd3-c8b09f9825bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:31.451459 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0786348-4128-4c2c-8bd3-c8b09f9825bd admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:31.451670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0786348-4128-4c2c-8bd3-c8b09f9825bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:31.451947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0786348-4128-4c2c-8bd3-c8b09f9825bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:31.452720 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0786348-4128-4c2c-8bd3-c8b09f9825bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:31.454291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0786348-4128-4c2c-8bd3-c8b09f9825bd admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:31.466117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1054/2129] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:29:31.470682 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0dbf5-6bc0-4c72-a9e2-f2bf588c0ec7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:31.481180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0dbf5-6bc0-4c72-a9e2-f2bf588c0ec7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:31.486329 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ee916-3f20-495e-b32a-2f8de885b9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:31.487200 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ee916-3f20-495e-b32a-2f8de885b9bf admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:31.487480 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ee916-3f20-495e-b32a-2f8de885b9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:31.487746 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ee916-3f20-495e-b32a-2f8de885b9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:31.488507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ee916-3f20-495e-b32a-2f8de885b9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:31.490131 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ee916-3f20-495e-b32a-2f8de885b9bf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:31.500577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1076/2130] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:31.504934 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0786348-4128-4c2c-8bd3-c8b09f9825bd admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:31.515710 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0786348-4128-4c2c-8bd3-c8b09f9825bd admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:31.520678 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67d384-c06d-4f48-8bd6-fb33f3e2a029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:31.521513 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67d384-c06d-4f48-8bd6-fb33f3e2a029 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:31.521826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67d384-c06d-4f48-8bd6-fb33f3e2a029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:31.522128 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67d384-c06d-4f48-8bd6-fb33f3e2a029 admin admin] PATH_INFO: `/v3/projects/3e16547a2f3e4aec9da94c76670a2751/users/c623c78e978649c3b7a3187007326ca1/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:31.542256 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67d384-c06d-4f48-8bd6-fb33f3e2a029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e16547a2f3e4aec9da94c76670a2751, user_id=c623c78e978649c3b7a3187007326ca1, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:31.545124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67d384-c06d-4f48-8bd6-fb33f3e2a029 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:31.558886 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1055/2131] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:31 2022] PUT /identity/v3/projects/3e16547a2f3e4aec9da94c76670a2751/users/c623c78e978649c3b7a3187007326ca1/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:31.570193 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab3041-96b9-42ff-a0c2-61781daa42e9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:31.570694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab3041-96b9-42ff-a0c2-61781daa42e9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:31.571173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab3041-96b9-42ff-a0c2-61781daa42e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:31.599212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c1ab3041-96b9-42ff-a0c2-61781daa42e9 None None] MFA Rules not processed for user `c623c78e978649c3b7a3187007326ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:31.600409 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c1ab3041-96b9-42ff-a0c2-61781daa42e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:31.647314 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:31.666626 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1077/2132] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:31.678957 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67d384-c06d-4f48-8bd6-fb33f3e2a029 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:31.680848 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0e67d384-c06d-4f48-8bd6-fb33f3e2a029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:31.760754 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67d384-c06d-4f48-8bd6-fb33f3e2a029 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:31.764802 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4ae53-0539-4c65-94cb-5a021804af15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97fe9d04ccb445208f3783a8b55cd31e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:31.765440 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4ae53-0539-4c65-94cb-5a021804af15 service glance] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:31.765721 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4ae53-0539-4c65-94cb-5a021804af15 service glance] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:31.765984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4ae53-0539-4c65-94cb-5a021804af15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:31.774954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4ae53-0539-4c65-94cb-5a021804af15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:31.776367 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4ae53-0539-4c65-94cb-5a021804af15 service glance] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:31.786021 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1056/2133] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:32.349984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab3041-96b9-42ff-a0c2-61781daa42e9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:32.351537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c1ab3041-96b9-42ff-a0c2-61781daa42e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:32.436418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab3041-96b9-42ff-a0c2-61781daa42e9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:32.444142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c42fe7-5947-4408-b7e1-09cb8f3064d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:32.445117 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c42fe7-5947-4408-b7e1-09cb8f3064d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:32.445448 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c42fe7-5947-4408-b7e1-09cb8f3064d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:32.445717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c42fe7-5947-4408-b7e1-09cb8f3064d0 admin admin] PATH_INFO: `/v3/users/cd356b025c6041d8bcb0dd2b7d8b3c06` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:32.446996 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c42fe7-5947-4408-b7e1-09cb8f3064d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd356b025c6041d8bcb0dd2b7d8b3c06)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:32.448994 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c42fe7-5947-4408-b7e1-09cb8f3064d0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:32.501438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a4c42fe7-5947-4408-b7e1-09cb8f3064d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd356b025c6041d8bcb0dd2b7d8b3c06'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:32.510724 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a4c42fe7-5947-4408-b7e1-09cb8f3064d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd356b025c6041d8bcb0dd2b7d8b3c06'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:32.518459 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a4c42fe7-5947-4408-b7e1-09cb8f3064d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd356b025c6041d8bcb0dd2b7d8b3c06'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:32.519213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a4c42fe7-5947-4408-b7e1-09cb8f3064d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd356b025c6041d8bcb0dd2b7d8b3c06'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:32.532142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a4c42fe7-5947-4408-b7e1-09cb8f3064d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd356b025c6041d8bcb0dd2b7d8b3c06'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:32.539762 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1078/2134] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:32 2022] DELETE /identity/v3/users/cd356b025c6041d8bcb0dd2b7d8b3c06 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:32.544343 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63071f-6c10-46f8-bc68-9e6523de6dd2 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:32.544873 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63071f-6c10-46f8-bc68-9e6523de6dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:32.544983 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63071f-6c10-46f8-bc68-9e6523de6dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:32.563493 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2d63071f-6c10-46f8-bc68-9e6523de6dd2 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:32.565264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2d63071f-6c10-46f8-bc68-9e6523de6dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:32.601967 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:32.655320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1057/2135] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:32.667241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c42fe7-5947-4408-b7e1-09cb8f3064d0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:32.669061 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a4c42fe7-5947-4408-b7e1-09cb8f3064d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:32.746735 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c42fe7-5947-4408-b7e1-09cb8f3064d0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:32.750655 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e7d59-16da-4be7-ba18-df53c90ac478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:32.751319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e7d59-16da-4be7-ba18-df53c90ac478 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:32.751661 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e7d59-16da-4be7-ba18-df53c90ac478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:32.751962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e7d59-16da-4be7-ba18-df53c90ac478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:32.762241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e7d59-16da-4be7-ba18-df53c90ac478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:32.763689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e7d59-16da-4be7-ba18-df53c90ac478 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:32.775226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1079/2136] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:33.070192 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63071f-6c10-46f8-bc68-9e6523de6dd2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:33.071906 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2d63071f-6c10-46f8-bc68-9e6523de6dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:33.086397 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63071f-6c10-46f8-bc68-9e6523de6dd2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:33.091763 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:33.092662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:33.092939 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:33.093194 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9 admin admin] PATH_INFO: `/v3/projects/be45ea581aaf45f98d072d2b4ac4e4cb` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:33.094482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be45ea581aaf45f98d072d2b4ac4e4cb)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:33.097214 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:33.146935 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be45ea581aaf45f98d072d2b4ac4e4cb', 'request_id': 'req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:33.158342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be45ea581aaf45f98d072d2b4ac4e4cb', 'request_id': 'req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:33.167377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be45ea581aaf45f98d072d2b4ac4e4cb', 'request_id': 'req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:33.180541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9 admin admin] The token cache is being invalidate because project be45ea581aaf45f98d072d2b4ac4e4cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:33.180837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:33.181472 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:33.184618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1058/2137] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:33 2022] DELETE /identity/v3/projects/be45ea581aaf45f98d072d2b4ac4e4cb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:33.187071 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e7d59-16da-4be7-ba18-df53c90ac478 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:33.197716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e7d59-16da-4be7-ba18-df53c90ac478 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:33.207701 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:33.259120 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb823ccb-8255-4482-b62b-ab06e6df1f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:33.260015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb823ccb-8255-4482-b62b-ab06e6df1f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:33.260298 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb823ccb-8255-4482-b62b-ab06e6df1f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:33.260608 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb823ccb-8255-4482-b62b-ab06e6df1f6d admin admin] PATH_INFO: `/v3/users/de682a9306a345a19c53c924e82773f8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:33.261806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb823ccb-8255-4482-b62b-ab06e6df1f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de682a9306a345a19c53c924e82773f8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:33.263767 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb823ccb-8255-4482-b62b-ab06e6df1f6d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:33.314175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-eb823ccb-8255-4482-b62b-ab06e6df1f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de682a9306a345a19c53c924e82773f8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:33.326528 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-eb823ccb-8255-4482-b62b-ab06e6df1f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de682a9306a345a19c53c924e82773f8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:33.333921 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-eb823ccb-8255-4482-b62b-ab06e6df1f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de682a9306a345a19c53c924e82773f8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:33.334552 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-eb823ccb-8255-4482-b62b-ab06e6df1f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de682a9306a345a19c53c924e82773f8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:33.346894 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-eb823ccb-8255-4482-b62b-ab06e6df1f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de682a9306a345a19c53c924e82773f8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:33.353340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1080/2138] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:33 2022] DELETE /identity/v3/users/de682a9306a345a19c53c924e82773f8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:33.662080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:33.663548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:33.679658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ecc18-bf15-4d42-b88a-7cba747aa4b9 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:33.742951 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77f606-1f14-4a07-8521-06e46212ff8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:33.743929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77f606-1f14-4a07-8521-06e46212ff8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:33.744192 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77f606-1f14-4a07-8521-06e46212ff8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:33.744466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77f606-1f14-4a07-8521-06e46212ff8a admin admin] PATH_INFO: `/v3/projects/881fd2ec6fdf4c76b08b3b24fc16cf81` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:33.745720 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77f606-1f14-4a07-8521-06e46212ff8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=881fd2ec6fdf4c76b08b3b24fc16cf81)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:33.747704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77f606-1f14-4a07-8521-06e46212ff8a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:33.807124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ea77f606-1f14-4a07-8521-06e46212ff8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '881fd2ec6fdf4c76b08b3b24fc16cf81', 'request_id': 'req-ea77f606-1f14-4a07-8521-06e46212ff8a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:33.817680 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ea77f606-1f14-4a07-8521-06e46212ff8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '881fd2ec6fdf4c76b08b3b24fc16cf81', 'request_id': 'req-ea77f606-1f14-4a07-8521-06e46212ff8a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:33.818982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:33.827280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ea77f606-1f14-4a07-8521-06e46212ff8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '881fd2ec6fdf4c76b08b3b24fc16cf81', 'request_id': 'req-ea77f606-1f14-4a07-8521-06e46212ff8a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:33.844003 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ea77f606-1f14-4a07-8521-06e46212ff8a admin admin] The token cache is being invalidate because project 881fd2ec6fdf4c76b08b3b24fc16cf81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:33.844439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ea77f606-1f14-4a07-8521-06e46212ff8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:33.845504 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ea77f606-1f14-4a07-8521-06e46212ff8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:33.847485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1059/2139] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:33 2022] DELETE /identity/v3/projects/881fd2ec6fdf4c76b08b3b24fc16cf81 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:33.852872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb823ccb-8255-4482-b62b-ab06e6df1f6d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:33.854537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-eb823ccb-8255-4482-b62b-ab06e6df1f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:33.875909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb823ccb-8255-4482-b62b-ab06e6df1f6d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:33.943995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ea131-cd48-4979-85c1-ed5070ab9905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:33.944909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ea131-cd48-4979-85c1-ed5070ab9905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:33.945185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ea131-cd48-4979-85c1-ed5070ab9905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:33.945453 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ea131-cd48-4979-85c1-ed5070ab9905 admin admin] PATH_INFO: `/v3/users/f11a661a81c9494c9220e21ba437c54a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:33.946635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ea131-cd48-4979-85c1-ed5070ab9905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f11a661a81c9494c9220e21ba437c54a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:33.948624 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ea131-cd48-4979-85c1-ed5070ab9905 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:33.991055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:34.001862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c57ea131-cd48-4979-85c1-ed5070ab9905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f11a661a81c9494c9220e21ba437c54a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:34.010770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c57ea131-cd48-4979-85c1-ed5070ab9905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f11a661a81c9494c9220e21ba437c54a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:34.017879 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c57ea131-cd48-4979-85c1-ed5070ab9905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f11a661a81c9494c9220e21ba437c54a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:34.018492 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c57ea131-cd48-4979-85c1-ed5070ab9905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f11a661a81c9494c9220e21ba437c54a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:34.034467 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c57ea131-cd48-4979-85c1-ed5070ab9905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f11a661a81c9494c9220e21ba437c54a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:34.040477 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1081/2140] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:33 2022] DELETE /identity/v3/users/f11a661a81c9494c9220e21ba437c54a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:34.366167 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77f606-1f14-4a07-8521-06e46212ff8a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:34.367652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ea77f606-1f14-4a07-8521-06e46212ff8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:34.381555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77f606-1f14-4a07-8521-06e46212ff8a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:34.455082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b44f59-4618-4ec5-ba28-5c5c55e73136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:34.455984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b44f59-4618-4ec5-ba28-5c5c55e73136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:34.456264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b44f59-4618-4ec5-ba28-5c5c55e73136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:34.456553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b44f59-4618-4ec5-ba28-5c5c55e73136 admin admin] PATH_INFO: `/v3/projects/4ff846c54e4a42a89d7a71d5c0d9e1f5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:34.457790 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b44f59-4618-4ec5-ba28-5c5c55e73136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ff846c54e4a42a89d7a71d5c0d9e1f5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:34.459705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b44f59-4618-4ec5-ba28-5c5c55e73136 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:34.529782 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-28b44f59-4618-4ec5-ba28-5c5c55e73136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ff846c54e4a42a89d7a71d5c0d9e1f5', 'request_id': 'req-28b44f59-4618-4ec5-ba28-5c5c55e73136'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:34.538454 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-28b44f59-4618-4ec5-ba28-5c5c55e73136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ff846c54e4a42a89d7a71d5c0d9e1f5', 'request_id': 'req-28b44f59-4618-4ec5-ba28-5c5c55e73136'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:34.544254 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-28b44f59-4618-4ec5-ba28-5c5c55e73136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ff846c54e4a42a89d7a71d5c0d9e1f5', 'request_id': 'req-28b44f59-4618-4ec5-ba28-5c5c55e73136'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:34.555573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-28b44f59-4618-4ec5-ba28-5c5c55e73136 admin admin] The token cache is being invalidate because project 4ff846c54e4a42a89d7a71d5c0d9e1f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:34.555899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-28b44f59-4618-4ec5-ba28-5c5c55e73136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:34.556636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-28b44f59-4618-4ec5-ba28-5c5c55e73136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:34.558298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1060/2141] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:34 2022] DELETE /identity/v3/projects/4ff846c54e4a42a89d7a71d5c0d9e1f5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:34.565856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4232153-8ce4-43a5-9d08-c18d1f5e06f3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:34.566382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4232153-8ce4-43a5-9d08-c18d1f5e06f3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:34.566382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4232153-8ce4-43a5-9d08-c18d1f5e06f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:34.587443 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e4232153-8ce4-43a5-9d08-c18d1f5e06f3 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:34.588631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e4232153-8ce4-43a5-9d08-c18d1f5e06f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:34.654964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1082/2142] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:34.664834 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca07143-4567-454b-9514-a6165fb0540a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:34.665367 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca07143-4567-454b-9514-a6165fb0540a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:34.665367 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca07143-4567-454b-9514-a6165fb0540a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:34.687459 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-0ca07143-4567-454b-9514-a6165fb0540a None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:34.688707 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0ca07143-4567-454b-9514-a6165fb0540a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:34.705149 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1061/2143] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:34.709649 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4232153-8ce4-43a5-9d08-c18d1f5e06f3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:34.724327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4232153-8ce4-43a5-9d08-c18d1f5e06f3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:34.729113 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5347951-0b9a-4c5a-8f53-b9857cfbf9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:34.729777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5347951-0b9a-4c5a-8f53-b9857cfbf9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:34.730054 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5347951-0b9a-4c5a-8f53-b9857cfbf9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:34.730326 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5347951-0b9a-4c5a-8f53-b9857cfbf9e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:34.731061 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5347951-0b9a-4c5a-8f53-b9857cfbf9e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:34.731366 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5347951-0b9a-4c5a-8f53-b9857cfbf9e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:34.733005 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5347951-0b9a-4c5a-8f53-b9857cfbf9e7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:34.745682 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1083/2144] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:29:34.750450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca07143-4567-454b-9514-a6165fb0540a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:34.761250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca07143-4567-454b-9514-a6165fb0540a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:34.766907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d911c3a-a4e9-4ff5-817d-741db282b6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:34.767713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d911c3a-a4e9-4ff5-817d-741db282b6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:34.768066 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d911c3a-a4e9-4ff5-817d-741db282b6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:34.768345 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d911c3a-a4e9-4ff5-817d-741db282b6f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:34.769087 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d911c3a-a4e9-4ff5-817d-741db282b6f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:34.771007 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d911c3a-a4e9-4ff5-817d-741db282b6f1 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:34.800844 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1062/2145] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:34 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:34.805263 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5347951-0b9a-4c5a-8f53-b9857cfbf9e7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:34.815933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5347951-0b9a-4c5a-8f53-b9857cfbf9e7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:34.874960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbc8bf-28c9-41a4-8341-39b91db433d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:34.875546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbc8bf-28c9-41a4-8341-39b91db433d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:34.875824 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbc8bf-28c9-41a4-8341-39b91db433d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:34.876099 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbc8bf-28c9-41a4-8341-39b91db433d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:34.877380 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbc8bf-28c9-41a4-8341-39b91db433d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:34.879307 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbc8bf-28c9-41a4-8341-39b91db433d2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:34.901810 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1084/2146] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:34 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:29:34.906729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d911c3a-a4e9-4ff5-817d-741db282b6f1 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:34.919086 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d911c3a-a4e9-4ff5-817d-741db282b6f1 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:34.925922 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13da86-b984-4386-832d-20f99c38052d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:34.926635 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13da86-b984-4386-832d-20f99c38052d admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:34.926870 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13da86-b984-4386-832d-20f99c38052d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:34.927131 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13da86-b984-4386-832d-20f99c38052d admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:34.927892 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13da86-b984-4386-832d-20f99c38052d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:34.929505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13da86-b984-4386-832d-20f99c38052d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:34.940687 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1063/2147] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:34.944903 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbc8bf-28c9-41a4-8341-39b91db433d2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:34.955711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbc8bf-28c9-41a4-8341-39b91db433d2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:34.961149 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4512d-64f5-4789-b1b1-39505c8ccac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:34.961909 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4512d-64f5-4789-b1b1-39505c8ccac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:34.962189 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4512d-64f5-4789-b1b1-39505c8ccac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:34.962523 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4512d-64f5-4789-b1b1-39505c8ccac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:34.963265 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4512d-64f5-4789-b1b1-39505c8ccac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:34.964948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4512d-64f5-4789-b1b1-39505c8ccac1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:34.975954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1085/2148] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:34.981466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13da86-b984-4386-832d-20f99c38052d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:34.992769 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13da86-b984-4386-832d-20f99c38052d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:34.998051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aab2c-d925-4c25-a1af-5fd31d1875d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:34.998931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aab2c-d925-4c25-a1af-5fd31d1875d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:34.999246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aab2c-d925-4c25-a1af-5fd31d1875d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:34.999514 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aab2c-d925-4c25-a1af-5fd31d1875d7 admin admin] PATH_INFO: `/v3/projects/0582981124544fb596a7513ca52f11e3/users/b19d98ec04614c28a4aa3e15a964a52e/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:35.016029 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7aab2c-d925-4c25-a1af-5fd31d1875d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0582981124544fb596a7513ca52f11e3, user_id=b19d98ec04614c28a4aa3e15a964a52e, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:35.018891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7aab2c-d925-4c25-a1af-5fd31d1875d7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:35.034615 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1064/2149] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:34 2022] PUT /identity/v3/projects/0582981124544fb596a7513ca52f11e3/users/b19d98ec04614c28a4aa3e15a964a52e/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:35.049165 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91bc89-c967-470d-bd8e-0e63e2a5eb1d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:35.049165 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91bc89-c967-470d-bd8e-0e63e2a5eb1d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:35.049425 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91bc89-c967-470d-bd8e-0e63e2a5eb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:35.075555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2b91bc89-c967-470d-bd8e-0e63e2a5eb1d None None] MFA Rules not processed for user `b19d98ec04614c28a4aa3e15a964a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:35.076800 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2b91bc89-c967-470d-bd8e-0e63e2a5eb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:35.082264 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:35.155276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1086/2150] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:35.160028 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aab2c-d925-4c25-a1af-5fd31d1875d7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:35.173710 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:35.228086 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aab2c-d925-4c25-a1af-5fd31d1875d7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:35.234073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdce63a-01a1-4d04-ae18-b858d340f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:35.234808 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdce63a-01a1-4d04-ae18-b858d340f39a admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:35.235089 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdce63a-01a1-4d04-ae18-b858d340f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:35.235354 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdce63a-01a1-4d04-ae18-b858d340f39a admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:35.236306 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdce63a-01a1-4d04-ae18-b858d340f39a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:35.238693 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdce63a-01a1-4d04-ae18-b858d340f39a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:35.268655 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1065/2151] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:35 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:35.273095 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91bc89-c967-470d-bd8e-0e63e2a5eb1d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:35.289144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91bc89-c967-470d-bd8e-0e63e2a5eb1d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:35.348386 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4f052-c514-44a8-9c1a-5ba3bd6f2002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:35.349080 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4f052-c514-44a8-9c1a-5ba3bd6f2002 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:35.349354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4f052-c514-44a8-9c1a-5ba3bd6f2002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:35.349618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4f052-c514-44a8-9c1a-5ba3bd6f2002 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:35.350316 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4f052-c514-44a8-9c1a-5ba3bd6f2002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:35.352237 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4f052-c514-44a8-9c1a-5ba3bd6f2002 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:35.373113 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1087/2152] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:35 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:29:35.377574 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdce63a-01a1-4d04-ae18-b858d340f39a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:35.388336 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdce63a-01a1-4d04-ae18-b858d340f39a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:35.394653 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf50143-c68d-45ce-b933-342cd93b64b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:35.395290 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf50143-c68d-45ce-b933-342cd93b64b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:35.395750 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf50143-c68d-45ce-b933-342cd93b64b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:35.396032 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf50143-c68d-45ce-b933-342cd93b64b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:35.396922 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf50143-c68d-45ce-b933-342cd93b64b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:35.398868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf50143-c68d-45ce-b933-342cd93b64b2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:35.411040 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1066/2153] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:35.415999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4f052-c514-44a8-9c1a-5ba3bd6f2002 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:35.430381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4f052-c514-44a8-9c1a-5ba3bd6f2002 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:35.438457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5d0a7-29fd-4b31-82e7-549b2e7ca49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:35.439597 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5d0a7-29fd-4b31-82e7-549b2e7ca49d admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:35.439904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5d0a7-29fd-4b31-82e7-549b2e7ca49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:35.440272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5d0a7-29fd-4b31-82e7-549b2e7ca49d admin admin] PATH_INFO: `/v3/projects/b3b2aea30e7c47328c9b83ccceae7d62/users/196f100e2343472f9e2e2bdf42478137/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:35.461407 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5d0a7-29fd-4b31-82e7-549b2e7ca49d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b2aea30e7c47328c9b83ccceae7d62, user_id=196f100e2343472f9e2e2bdf42478137, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:35.464468 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5d0a7-29fd-4b31-82e7-549b2e7ca49d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:35.481384 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1088/2154] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:35 2022] PUT /identity/v3/projects/b3b2aea30e7c47328c9b83ccceae7d62/users/196f100e2343472f9e2e2bdf42478137/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:35.485442 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf50143-c68d-45ce-b933-342cd93b64b2 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:35.496158 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf50143-c68d-45ce-b933-342cd93b64b2 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:35.557670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d556c-3923-48e6-a5a0-c9934025c6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:35.558887 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d556c-3923-48e6-a5a0-c9934025c6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:35.559428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d556c-3923-48e6-a5a0-c9934025c6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:35.559841 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d556c-3923-48e6-a5a0-c9934025c6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:35.560676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d556c-3923-48e6-a5a0-c9934025c6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:35.562889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d556c-3923-48e6-a5a0-c9934025c6e0 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:35.583880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1067/2155] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:29:35.588778 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5d0a7-29fd-4b31-82e7-549b2e7ca49d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:35.602573 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5d0a7-29fd-4b31-82e7-549b2e7ca49d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:35.608371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad31787-d8a5-4fb1-b088-295613f59cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:35.609725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad31787-d8a5-4fb1-b088-295613f59cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:35.610054 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad31787-d8a5-4fb1-b088-295613f59cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:35.610349 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad31787-d8a5-4fb1-b088-295613f59cd1 admin admin] PATH_INFO: `/v3/projects/b3b2aea30e7c47328c9b83ccceae7d62/users/196f100e2343472f9e2e2bdf42478137/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:35.612969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad31787-d8a5-4fb1-b088-295613f59cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b2aea30e7c47328c9b83ccceae7d62, user_id=196f100e2343472f9e2e2bdf42478137, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:35.615638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad31787-d8a5-4fb1-b088-295613f59cd1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:35.627437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1089/2156] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:35 2022] PUT /identity/v3/projects/b3b2aea30e7c47328c9b83ccceae7d62/users/196f100e2343472f9e2e2bdf42478137/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:35.637942 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baaed95-dd26-49f9-9e4c-0b9b60583c0c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:35.638228 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baaed95-dd26-49f9-9e4c-0b9b60583c0c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:35.638513 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baaed95-dd26-49f9-9e4c-0b9b60583c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:35.668310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2baaed95-dd26-49f9-9e4c-0b9b60583c0c None None] MFA Rules not processed for user `196f100e2343472f9e2e2bdf42478137`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:35.669644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2baaed95-dd26-49f9-9e4c-0b9b60583c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:35.740305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1068/2157] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:35.751069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad31787-d8a5-4fb1-b088-295613f59cd1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:35.753097 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6ad31787-d8a5-4fb1-b088-295613f59cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:35.814527 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad31787-d8a5-4fb1-b088-295613f59cd1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:35.818905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a83f1-d379-44bb-a801-167b5bed10e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:35.819574 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a83f1-d379-44bb-a801-167b5bed10e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:35.819961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a83f1-d379-44bb-a801-167b5bed10e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:35.820357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a83f1-d379-44bb-a801-167b5bed10e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:35.836496 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a83f1-d379-44bb-a801-167b5bed10e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:35.838821 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a83f1-d379-44bb-a801-167b5bed10e9 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:35.850660 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1090/2158] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:35.981470 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baaed95-dd26-49f9-9e4c-0b9b60583c0c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:35.982729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2baaed95-dd26-49f9-9e4c-0b9b60583c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:35.997122 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:36.070086 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baaed95-dd26-49f9-9e4c-0b9b60583c0c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:36.079548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01b5ae-2ea1-49f9-bb8f-aa9969f450d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:36.080452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01b5ae-2ea1-49f9-bb8f-aa9969f450d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:36.080844 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01b5ae-2ea1-49f9-bb8f-aa9969f450d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:36.081123 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01b5ae-2ea1-49f9-bb8f-aa9969f450d4 admin admin] PATH_INFO: `/v3/users/b2040ecea7f547c0a5a1909699f2a4f9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:36.082367 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01b5ae-2ea1-49f9-bb8f-aa9969f450d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2040ecea7f547c0a5a1909699f2a4f9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:36.084339 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01b5ae-2ea1-49f9-bb8f-aa9969f450d4 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:36.138595 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-bb01b5ae-2ea1-49f9-bb8f-aa9969f450d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2040ecea7f547c0a5a1909699f2a4f9'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:36.146851 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-bb01b5ae-2ea1-49f9-bb8f-aa9969f450d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2040ecea7f547c0a5a1909699f2a4f9'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:36.160149 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-bb01b5ae-2ea1-49f9-bb8f-aa9969f450d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2040ecea7f547c0a5a1909699f2a4f9'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:36.160844 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-bb01b5ae-2ea1-49f9-bb8f-aa9969f450d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2040ecea7f547c0a5a1909699f2a4f9'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:36.169434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-bb01b5ae-2ea1-49f9-bb8f-aa9969f450d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2040ecea7f547c0a5a1909699f2a4f9'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:36.180534 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1069/2159] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:35 2022] DELETE /identity/v3/users/b2040ecea7f547c0a5a1909699f2a4f9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:36.185005 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e01fe-cec7-41c7-a9b0-8b66b996f813 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:36.185295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e01fe-cec7-41c7-a9b0-8b66b996f813 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:36.185572 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e01fe-cec7-41c7-a9b0-8b66b996f813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:36.193657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:36.208155 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-455e01fe-cec7-41c7-a9b0-8b66b996f813 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:36.209401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-455e01fe-cec7-41c7-a9b0-8b66b996f813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:36.284464 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1091/2160] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:29:36.292044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01b5ae-2ea1-49f9-bb8f-aa9969f450d4 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:36.293562 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bb01b5ae-2ea1-49f9-bb8f-aa9969f450d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:36.377402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01b5ae-2ea1-49f9-bb8f-aa9969f450d4 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:36.381762 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88c46f-fd7e-4479-ba8a-2e1029276822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:36.382552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88c46f-fd7e-4479-ba8a-2e1029276822 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:36.382913 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88c46f-fd7e-4479-ba8a-2e1029276822 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:36.383203 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88c46f-fd7e-4479-ba8a-2e1029276822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:36.395686 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88c46f-fd7e-4479-ba8a-2e1029276822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:36.399055 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88c46f-fd7e-4479-ba8a-2e1029276822 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:36.412321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1070/2161] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:29:36.511508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e01fe-cec7-41c7-a9b0-8b66b996f813 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:36.513040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-455e01fe-cec7-41c7-a9b0-8b66b996f813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:36.529764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e01fe-cec7-41c7-a9b0-8b66b996f813 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:36.535320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4954b-fe3b-4a03-b77b-928f7f1532ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:36.536208 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4954b-fe3b-4a03-b77b-928f7f1532ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:36.536559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4954b-fe3b-4a03-b77b-928f7f1532ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:36.536824 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4954b-fe3b-4a03-b77b-928f7f1532ce admin admin] PATH_INFO: `/v3/users/b19d98ec04614c28a4aa3e15a964a52e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:36.538207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4954b-fe3b-4a03-b77b-928f7f1532ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b19d98ec04614c28a4aa3e15a964a52e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:36.540142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4954b-fe3b-4a03-b77b-928f7f1532ce admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:36.603691 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fdb4954b-fe3b-4a03-b77b-928f7f1532ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19d98ec04614c28a4aa3e15a964a52e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:36.613218 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fdb4954b-fe3b-4a03-b77b-928f7f1532ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19d98ec04614c28a4aa3e15a964a52e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:36.621093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fdb4954b-fe3b-4a03-b77b-928f7f1532ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19d98ec04614c28a4aa3e15a964a52e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:36.622018 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fdb4954b-fe3b-4a03-b77b-928f7f1532ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19d98ec04614c28a4aa3e15a964a52e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:36.641586 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fdb4954b-fe3b-4a03-b77b-928f7f1532ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19d98ec04614c28a4aa3e15a964a52e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:36.648600 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1092/2162] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:36 2022] DELETE /identity/v3/users/b19d98ec04614c28a4aa3e15a964a52e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:36.653112 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228551d4-b30b-42e4-bfac-36d67866be07 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:36.653405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228551d4-b30b-42e4-bfac-36d67866be07 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:36.653686 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228551d4-b30b-42e4-bfac-36d67866be07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:36.671207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-228551d4-b30b-42e4-bfac-36d67866be07 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:36.672588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-228551d4-b30b-42e4-bfac-36d67866be07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:36.701096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:36.731984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4954b-fe3b-4a03-b77b-928f7f1532ce admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:36.733478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fdb4954b-fe3b-4a03-b77b-928f7f1532ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:36.753162 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1071/2163] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:36.769011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228551d4-b30b-42e4-bfac-36d67866be07 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:36.772720 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-228551d4-b30b-42e4-bfac-36d67866be07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:36.833615 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4954b-fe3b-4a03-b77b-928f7f1532ce admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:36.838815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0fc41-5a70-479f-a4c8-925ead799608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:36.839664 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0fc41-5a70-479f-a4c8-925ead799608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:36.840012 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0fc41-5a70-479f-a4c8-925ead799608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:36.840347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0fc41-5a70-479f-a4c8-925ead799608 admin admin] PATH_INFO: `/v3/projects/53dbc1f4a71d431985cd4ef3af7f6d04` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:36.841661 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0fc41-5a70-479f-a4c8-925ead799608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53dbc1f4a71d431985cd4ef3af7f6d04)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:36.843696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0fc41-5a70-479f-a4c8-925ead799608 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:36.851389 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228551d4-b30b-42e4-bfac-36d67866be07 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:36.855719 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf203f8-4c15-462f-9412-cee0af91cd9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:36.856672 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf203f8-4c15-462f-9412-cee0af91cd9b service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:36.857138 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf203f8-4c15-462f-9412-cee0af91cd9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:36.857476 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf203f8-4c15-462f-9412-cee0af91cd9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:36.863527 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:36.869535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf203f8-4c15-462f-9412-cee0af91cd9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:36.872586 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf203f8-4c15-462f-9412-cee0af91cd9b service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:36.885269 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1072/2164] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:36.909433 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-16f0fc41-5a70-479f-a4c8-925ead799608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53dbc1f4a71d431985cd4ef3af7f6d04', 'request_id': 'req-16f0fc41-5a70-479f-a4c8-925ead799608'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:36.918815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-16f0fc41-5a70-479f-a4c8-925ead799608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53dbc1f4a71d431985cd4ef3af7f6d04', 'request_id': 'req-16f0fc41-5a70-479f-a4c8-925ead799608'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:36.925416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-16f0fc41-5a70-479f-a4c8-925ead799608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53dbc1f4a71d431985cd4ef3af7f6d04', 'request_id': 'req-16f0fc41-5a70-479f-a4c8-925ead799608'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:36.937995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-16f0fc41-5a70-479f-a4c8-925ead799608 admin admin] The token cache is being invalidate because project 53dbc1f4a71d431985cd4ef3af7f6d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:36.938286 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-16f0fc41-5a70-479f-a4c8-925ead799608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:36.939244 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-16f0fc41-5a70-479f-a4c8-925ead799608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:36.941199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1093/2165] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:36 2022] DELETE /identity/v3/projects/53dbc1f4a71d431985cd4ef3af7f6d04 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:36.946211 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2eaf46-ff4a-4995-9878-6d4051f44669 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:36.946626 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2eaf46-ff4a-4995-9878-6d4051f44669 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:36.947033 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2eaf46-ff4a-4995-9878-6d4051f44669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:36.966494 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ee2eaf46-ff4a-4995-9878-6d4051f44669 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:36.967802 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ee2eaf46-ff4a-4995-9878-6d4051f44669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:37.033630 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1073/2166] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:37.041981 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fff017-c918-46ad-8b16-9fda9efe3df1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:37.042275 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fff017-c918-46ad-8b16-9fda9efe3df1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:37.042555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fff017-c918-46ad-8b16-9fda9efe3df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:37.061851 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-55fff017-c918-46ad-8b16-9fda9efe3df1 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:37.063071 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-55fff017-c918-46ad-8b16-9fda9efe3df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:37.071131 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1094/2167] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:37.075968 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2eaf46-ff4a-4995-9878-6d4051f44669 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:37.086602 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2eaf46-ff4a-4995-9878-6d4051f44669 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:37.091340 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91460acb-1dd0-467a-aee9-206db4a0b302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:37.092006 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91460acb-1dd0-467a-aee9-206db4a0b302 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:37.092287 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91460acb-1dd0-467a-aee9-206db4a0b302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:37.092595 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91460acb-1dd0-467a-aee9-206db4a0b302 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:37.093330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91460acb-1dd0-467a-aee9-206db4a0b302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:37.093635 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91460acb-1dd0-467a-aee9-206db4a0b302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:37.095782 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91460acb-1dd0-467a-aee9-206db4a0b302 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:37.108552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1074/2168] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:29:37.112363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fff017-c918-46ad-8b16-9fda9efe3df1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:37.121922 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fff017-c918-46ad-8b16-9fda9efe3df1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:37.127260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce81543-6413-4341-b753-5f8da724c075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:37.127926 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce81543-6413-4341-b753-5f8da724c075 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:37.128412 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce81543-6413-4341-b753-5f8da724c075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:37.128785 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce81543-6413-4341-b753-5f8da724c075 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:37.129588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce81543-6413-4341-b753-5f8da724c075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:37.131869 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce81543-6413-4341-b753-5f8da724c075 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:37.164550 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1095/2169] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:37 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:37.168794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91460acb-1dd0-467a-aee9-206db4a0b302 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:37.181585 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce81543-6413-4341-b753-5f8da724c075 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:37.183895 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91460acb-1dd0-467a-aee9-206db4a0b302 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:37.184679 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fce81543-6413-4341-b753-5f8da724c075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:37.258002 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce81543-6413-4341-b753-5f8da724c075 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:37.261306 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36482e-a606-44c8-91ff-dfb53167a626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:37.261970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36482e-a606-44c8-91ff-dfb53167a626 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:37.262238 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36482e-a606-44c8-91ff-dfb53167a626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:37.262509 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36482e-a606-44c8-91ff-dfb53167a626 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:37.262966 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f04074-8b6c-4ac2-9215-2cd755e9b640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:37.263205 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36482e-a606-44c8-91ff-dfb53167a626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:37.263971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f04074-8b6c-4ac2-9215-2cd755e9b640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:37.264299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f04074-8b6c-4ac2-9215-2cd755e9b640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:37.264677 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f04074-8b6c-4ac2-9215-2cd755e9b640 admin admin] PATH_INFO: `/v3/projects/0582981124544fb596a7513ca52f11e3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:37.265182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36482e-a606-44c8-91ff-dfb53167a626 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:37.265906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f04074-8b6c-4ac2-9215-2cd755e9b640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0582981124544fb596a7513ca52f11e3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:37.267915 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f04074-8b6c-4ac2-9215-2cd755e9b640 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:37.271851 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:37.287721 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1075/2170] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:37 2022] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:29:37.291846 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36482e-a606-44c8-91ff-dfb53167a626 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:37.301308 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36482e-a606-44c8-91ff-dfb53167a626 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:37.307210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e53fb-f18e-414b-849e-e6b6d0602bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:37.307980 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e53fb-f18e-414b-849e-e6b6d0602bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:37.308266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e53fb-f18e-414b-849e-e6b6d0602bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:37.308576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e53fb-f18e-414b-849e-e6b6d0602bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:37.309333 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e53fb-f18e-414b-849e-e6b6d0602bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:37.310982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e53fb-f18e-414b-849e-e6b6d0602bc9 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:37.324810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1076/2171] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:37.324994 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-43f04074-8b6c-4ac2-9215-2cd755e9b640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0582981124544fb596a7513ca52f11e3', 'request_id': 'req-43f04074-8b6c-4ac2-9215-2cd755e9b640'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:37.326185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e53fb-f18e-414b-849e-e6b6d0602bc9 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:37.333730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-43f04074-8b6c-4ac2-9215-2cd755e9b640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0582981124544fb596a7513ca52f11e3', 'request_id': 'req-43f04074-8b6c-4ac2-9215-2cd755e9b640'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:37.337218 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e53fb-f18e-414b-849e-e6b6d0602bc9 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:37.339446 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-43f04074-8b6c-4ac2-9215-2cd755e9b640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0582981124544fb596a7513ca52f11e3', 'request_id': 'req-43f04074-8b6c-4ac2-9215-2cd755e9b640'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:37.351084 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-43f04074-8b6c-4ac2-9215-2cd755e9b640 admin admin] The token cache is being invalidate because project 0582981124544fb596a7513ca52f11e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:37.351426 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-43f04074-8b6c-4ac2-9215-2cd755e9b640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:37.352087 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-43f04074-8b6c-4ac2-9215-2cd755e9b640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:37.354123 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1096/2172] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:37 2022] DELETE /identity/v3/projects/0582981124544fb596a7513ca52f11e3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:37.358133 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f04074-8b6c-4ac2-9215-2cd755e9b640 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:37.359541 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-43f04074-8b6c-4ac2-9215-2cd755e9b640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:37.369547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:37.409615 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71824767-ff2e-4a08-bf8a-5cf8a7d5db14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:37.410451 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71824767-ff2e-4a08-bf8a-5cf8a7d5db14 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:37.411193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71824767-ff2e-4a08-bf8a-5cf8a7d5db14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:37.411193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71824767-ff2e-4a08-bf8a-5cf8a7d5db14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:37.412074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71824767-ff2e-4a08-bf8a-5cf8a7d5db14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:37.413750 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71824767-ff2e-4a08-bf8a-5cf8a7d5db14 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:37.428372 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1077/2173] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:29:37.429680 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71824767-ff2e-4a08-bf8a-5cf8a7d5db14 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:37.431969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-71824767-ff2e-4a08-bf8a-5cf8a7d5db14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:37.440565 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f04074-8b6c-4ac2-9215-2cd755e9b640 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:37.445527 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71824767-ff2e-4a08-bf8a-5cf8a7d5db14 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:37.445837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f742fa-9ae3-4b35-8275-e1124010c18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:37.446881 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f742fa-9ae3-4b35-8275-e1124010c18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:37.447320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f742fa-9ae3-4b35-8275-e1124010c18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:37.447594 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f742fa-9ae3-4b35-8275-e1124010c18e admin admin] PATH_INFO: `/v3/users/196f100e2343472f9e2e2bdf42478137` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:37.448822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f742fa-9ae3-4b35-8275-e1124010c18e admin admin] RBAC: Authorizing `identity:delete_user(user_id=196f100e2343472f9e2e2bdf42478137)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:37.450720 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4edf4f-3ba6-4ab4-931c-5320901b2256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:37.450846 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f742fa-9ae3-4b35-8275-e1124010c18e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:37.451634 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4edf4f-3ba6-4ab4-931c-5320901b2256 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:37.451917 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4edf4f-3ba6-4ab4-931c-5320901b2256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:37.452197 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4edf4f-3ba6-4ab4-931c-5320901b2256 admin admin] PATH_INFO: `/v3/projects/100bafe8ccf944b190155a2c01b064ed/users/7bf66f1ad96d4ffd8034bcebc4c99e99/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:37.468216 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4edf4f-3ba6-4ab4-931c-5320901b2256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100bafe8ccf944b190155a2c01b064ed, user_id=7bf66f1ad96d4ffd8034bcebc4c99e99, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:37.476130 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4edf4f-3ba6-4ab4-931c-5320901b2256 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:37.505169 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1078/2174] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:37 2022] PUT /identity/v3/projects/100bafe8ccf944b190155a2c01b064ed/users/7bf66f1ad96d4ffd8034bcebc4c99e99/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:37.507657 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a9a0-8239-47c0-b7c8-d5db1ce12c63 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:37.508258 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a9a0-8239-47c0-b7c8-d5db1ce12c63 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:37.508550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a9a0-8239-47c0-b7c8-d5db1ce12c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:37.510398 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-01f742fa-9ae3-4b35-8275-e1124010c18e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196f100e2343472f9e2e2bdf42478137'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:37.521093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-01f742fa-9ae3-4b35-8275-e1124010c18e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196f100e2343472f9e2e2bdf42478137'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:37.534078 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-01f742fa-9ae3-4b35-8275-e1124010c18e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196f100e2343472f9e2e2bdf42478137'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:37.535762 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-01f742fa-9ae3-4b35-8275-e1124010c18e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196f100e2343472f9e2e2bdf42478137'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:37.540590 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6246a9a0-8239-47c0-b7c8-d5db1ce12c63 None None] MFA Rules not processed for user `7bf66f1ad96d4ffd8034bcebc4c99e99`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:37.541818 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6246a9a0-8239-47c0-b7c8-d5db1ce12c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:37.550711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-01f742fa-9ae3-4b35-8275-e1124010c18e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196f100e2343472f9e2e2bdf42478137'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:37.560254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1097/2175] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:37 2022] DELETE /identity/v3/users/196f100e2343472f9e2e2bdf42478137 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:37.634153 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1079/2176] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:37.638910 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f742fa-9ae3-4b35-8275-e1124010c18e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:37.640391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-01f742fa-9ae3-4b35-8275-e1124010c18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:37.743516 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f742fa-9ae3-4b35-8275-e1124010c18e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:37.748435 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c732e-ee19-458b-8820-dc4a0da80e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:37.749183 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c732e-ee19-458b-8820-dc4a0da80e12 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:37.749464 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c732e-ee19-458b-8820-dc4a0da80e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:37.749739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c732e-ee19-458b-8820-dc4a0da80e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:37.750537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c732e-ee19-458b-8820-dc4a0da80e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:37.752642 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c732e-ee19-458b-8820-dc4a0da80e12 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:37.781981 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1098/2177] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:37 2022] POST /identity/v3/projects => generated 363 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:37.786290 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246a9a0-8239-47c0-b7c8-d5db1ce12c63 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:37.833444 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:37.856281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246a9a0-8239-47c0-b7c8-d5db1ce12c63 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:37.890175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c732e-ee19-458b-8820-dc4a0da80e12 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:37.893599 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-644c732e-ee19-458b-8820-dc4a0da80e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:37.915517 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:37.943014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd193909-f3ec-4acc-874c-98e1aaf13997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:37.943990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd193909-f3ec-4acc-874c-98e1aaf13997 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:37.944900 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd193909-f3ec-4acc-874c-98e1aaf13997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:37.945014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd193909-f3ec-4acc-874c-98e1aaf13997 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:37.945882 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd193909-f3ec-4acc-874c-98e1aaf13997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:37.947813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd193909-f3ec-4acc-874c-98e1aaf13997 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:37.971281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1080/2178] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:37 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:37.976192 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd193909-f3ec-4acc-874c-98e1aaf13997 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:37.986813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd193909-f3ec-4acc-874c-98e1aaf13997 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:37.988280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c732e-ee19-458b-8820-dc4a0da80e12 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:37.993760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f5c34-b0e9-47f8-80d3-747806296d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:37.994078 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2dcbd-6227-48f5-9332-053ea7286465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:37.994634 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f5c34-b0e9-47f8-80d3-747806296d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:37.994912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f5c34-b0e9-47f8-80d3-747806296d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:37.995184 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f5c34-b0e9-47f8-80d3-747806296d42 admin admin] PATH_INFO: `/v3/projects/b3b2aea30e7c47328c9b83ccceae7d62` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:37.995575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2dcbd-6227-48f5-9332-053ea7286465 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:37.996030 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2dcbd-6227-48f5-9332-053ea7286465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:37.996422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f5c34-b0e9-47f8-80d3-747806296d42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b2aea30e7c47328c9b83ccceae7d62)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:37.996679 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2dcbd-6227-48f5-9332-053ea7286465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:37.997704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2dcbd-6227-48f5-9332-053ea7286465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:37.998688 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f5c34-b0e9-47f8-80d3-747806296d42 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:37.999797 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2dcbd-6227-48f5-9332-053ea7286465 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:38.016186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1081/2179] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:29:38.017876 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2dcbd-6227-48f5-9332-053ea7286465 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:38.028221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2dcbd-6227-48f5-9332-053ea7286465 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:38.033609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132757d-7df1-48a2-9777-b7024dcc77bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:38.034566 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132757d-7df1-48a2-9777-b7024dcc77bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:38.034849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132757d-7df1-48a2-9777-b7024dcc77bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:38.035147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132757d-7df1-48a2-9777-b7024dcc77bf admin admin] PATH_INFO: `/v3/projects/3e0945fbe71140bb9f047219e9d59dc3/users/b09c917784f0431cb83cf7d05a06d2ce/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:38.060416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-276f5c34-b0e9-47f8-80d3-747806296d42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b2aea30e7c47328c9b83ccceae7d62', 'request_id': 'req-276f5c34-b0e9-47f8-80d3-747806296d42'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:38.062694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132757d-7df1-48a2-9777-b7024dcc77bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0945fbe71140bb9f047219e9d59dc3, user_id=b09c917784f0431cb83cf7d05a06d2ce, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:38.067251 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132757d-7df1-48a2-9777-b7024dcc77bf admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:38.073077 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-276f5c34-b0e9-47f8-80d3-747806296d42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b2aea30e7c47328c9b83ccceae7d62', 'request_id': 'req-276f5c34-b0e9-47f8-80d3-747806296d42'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:38.086984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-276f5c34-b0e9-47f8-80d3-747806296d42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b2aea30e7c47328c9b83ccceae7d62', 'request_id': 'req-276f5c34-b0e9-47f8-80d3-747806296d42'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:38.088111 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1082/2180] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:38 2022] PUT /identity/v3/projects/3e0945fbe71140bb9f047219e9d59dc3/users/b09c917784f0431cb83cf7d05a06d2ce/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:38.091966 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132757d-7df1-48a2-9777-b7024dcc77bf admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:38.120368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-276f5c34-b0e9-47f8-80d3-747806296d42 admin admin] The token cache is being invalidate because project b3b2aea30e7c47328c9b83ccceae7d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:38.121003 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-276f5c34-b0e9-47f8-80d3-747806296d42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:38.121423 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-276f5c34-b0e9-47f8-80d3-747806296d42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:38.126286 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1099/2181] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:37 2022] DELETE /identity/v3/projects/b3b2aea30e7c47328c9b83ccceae7d62 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:29:38.127920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9090b87-cd40-4309-a782-49f915006bdc None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:38.128151 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9090b87-cd40-4309-a782-49f915006bdc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:38.128426 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9090b87-cd40-4309-a782-49f915006bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:38.152603 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f9090b87-cd40-4309-a782-49f915006bdc None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:38.153822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f9090b87-cd40-4309-a782-49f915006bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:38.177793 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132757d-7df1-48a2-9777-b7024dcc77bf admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:38.184132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d19a6-be69-43bc-895c-6b4379ba786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:38.185204 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d19a6-be69-43bc-895c-6b4379ba786d admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:38.186091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d19a6-be69-43bc-895c-6b4379ba786d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:38.186091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d19a6-be69-43bc-895c-6b4379ba786d admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:38.186804 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d19a6-be69-43bc-895c-6b4379ba786d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:38.189402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d19a6-be69-43bc-895c-6b4379ba786d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:38.201925 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1083/2182] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:29:38.206394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d19a6-be69-43bc-895c-6b4379ba786d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:38.208361 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5f3d19a6-be69-43bc-895c-6b4379ba786d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:38.221881 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1100/2183] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:38.223155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d19a6-be69-43bc-895c-6b4379ba786d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:38.229554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2ba5f-066a-40bd-9056-5213bf9c9526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:38.229887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540db75-5c4f-4280-8a1f-49d8da9a0e6f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:38.230182 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540db75-5c4f-4280-8a1f-49d8da9a0e6f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:38.230441 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2ba5f-066a-40bd-9056-5213bf9c9526 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:38.230633 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540db75-5c4f-4280-8a1f-49d8da9a0e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:38.230729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2ba5f-066a-40bd-9056-5213bf9c9526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:38.230974 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2ba5f-066a-40bd-9056-5213bf9c9526 admin admin] PATH_INFO: `/v3/projects/3e0945fbe71140bb9f047219e9d59dc3/users/b09c917784f0431cb83cf7d05a06d2ce/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:38.233236 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2ba5f-066a-40bd-9056-5213bf9c9526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0945fbe71140bb9f047219e9d59dc3, user_id=b09c917784f0431cb83cf7d05a06d2ce, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:38.236395 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2ba5f-066a-40bd-9056-5213bf9c9526 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:38.251396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3540db75-5c4f-4280-8a1f-49d8da9a0e6f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:38.252598 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1084/2184] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:38 2022] PUT /identity/v3/projects/3e0945fbe71140bb9f047219e9d59dc3/users/b09c917784f0431cb83cf7d05a06d2ce/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:38.252736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3540db75-5c4f-4280-8a1f-49d8da9a0e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:38.261371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422fed5-f35b-42e4-a3dc-a1c378e23b84 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:38.262124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422fed5-f35b-42e4-a3dc-a1c378e23b84 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:38.262124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422fed5-f35b-42e4-a3dc-a1c378e23b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:38.297221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-1422fed5-f35b-42e4-a3dc-a1c378e23b84 None None] MFA Rules not processed for user `b09c917784f0431cb83cf7d05a06d2ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:38.298533 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1422fed5-f35b-42e4-a3dc-a1c378e23b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:38.312931 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:38.313157 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:38.346069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1101/2185] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:38.350387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540db75-5c4f-4280-8a1f-49d8da9a0e6f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:38.359668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540db75-5c4f-4280-8a1f-49d8da9a0e6f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:38.372152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887410e-8a09-4982-9592-1429d19429c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:38.373033 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887410e-8a09-4982-9592-1429d19429c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:38.373319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887410e-8a09-4982-9592-1429d19429c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:38.373598 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887410e-8a09-4982-9592-1429d19429c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:38.374378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887410e-8a09-4982-9592-1429d19429c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:38.374694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887410e-8a09-4982-9592-1429d19429c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:38.376467 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887410e-8a09-4982-9592-1429d19429c2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:38.387557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1085/2186] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:38 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:29:38.393491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1102/2187] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:29:38.394758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422fed5-f35b-42e4-a3dc-a1c378e23b84 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:38.399545 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887410e-8a09-4982-9592-1429d19429c2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:38.402812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c887410e-8a09-4982-9592-1429d19429c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:38.405202 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422fed5-f35b-42e4-a3dc-a1c378e23b84 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:38.409836 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbab689-9383-4187-9ba4-7ed306eeb9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:38.410498 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbab689-9383-4187-9ba4-7ed306eeb9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:38.410777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbab689-9383-4187-9ba4-7ed306eeb9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:38.411049 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbab689-9383-4187-9ba4-7ed306eeb9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:38.411746 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbab689-9383-4187-9ba4-7ed306eeb9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:38.413691 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbab689-9383-4187-9ba4-7ed306eeb9c9 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:38.449676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1086/2188] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:38 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:38.453706 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbab689-9383-4187-9ba4-7ed306eeb9c9 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:38.472124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887410e-8a09-4982-9592-1429d19429c2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:38.517667 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbab689-9383-4187-9ba4-7ed306eeb9c9 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:38.522774 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac052b33-3a27-4454-aaa4-b791b944fc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:38.522918 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e9e9d-d115-459f-80e6-bce432e98154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:38.523441 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac052b33-3a27-4454-aaa4-b791b944fc36 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:38.523552 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e9e9d-d115-459f-80e6-bce432e98154 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:38.523718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac052b33-3a27-4454-aaa4-b791b944fc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:38.523812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e9e9d-d115-459f-80e6-bce432e98154 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:38.523988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac052b33-3a27-4454-aaa4-b791b944fc36 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:38.524078 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e9e9d-d115-459f-80e6-bce432e98154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:38.524712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac052b33-3a27-4454-aaa4-b791b944fc36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:38.526688 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac052b33-3a27-4454-aaa4-b791b944fc36 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:38.549112 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1087/2189] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:38 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:29:38.553150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac052b33-3a27-4454-aaa4-b791b944fc36 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:38.563318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac052b33-3a27-4454-aaa4-b791b944fc36 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:38.567876 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e4248-dab6-447b-a08e-83b3117ef2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:38.568541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e4248-dab6-447b-a08e-83b3117ef2af admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:38.568867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e4248-dab6-447b-a08e-83b3117ef2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:38.569142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e4248-dab6-447b-a08e-83b3117ef2af admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:38.569855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e4248-dab6-447b-a08e-83b3117ef2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:38.571446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e4248-dab6-447b-a08e-83b3117ef2af admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:38.584294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1088/2190] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:29:38.585327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e4248-dab6-447b-a08e-83b3117ef2af admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:38.591023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e9e9d-d115-459f-80e6-bce432e98154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:38.592470 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e9e9d-d115-459f-80e6-bce432e98154 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:38.595187 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e4248-dab6-447b-a08e-83b3117ef2af admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:38.599829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b12b3-f049-4c08-87a9-4e2d588a1555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:38.600457 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b12b3-f049-4c08-87a9-4e2d588a1555 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:38.600766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b12b3-f049-4c08-87a9-4e2d588a1555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:38.601057 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b12b3-f049-4c08-87a9-4e2d588a1555 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:38.601741 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b12b3-f049-4c08-87a9-4e2d588a1555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:38.602857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1103/2191] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:38 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:29:38.603310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b12b3-f049-4c08-87a9-4e2d588a1555 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:38.618209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1089/2192] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:38.622481 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e9e9d-d115-459f-80e6-bce432e98154 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:38.633234 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e9e9d-d115-459f-80e6-bce432e98154 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:38.639620 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecf1b6-5ba3-47ee-88b7-5b29d11ff7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:38.639620 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecf1b6-5ba3-47ee-88b7-5b29d11ff7a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:38.639620 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecf1b6-5ba3-47ee-88b7-5b29d11ff7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:38.639620 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecf1b6-5ba3-47ee-88b7-5b29d11ff7a1 admin admin] PATH_INFO: `/v3/projects/4c82c4e943cd40889de747d039388eca/users/231d54dea5574b4f8dd61d081d991bec/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:38.655098 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecf1b6-5ba3-47ee-88b7-5b29d11ff7a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c82c4e943cd40889de747d039388eca, user_id=231d54dea5574b4f8dd61d081d991bec, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:38.657748 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecf1b6-5ba3-47ee-88b7-5b29d11ff7a1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:38.679109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1104/2193] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:38 2022] PUT /identity/v3/projects/4c82c4e943cd40889de747d039388eca/users/231d54dea5574b4f8dd61d081d991bec/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:38.683570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b12b3-f049-4c08-87a9-4e2d588a1555 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:38.690015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a61248-8ecf-4f5f-be24-fc4d1b3b7ae1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:38.690302 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a61248-8ecf-4f5f-be24-fc4d1b3b7ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:38.690580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a61248-8ecf-4f5f-be24-fc4d1b3b7ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:38.694220 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b12b3-f049-4c08-87a9-4e2d588a1555 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:38.714606 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:38.725187 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-02a61248-8ecf-4f5f-be24-fc4d1b3b7ae1 None None] MFA Rules not processed for user `231d54dea5574b4f8dd61d081d991bec`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:38.727319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-02a61248-8ecf-4f5f-be24-fc4d1b3b7ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:38.754925 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaf60e-7c48-422f-b2e9-8b9c30f3228c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:38.755573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaf60e-7c48-422f-b2e9-8b9c30f3228c service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:38.755847 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaf60e-7c48-422f-b2e9-8b9c30f3228c service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:38.756145 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaf60e-7c48-422f-b2e9-8b9c30f3228c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:38.757997 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9faaf60e-7c48-422f-b2e9-8b9c30f3228c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:38.767136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:38.802994 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1105/2194] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:38.814043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a61248-8ecf-4f5f-be24-fc4d1b3b7ae1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:38.815473 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-02a61248-8ecf-4f5f-be24-fc4d1b3b7ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:38.819295 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faaf60e-7c48-422f-b2e9-8b9c30f3228c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:38.820805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faaf60e-7c48-422f-b2e9-8b9c30f3228c service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:38.827057 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a61248-8ecf-4f5f-be24-fc4d1b3b7ae1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:38.829812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1090/2195] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:29:38.830822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d30c57-6f0b-4c14-b643-73c759c23803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:38.831455 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d30c57-6f0b-4c14-b643-73c759c23803 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:38.831731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d30c57-6f0b-4c14-b643-73c759c23803 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:38.832033 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d30c57-6f0b-4c14-b643-73c759c23803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:38.840660 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d30c57-6f0b-4c14-b643-73c759c23803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:38.842824 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d30c57-6f0b-4c14-b643-73c759c23803 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:38.854768 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1106/2196] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:29:38.879784 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaf60e-7c48-422f-b2e9-8b9c30f3228c service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:38.954160 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaf60e-7c48-422f-b2e9-8b9c30f3228c service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:38.959488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6165378-bed9-40e7-8afa-ed41d96a0600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:38.960447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6165378-bed9-40e7-8afa-ed41d96a0600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:38.960868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6165378-bed9-40e7-8afa-ed41d96a0600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:38.961211 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6165378-bed9-40e7-8afa-ed41d96a0600 admin admin] PATH_INFO: `/v3/users/231d54dea5574b4f8dd61d081d991bec` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:38.962431 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6165378-bed9-40e7-8afa-ed41d96a0600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=231d54dea5574b4f8dd61d081d991bec)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:38.964407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6165378-bed9-40e7-8afa-ed41d96a0600 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:39.014925 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c6165378-bed9-40e7-8afa-ed41d96a0600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231d54dea5574b4f8dd61d081d991bec'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:39.023343 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c6165378-bed9-40e7-8afa-ed41d96a0600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231d54dea5574b4f8dd61d081d991bec'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:39.036632 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c6165378-bed9-40e7-8afa-ed41d96a0600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231d54dea5574b4f8dd61d081d991bec'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:39.037364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c6165378-bed9-40e7-8afa-ed41d96a0600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231d54dea5574b4f8dd61d081d991bec'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:39.044324 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c6165378-bed9-40e7-8afa-ed41d96a0600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231d54dea5574b4f8dd61d081d991bec'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:39.051442 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1091/2197] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:38 2022] DELETE /identity/v3/users/231d54dea5574b4f8dd61d081d991bec => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:39.056272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433321a4-d2fb-4586-b2f5-7198263ac25f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:39.056663 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433321a4-d2fb-4586-b2f5-7198263ac25f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:39.056989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433321a4-d2fb-4586-b2f5-7198263ac25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:39.075074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-433321a4-d2fb-4586-b2f5-7198263ac25f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:39.076271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-433321a4-d2fb-4586-b2f5-7198263ac25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:39.138806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1107/2198] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:39.152545 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6165378-bed9-40e7-8afa-ed41d96a0600 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:39.154166 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c6165378-bed9-40e7-8afa-ed41d96a0600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:39.189090 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:39.216999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6165378-bed9-40e7-8afa-ed41d96a0600 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:39.222168 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3b251-ffdf-47af-b6d4-c27fdc1bbc4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:39.222829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3b251-ffdf-47af-b6d4-c27fdc1bbc4b service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:39.223108 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3b251-ffdf-47af-b6d4-c27fdc1bbc4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:39.223378 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3b251-ffdf-47af-b6d4-c27fdc1bbc4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:39.232778 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3b251-ffdf-47af-b6d4-c27fdc1bbc4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:39.234304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3b251-ffdf-47af-b6d4-c27fdc1bbc4b service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:39.244989 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1092/2199] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:39.664012 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433321a4-d2fb-4586-b2f5-7198263ac25f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:39.668405 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-433321a4-d2fb-4586-b2f5-7198263ac25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:39.689710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433321a4-d2fb-4586-b2f5-7198263ac25f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:39.694877 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd129a5-3c47-45ff-b610-8043313d6a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:39.695751 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd129a5-3c47-45ff-b610-8043313d6a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:39.696046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd129a5-3c47-45ff-b610-8043313d6a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:39.696382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd129a5-3c47-45ff-b610-8043313d6a6d admin admin] PATH_INFO: `/v3/projects/4c82c4e943cd40889de747d039388eca` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:39.697580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd129a5-3c47-45ff-b610-8043313d6a6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c82c4e943cd40889de747d039388eca)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:39.699534 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd129a5-3c47-45ff-b610-8043313d6a6d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:39.752324 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4dd129a5-3c47-45ff-b610-8043313d6a6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c82c4e943cd40889de747d039388eca', 'request_id': 'req-4dd129a5-3c47-45ff-b610-8043313d6a6d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:39.762467 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4dd129a5-3c47-45ff-b610-8043313d6a6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c82c4e943cd40889de747d039388eca', 'request_id': 'req-4dd129a5-3c47-45ff-b610-8043313d6a6d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:39.769300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4dd129a5-3c47-45ff-b610-8043313d6a6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c82c4e943cd40889de747d039388eca', 'request_id': 'req-4dd129a5-3c47-45ff-b610-8043313d6a6d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:39.780880 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4dd129a5-3c47-45ff-b610-8043313d6a6d admin admin] The token cache is being invalidate because project 4c82c4e943cd40889de747d039388eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:39.781298 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4dd129a5-3c47-45ff-b610-8043313d6a6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:39.781965 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4dd129a5-3c47-45ff-b610-8043313d6a6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:39.783827 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1108/2200] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:39 2022] DELETE /identity/v3/projects/4c82c4e943cd40889de747d039388eca => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:39.793938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d2930-ebf2-44d6-ad5d-6d5b412f52a2 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:39.793938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d2930-ebf2-44d6-ad5d-6d5b412f52a2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:39.793938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d2930-ebf2-44d6-ad5d-6d5b412f52a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:39.813208 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-647d2930-ebf2-44d6-ad5d-6d5b412f52a2 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:39.814556 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-647d2930-ebf2-44d6-ad5d-6d5b412f52a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:39.886287 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1093/2201] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:39.894984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0e704-b3cd-4248-a40b-7a9fbc3bfd2c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:39.895278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0e704-b3cd-4248-a40b-7a9fbc3bfd2c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:39.895552 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0e704-b3cd-4248-a40b-7a9fbc3bfd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:39.916065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-66c0e704-b3cd-4248-a40b-7a9fbc3bfd2c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:39.917317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-66c0e704-b3cd-4248-a40b-7a9fbc3bfd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:39.926341 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1109/2202] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:39.931427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d2930-ebf2-44d6-ad5d-6d5b412f52a2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:39.947103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d2930-ebf2-44d6-ad5d-6d5b412f52a2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:39.955816 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc8958-0c63-49f3-8173-6e6d961a52e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:39.956467 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc8958-0c63-49f3-8173-6e6d961a52e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:39.956776 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc8958-0c63-49f3-8173-6e6d961a52e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:39.957037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc8958-0c63-49f3-8173-6e6d961a52e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:39.957903 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc8958-0c63-49f3-8173-6e6d961a52e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:39.958210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc8958-0c63-49f3-8173-6e6d961a52e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:39.960611 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc8958-0c63-49f3-8173-6e6d961a52e7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:39.976403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1094/2203] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:29:39.980786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0e704-b3cd-4248-a40b-7a9fbc3bfd2c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:39.987146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:39.993108 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0e704-b3cd-4248-a40b-7a9fbc3bfd2c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:39.999200 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d114394-02f9-4d61-97be-a4efe539bf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:39.999880 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d114394-02f9-4d61-97be-a4efe539bf7e admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:40.000396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d114394-02f9-4d61-97be-a4efe539bf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:40.000946 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d114394-02f9-4d61-97be-a4efe539bf7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:40.002229 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d114394-02f9-4d61-97be-a4efe539bf7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:40.004420 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d114394-02f9-4d61-97be-a4efe539bf7e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:40.043878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1110/2204] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:39 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:40.048409 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc8958-0c63-49f3-8173-6e6d961a52e7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:40.059093 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc8958-0c63-49f3-8173-6e6d961a52e7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:40.120808 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6aa59-ec8c-4e2e-9ad9-64830f83f912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:40.121597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6aa59-ec8c-4e2e-9ad9-64830f83f912 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:40.121978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6aa59-ec8c-4e2e-9ad9-64830f83f912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:40.122385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6aa59-ec8c-4e2e-9ad9-64830f83f912 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:40.123171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6aa59-ec8c-4e2e-9ad9-64830f83f912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:40.125274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6aa59-ec8c-4e2e-9ad9-64830f83f912 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:40.155267 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1095/2205] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:40 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:40.156934 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d114394-02f9-4d61-97be-a4efe539bf7e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:40.174482 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d114394-02f9-4d61-97be-a4efe539bf7e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:40.179661 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0b9cf-ad3c-4b76-b5c2-47a8adb86616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:40.180466 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0b9cf-ad3c-4b76-b5c2-47a8adb86616 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:40.180889 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0b9cf-ad3c-4b76-b5c2-47a8adb86616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:40.181823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0b9cf-ad3c-4b76-b5c2-47a8adb86616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:40.182570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0b9cf-ad3c-4b76-b5c2-47a8adb86616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:40.185669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0b9cf-ad3c-4b76-b5c2-47a8adb86616 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:40.203516 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1111/2206] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:40.205755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6aa59-ec8c-4e2e-9ad9-64830f83f912 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:40.216084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6aa59-ec8c-4e2e-9ad9-64830f83f912 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:40.223716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c209ade-bd86-4c87-b7a8-eb080b5b5b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:40.224404 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c209ade-bd86-4c87-b7a8-eb080b5b5b16 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:40.224700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c209ade-bd86-4c87-b7a8-eb080b5b5b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:40.224976 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c209ade-bd86-4c87-b7a8-eb080b5b5b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:40.225705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c209ade-bd86-4c87-b7a8-eb080b5b5b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:40.227349 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c209ade-bd86-4c87-b7a8-eb080b5b5b16 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:40.238510 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1096/2207] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:29:40.244363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0b9cf-ad3c-4b76-b5c2-47a8adb86616 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:40.254535 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0b9cf-ad3c-4b76-b5c2-47a8adb86616 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:40.259587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd13e7-fce5-4181-a9dd-588a65281919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:40.260483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd13e7-fce5-4181-a9dd-588a65281919 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:40.260812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd13e7-fce5-4181-a9dd-588a65281919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:40.261086 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd13e7-fce5-4181-a9dd-588a65281919 admin admin] PATH_INFO: `/v3/projects/8b51215b008e467291a93ec1cbd15900/users/580c7e4b442e402e83cce190bf68592d/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:40.282704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd13e7-fce5-4181-a9dd-588a65281919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b51215b008e467291a93ec1cbd15900, user_id=580c7e4b442e402e83cce190bf68592d, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:40.285882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd13e7-fce5-4181-a9dd-588a65281919 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:40.303244 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1112/2208] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:40 2022] PUT /identity/v3/projects/8b51215b008e467291a93ec1cbd15900/users/580c7e4b442e402e83cce190bf68592d/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:40.314403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505d921-1842-406b-86b8-b448938750d9 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:40.314686 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505d921-1842-406b-86b8-b448938750d9 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:40.314973 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505d921-1842-406b-86b8-b448938750d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:40.368501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-d505d921-1842-406b-86b8-b448938750d9 None None] MFA Rules not processed for user `580c7e4b442e402e83cce190bf68592d`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:40.369836 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d505d921-1842-406b-86b8-b448938750d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:40.405879 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:40.472869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1097/2209] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:29:40.485741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd13e7-fce5-4181-a9dd-588a65281919 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:40.488302 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fecd13e7-fce5-4181-a9dd-588a65281919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:40.551161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd13e7-fce5-4181-a9dd-588a65281919 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:40.555233 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bb2db-48e7-4559-a130-5b3965bf4b6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:40.555999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bb2db-48e7-4559-a130-5b3965bf4b6d service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:40.556366 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bb2db-48e7-4559-a130-5b3965bf4b6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:40.556759 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bb2db-48e7-4559-a130-5b3965bf4b6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:40.566673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bb2db-48e7-4559-a130-5b3965bf4b6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:40.568192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bb2db-48e7-4559-a130-5b3965bf4b6d service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:40.578346 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1113/2210] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:40.604306 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505d921-1842-406b-86b8-b448938750d9 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:40.673377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505d921-1842-406b-86b8-b448938750d9 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:40.685459 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae0c87-fc09-427d-9163-cc1503366601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:40.686658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae0c87-fc09-427d-9163-cc1503366601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:40.687120 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae0c87-fc09-427d-9163-cc1503366601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:40.687764 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae0c87-fc09-427d-9163-cc1503366601 admin admin] PATH_INFO: `/v3/users/580c7e4b442e402e83cce190bf68592d` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:40.689593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae0c87-fc09-427d-9163-cc1503366601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=580c7e4b442e402e83cce190bf68592d)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:40.691971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae0c87-fc09-427d-9163-cc1503366601 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:40.772875 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-afae0c87-fc09-427d-9163-cc1503366601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '580c7e4b442e402e83cce190bf68592d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:40.784969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-afae0c87-fc09-427d-9163-cc1503366601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '580c7e4b442e402e83cce190bf68592d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:40.798809 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-afae0c87-fc09-427d-9163-cc1503366601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '580c7e4b442e402e83cce190bf68592d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:40.799509 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-afae0c87-fc09-427d-9163-cc1503366601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '580c7e4b442e402e83cce190bf68592d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:40.807577 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-afae0c87-fc09-427d-9163-cc1503366601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '580c7e4b442e402e83cce190bf68592d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:40.818315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1098/2211] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:40 2022] DELETE /identity/v3/users/580c7e4b442e402e83cce190bf68592d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:40.822600 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f1b25-9f01-4f50-9af5-0f89d9c91d8f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:40.823127 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f1b25-9f01-4f50-9af5-0f89d9c91d8f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:40.823209 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f1b25-9f01-4f50-9af5-0f89d9c91d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:40.847570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-fe2f1b25-9f01-4f50-9af5-0f89d9c91d8f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:40.848896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fe2f1b25-9f01-4f50-9af5-0f89d9c91d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:40.937958 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1114/2212] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:40.948384 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae0c87-fc09-427d-9163-cc1503366601 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:40.951430 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-afae0c87-fc09-427d-9163-cc1503366601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:41.011517 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:41.017959 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae0c87-fc09-427d-9163-cc1503366601 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:41.022676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ef364-09b5-495e-8a5b-738cb0d9d14c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:41.023295 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ef364-09b5-495e-8a5b-738cb0d9d14c service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:41.023582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ef364-09b5-495e-8a5b-738cb0d9d14c service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:41.023856 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ef364-09b5-495e-8a5b-738cb0d9d14c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:41.033104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ef364-09b5-495e-8a5b-738cb0d9d14c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:41.034558 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ef364-09b5-495e-8a5b-738cb0d9d14c service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:41.044644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1099/2213] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:41.334580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f1b25-9f01-4f50-9af5-0f89d9c91d8f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:41.336801 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fe2f1b25-9f01-4f50-9af5-0f89d9c91d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:41.353189 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f1b25-9f01-4f50-9af5-0f89d9c91d8f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:41.358686 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b87d95-8e20-440f-8328-d0d05e009ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:41.359597 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b87d95-8e20-440f-8328-d0d05e009ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:41.359879 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b87d95-8e20-440f-8328-d0d05e009ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:41.360164 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b87d95-8e20-440f-8328-d0d05e009ed9 admin admin] PATH_INFO: `/v3/projects/8b51215b008e467291a93ec1cbd15900` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:41.361565 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b87d95-8e20-440f-8328-d0d05e009ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b51215b008e467291a93ec1cbd15900)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:41.363863 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b87d95-8e20-440f-8328-d0d05e009ed9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:41.416130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:41.419938 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-87b87d95-8e20-440f-8328-d0d05e009ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b51215b008e467291a93ec1cbd15900', 'request_id': 'req-87b87d95-8e20-440f-8328-d0d05e009ed9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:41.429803 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-87b87d95-8e20-440f-8328-d0d05e009ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b51215b008e467291a93ec1cbd15900', 'request_id': 'req-87b87d95-8e20-440f-8328-d0d05e009ed9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:41.437267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-87b87d95-8e20-440f-8328-d0d05e009ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b51215b008e467291a93ec1cbd15900', 'request_id': 'req-87b87d95-8e20-440f-8328-d0d05e009ed9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:41.450058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-87b87d95-8e20-440f-8328-d0d05e009ed9 admin admin] The token cache is being invalidate because project 8b51215b008e467291a93ec1cbd15900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:41.450370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-87b87d95-8e20-440f-8328-d0d05e009ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:41.451052 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-87b87d95-8e20-440f-8328-d0d05e009ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:41.455314 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1115/2214] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:41 2022] DELETE /identity/v3/projects/8b51215b008e467291a93ec1cbd15900 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:41.952748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099a62c-a6b5-4169-985f-3a1e368d8b9e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:41.953201 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099a62c-a6b5-4169-985f-3a1e368d8b9e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:41.953431 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099a62c-a6b5-4169-985f-3a1e368d8b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:41.972304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f099a62c-a6b5-4169-985f-3a1e368d8b9e None None] MFA Rules not processed for user `31bd41139867408b8cdc6b7f6be968de`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:41.973673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f099a62c-a6b5-4169-985f-3a1e368d8b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:42.031902 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1100/2215] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:46.061928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b87d95-8e20-440f-8328-d0d05e009ed9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:46.064227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-87b87d95-8e20-440f-8328-d0d05e009ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:46.136998 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b87d95-8e20-440f-8328-d0d05e009ed9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:46.141800 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74376f-d086-4dad-a062-e2671e670d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:46.142812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74376f-d086-4dad-a062-e2671e670d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:46.143144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74376f-d086-4dad-a062-e2671e670d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:46.143482 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74376f-d086-4dad-a062-e2671e670d4d admin admin] PATH_INFO: `/v3/users/7bf66f1ad96d4ffd8034bcebc4c99e99` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:46.144826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74376f-d086-4dad-a062-e2671e670d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf66f1ad96d4ffd8034bcebc4c99e99)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:46.146841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74376f-d086-4dad-a062-e2671e670d4d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:46.211287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3e74376f-d086-4dad-a062-e2671e670d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf66f1ad96d4ffd8034bcebc4c99e99'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:46.224849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3e74376f-d086-4dad-a062-e2671e670d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf66f1ad96d4ffd8034bcebc4c99e99'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:46.238224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3e74376f-d086-4dad-a062-e2671e670d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf66f1ad96d4ffd8034bcebc4c99e99'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:46.238993 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3e74376f-d086-4dad-a062-e2671e670d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf66f1ad96d4ffd8034bcebc4c99e99'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:46.255241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3e74376f-d086-4dad-a062-e2671e670d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf66f1ad96d4ffd8034bcebc4c99e99'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:46.261748 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1116/2216] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:46 2022] DELETE /identity/v3/users/7bf66f1ad96d4ffd8034bcebc4c99e99 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:46.266366 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d18e93-1040-47a9-9583-93ef1b298da8 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:46.266998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d18e93-1040-47a9-9583-93ef1b298da8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:46.267120 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d18e93-1040-47a9-9583-93ef1b298da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:46.285256 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-57d18e93-1040-47a9-9583-93ef1b298da8 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:46.286454 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-57d18e93-1040-47a9-9583-93ef1b298da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:46.348688 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1101/2217] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:46.359039 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74376f-d086-4dad-a062-e2671e670d4d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:46.360575 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3e74376f-d086-4dad-a062-e2671e670d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:46.424235 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74376f-d086-4dad-a062-e2671e670d4d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:46.428632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc1eda-b7c5-44bf-8a33-ce2e40a4aa74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:46.429331 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc1eda-b7c5-44bf-8a33-ce2e40a4aa74 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:46.429619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc1eda-b7c5-44bf-8a33-ce2e40a4aa74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:46.429942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc1eda-b7c5-44bf-8a33-ce2e40a4aa74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:46.437780 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:46.441828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc1eda-b7c5-44bf-8a33-ce2e40a4aa74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:46.443448 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc1eda-b7c5-44bf-8a33-ce2e40a4aa74 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:46.455970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1117/2218] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:46.781713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d18e93-1040-47a9-9583-93ef1b298da8 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:46.783369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-57d18e93-1040-47a9-9583-93ef1b298da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:46.796443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d18e93-1040-47a9-9583-93ef1b298da8 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:46.802172 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b932404-0720-4715-9b1f-fe9231174717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:46.803069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b932404-0720-4715-9b1f-fe9231174717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:46.803343 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b932404-0720-4715-9b1f-fe9231174717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:46.803607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b932404-0720-4715-9b1f-fe9231174717 admin admin] PATH_INFO: `/v3/projects/100bafe8ccf944b190155a2c01b064ed` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:46.804910 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b932404-0720-4715-9b1f-fe9231174717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=100bafe8ccf944b190155a2c01b064ed)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:46.806925 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b932404-0720-4715-9b1f-fe9231174717 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:46.858269 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8b932404-0720-4715-9b1f-fe9231174717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100bafe8ccf944b190155a2c01b064ed', 'request_id': 'req-8b932404-0720-4715-9b1f-fe9231174717'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:46.866949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8b932404-0720-4715-9b1f-fe9231174717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100bafe8ccf944b190155a2c01b064ed', 'request_id': 'req-8b932404-0720-4715-9b1f-fe9231174717'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:46.872651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8b932404-0720-4715-9b1f-fe9231174717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100bafe8ccf944b190155a2c01b064ed', 'request_id': 'req-8b932404-0720-4715-9b1f-fe9231174717'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:46.884691 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8b932404-0720-4715-9b1f-fe9231174717 admin admin] The token cache is being invalidate because project 100bafe8ccf944b190155a2c01b064ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:46.884981 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8b932404-0720-4715-9b1f-fe9231174717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:46.885618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8b932404-0720-4715-9b1f-fe9231174717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:46.887164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1102/2219] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:46 2022] DELETE /identity/v3/projects/100bafe8ccf944b190155a2c01b064ed => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:46.891065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc1eda-b7c5-44bf-8a33-ce2e40a4aa74 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:46.901634 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc1eda-b7c5-44bf-8a33-ce2e40a4aa74 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:46.959776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9b4c8-2213-40eb-99dc-99a5ff52439b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:46.960685 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9b4c8-2213-40eb-99dc-99a5ff52439b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:46.961475 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9b4c8-2213-40eb-99dc-99a5ff52439b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:46.961475 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9b4c8-2213-40eb-99dc-99a5ff52439b admin admin] PATH_INFO: `/v3/users/b09c917784f0431cb83cf7d05a06d2ce` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:46.962485 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9b4c8-2213-40eb-99dc-99a5ff52439b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b09c917784f0431cb83cf7d05a06d2ce)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:46.964687 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9b4c8-2213-40eb-99dc-99a5ff52439b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:47.018941 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6bc9b4c8-2213-40eb-99dc-99a5ff52439b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b09c917784f0431cb83cf7d05a06d2ce'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:47.027706 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6bc9b4c8-2213-40eb-99dc-99a5ff52439b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b09c917784f0431cb83cf7d05a06d2ce'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:47.035328 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6bc9b4c8-2213-40eb-99dc-99a5ff52439b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b09c917784f0431cb83cf7d05a06d2ce'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:47.035944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6bc9b4c8-2213-40eb-99dc-99a5ff52439b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b09c917784f0431cb83cf7d05a06d2ce'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:47.048700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6bc9b4c8-2213-40eb-99dc-99a5ff52439b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b09c917784f0431cb83cf7d05a06d2ce'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:47.054883 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1118/2220] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:46 2022] DELETE /identity/v3/users/b09c917784f0431cb83cf7d05a06d2ce => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:47.389712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b932404-0720-4715-9b1f-fe9231174717 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:47.392899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8b932404-0720-4715-9b1f-fe9231174717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:47.411983 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b932404-0720-4715-9b1f-fe9231174717 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:47.427152 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:47.490348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41972c3-e2ed-40ca-8259-bce5726c8073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:47.491236 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41972c3-e2ed-40ca-8259-bce5726c8073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:47.491518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41972c3-e2ed-40ca-8259-bce5726c8073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:47.491784 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41972c3-e2ed-40ca-8259-bce5726c8073 admin admin] PATH_INFO: `/v3/projects/3e0945fbe71140bb9f047219e9d59dc3` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:47.492990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41972c3-e2ed-40ca-8259-bce5726c8073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0945fbe71140bb9f047219e9d59dc3)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:47.494949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41972c3-e2ed-40ca-8259-bce5726c8073 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:47.542831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a41972c3-e2ed-40ca-8259-bce5726c8073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0945fbe71140bb9f047219e9d59dc3', 'request_id': 'req-a41972c3-e2ed-40ca-8259-bce5726c8073'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:47.550832 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a41972c3-e2ed-40ca-8259-bce5726c8073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0945fbe71140bb9f047219e9d59dc3', 'request_id': 'req-a41972c3-e2ed-40ca-8259-bce5726c8073'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:47.556724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a41972c3-e2ed-40ca-8259-bce5726c8073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0945fbe71140bb9f047219e9d59dc3', 'request_id': 'req-a41972c3-e2ed-40ca-8259-bce5726c8073'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:47.567764 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a41972c3-e2ed-40ca-8259-bce5726c8073 admin admin] The token cache is being invalidate because project 3e0945fbe71140bb9f047219e9d59dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:47.568044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a41972c3-e2ed-40ca-8259-bce5726c8073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:47.568691 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a41972c3-e2ed-40ca-8259-bce5726c8073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:47.570205 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1103/2221] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:47 2022] DELETE /identity/v3/projects/3e0945fbe71140bb9f047219e9d59dc3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:47.575136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcf0be-eaba-40aa-ad54-2fc5ff73e304 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:47.575606 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcf0be-eaba-40aa-ad54-2fc5ff73e304 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:47.575722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcf0be-eaba-40aa-ad54-2fc5ff73e304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:47.596690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1fdcf0be-eaba-40aa-ad54-2fc5ff73e304 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:47.597886 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1fdcf0be-eaba-40aa-ad54-2fc5ff73e304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:47.665093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1119/2222] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:47.673134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64463bf-cc7d-4f4c-8817-4a84a3e45d84 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:47.673378 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64463bf-cc7d-4f4c-8817-4a84a3e45d84 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:47.673630 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64463bf-cc7d-4f4c-8817-4a84a3e45d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:47.693554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-d64463bf-cc7d-4f4c-8817-4a84a3e45d84 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:47.694817 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d64463bf-cc7d-4f4c-8817-4a84a3e45d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:47.704575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1104/2223] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:47.708800 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcf0be-eaba-40aa-ad54-2fc5ff73e304 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:47.719059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcf0be-eaba-40aa-ad54-2fc5ff73e304 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:47.724224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91baf959-f63b-4d8d-8c21-76326823959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:47.724925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baf959-f63b-4d8d-8c21-76326823959d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:47.725203 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baf959-f63b-4d8d-8c21-76326823959d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:47.725470 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baf959-f63b-4d8d-8c21-76326823959d admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:47.726199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91baf959-f63b-4d8d-8c21-76326823959d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:47.726499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91baf959-f63b-4d8d-8c21-76326823959d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:47.728106 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91baf959-f63b-4d8d-8c21-76326823959d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:47.742228 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1120/2224] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:29:47.745057 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64463bf-cc7d-4f4c-8817-4a84a3e45d84 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:47.754554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64463bf-cc7d-4f4c-8817-4a84a3e45d84 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:47.759258 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd66f56-eee7-4829-b5ea-0d90f653cba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:47.759907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd66f56-eee7-4829-b5ea-0d90f653cba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:47.760182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd66f56-eee7-4829-b5ea-0d90f653cba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:47.760472 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd66f56-eee7-4829-b5ea-0d90f653cba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:47.761208 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd66f56-eee7-4829-b5ea-0d90f653cba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:47.763155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd66f56-eee7-4829-b5ea-0d90f653cba8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:47.789468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1105/2225] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:47 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:47.793804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91baf959-f63b-4d8d-8c21-76326823959d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:47.799491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:47.806221 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91baf959-f63b-4d8d-8c21-76326823959d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:47.865378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371206b-fec3-4c0c-bfbf-a341c083ce01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:47.866049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371206b-fec3-4c0c-bfbf-a341c083ce01 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:47.866318 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371206b-fec3-4c0c-bfbf-a341c083ce01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:47.866590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371206b-fec3-4c0c-bfbf-a341c083ce01 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:47.867290 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371206b-fec3-4c0c-bfbf-a341c083ce01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:47.869264 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371206b-fec3-4c0c-bfbf-a341c083ce01 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:47.890777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1121/2226] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:47 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:29:47.895047 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd66f56-eee7-4829-b5ea-0d90f653cba8 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:47.906984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd66f56-eee7-4829-b5ea-0d90f653cba8 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:47.912600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04390a-bf13-4fe0-9c6b-d824878b217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:47.913344 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04390a-bf13-4fe0-9c6b-d824878b217b admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:47.913622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04390a-bf13-4fe0-9c6b-d824878b217b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:47.913892 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04390a-bf13-4fe0-9c6b-d824878b217b admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:47.914621 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04390a-bf13-4fe0-9c6b-d824878b217b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:47.916282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04390a-bf13-4fe0-9c6b-d824878b217b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:47.927502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1106/2227] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:47.931747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371206b-fec3-4c0c-bfbf-a341c083ce01 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:47.942918 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371206b-fec3-4c0c-bfbf-a341c083ce01 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:47.948654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a19bd-3fb9-4548-865e-8b02339ef350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:47.949326 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a19bd-3fb9-4548-865e-8b02339ef350 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:47.949609 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a19bd-3fb9-4548-865e-8b02339ef350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:47.949881 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a19bd-3fb9-4548-865e-8b02339ef350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:47.950618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a19bd-3fb9-4548-865e-8b02339ef350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:47.952243 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a19bd-3fb9-4548-865e-8b02339ef350 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:47.963147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1122/2228] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:47.967493 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04390a-bf13-4fe0-9c6b-d824878b217b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:47.978517 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04390a-bf13-4fe0-9c6b-d824878b217b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:47.984182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde97b2-991d-4cb9-88f8-d230cda6eb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:47.985107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde97b2-991d-4cb9-88f8-d230cda6eb14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:47.985502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde97b2-991d-4cb9-88f8-d230cda6eb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:47.985816 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde97b2-991d-4cb9-88f8-d230cda6eb14 admin admin] PATH_INFO: `/v3/projects/3e029eb1e5eb4c388dd275f748ae2c96/users/6f69ba5ba59b4e6c8bf2598eba737405/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:48.000558 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde97b2-991d-4cb9-88f8-d230cda6eb14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e029eb1e5eb4c388dd275f748ae2c96, user_id=6f69ba5ba59b4e6c8bf2598eba737405, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:48.003418 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde97b2-991d-4cb9-88f8-d230cda6eb14 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:48.018310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1107/2229] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:47 2022] PUT /identity/v3/projects/3e029eb1e5eb4c388dd275f748ae2c96/users/6f69ba5ba59b4e6c8bf2598eba737405/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:48.034277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e904ec-f6bd-409c-be45-e21f7fce196c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:48.034561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e904ec-f6bd-409c-be45-e21f7fce196c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:48.034839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e904ec-f6bd-409c-be45-e21f7fce196c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:48.062856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f9e904ec-f6bd-409c-be45-e21f7fce196c None None] MFA Rules not processed for user `6f69ba5ba59b4e6c8bf2598eba737405`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:48.064113 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f9e904ec-f6bd-409c-be45-e21f7fce196c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:48.131187 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1123/2230] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:48.136027 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde97b2-991d-4cb9-88f8-d230cda6eb14 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:48.182586 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:48.200383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde97b2-991d-4cb9-88f8-d230cda6eb14 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:48.205268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9cf67-b291-4194-b51d-8afac071ead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:48.205918 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9cf67-b291-4194-b51d-8afac071ead1 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:48.206198 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9cf67-b291-4194-b51d-8afac071ead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:48.206468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9cf67-b291-4194-b51d-8afac071ead1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:48.207152 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9cf67-b291-4194-b51d-8afac071ead1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:48.209152 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9cf67-b291-4194-b51d-8afac071ead1 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:48.238557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1108/2231] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:48 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:48.242948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e904ec-f6bd-409c-be45-e21f7fce196c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:48.254777 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e904ec-f6bd-409c-be45-e21f7fce196c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:48.313320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d88f7d-1cbc-456e-83df-cef0d412e966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:48.314625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d88f7d-1cbc-456e-83df-cef0d412e966 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:48.314793 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d88f7d-1cbc-456e-83df-cef0d412e966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:48.315089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d88f7d-1cbc-456e-83df-cef0d412e966 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:48.315784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d88f7d-1cbc-456e-83df-cef0d412e966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:48.317715 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d88f7d-1cbc-456e-83df-cef0d412e966 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:48.336040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:48.345487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1124/2232] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:48 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:48.347033 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9cf67-b291-4194-b51d-8afac071ead1 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:48.357458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9cf67-b291-4194-b51d-8afac071ead1 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:48.362326 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de5c1f-0331-4d79-8dd8-854bfe7f1dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:48.362980 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de5c1f-0331-4d79-8dd8-854bfe7f1dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:48.363257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de5c1f-0331-4d79-8dd8-854bfe7f1dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:48.363528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de5c1f-0331-4d79-8dd8-854bfe7f1dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:48.364280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de5c1f-0331-4d79-8dd8-854bfe7f1dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:48.365907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de5c1f-0331-4d79-8dd8-854bfe7f1dbd admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:48.376649 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1109/2233] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:48.381055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d88f7d-1cbc-456e-83df-cef0d412e966 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:48.391261 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d88f7d-1cbc-456e-83df-cef0d412e966 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:48.396493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a6041-dcae-4285-8926-b656ab94868a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:48.397409 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a6041-dcae-4285-8926-b656ab94868a admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:48.397693 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a6041-dcae-4285-8926-b656ab94868a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:48.398047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a6041-dcae-4285-8926-b656ab94868a admin admin] PATH_INFO: `/v3/projects/da447edea05348d88f403795d5892cf3/users/95be99520aa34c229fd7e19a4728b662/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:48.417786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a6041-dcae-4285-8926-b656ab94868a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da447edea05348d88f403795d5892cf3, user_id=95be99520aa34c229fd7e19a4728b662, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:48.420627 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a6041-dcae-4285-8926-b656ab94868a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:48.439270 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1125/2234] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:48 2022] PUT /identity/v3/projects/da447edea05348d88f403795d5892cf3/users/95be99520aa34c229fd7e19a4728b662/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:48.443362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de5c1f-0331-4d79-8dd8-854bfe7f1dbd admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:48.454263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de5c1f-0331-4d79-8dd8-854bfe7f1dbd admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:48.511268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed90bd0-f8c5-4e99-be35-0fa0afe9428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:48.511941 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed90bd0-f8c5-4e99-be35-0fa0afe9428f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:48.512218 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed90bd0-f8c5-4e99-be35-0fa0afe9428f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:48.512485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed90bd0-f8c5-4e99-be35-0fa0afe9428f admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:48.513249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed90bd0-f8c5-4e99-be35-0fa0afe9428f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:48.514824 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed90bd0-f8c5-4e99-be35-0fa0afe9428f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:48.525027 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1110/2235] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:48.529252 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a6041-dcae-4285-8926-b656ab94868a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:48.540393 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a6041-dcae-4285-8926-b656ab94868a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:48.545130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491725c4-583a-4b09-8788-08117f8bfde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:48.546021 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491725c4-583a-4b09-8788-08117f8bfde0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:48.546301 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491725c4-583a-4b09-8788-08117f8bfde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:48.546568 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491725c4-583a-4b09-8788-08117f8bfde0 admin admin] PATH_INFO: `/v3/projects/da447edea05348d88f403795d5892cf3/users/95be99520aa34c229fd7e19a4728b662/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:48.548725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491725c4-583a-4b09-8788-08117f8bfde0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da447edea05348d88f403795d5892cf3, user_id=95be99520aa34c229fd7e19a4728b662, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:48.551358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491725c4-583a-4b09-8788-08117f8bfde0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:48.562655 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1126/2236] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:48 2022] PUT /identity/v3/projects/da447edea05348d88f403795d5892cf3/users/95be99520aa34c229fd7e19a4728b662/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:48.572993 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e42b04-7b80-44dc-9a59-2da64383bee0 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:48.573290 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e42b04-7b80-44dc-9a59-2da64383bee0 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:48.573559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e42b04-7b80-44dc-9a59-2da64383bee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:48.601364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-07e42b04-7b80-44dc-9a59-2da64383bee0 None None] MFA Rules not processed for user `95be99520aa34c229fd7e19a4728b662`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:48.602608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-07e42b04-7b80-44dc-9a59-2da64383bee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:48.669877 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1111/2237] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:48.681507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491725c4-583a-4b09-8788-08117f8bfde0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:48.683415 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-491725c4-583a-4b09-8788-08117f8bfde0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:48.739837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491725c4-583a-4b09-8788-08117f8bfde0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:48.744412 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912a39d-06ef-4fc9-a6a4-c90e8d3158b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:48.745139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912a39d-06ef-4fc9-a6a4-c90e8d3158b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:48.745416 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912a39d-06ef-4fc9-a6a4-c90e8d3158b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:48.745684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912a39d-06ef-4fc9-a6a4-c90e8d3158b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:48.756356 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912a39d-06ef-4fc9-a6a4-c90e8d3158b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:48.757994 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912a39d-06ef-4fc9-a6a4-c90e8d3158b5 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:48.768112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1127/2238] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:48.817483 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e42b04-7b80-44dc-9a59-2da64383bee0 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:48.819018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-07e42b04-7b80-44dc-9a59-2da64383bee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:48.833343 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e42b04-7b80-44dc-9a59-2da64383bee0 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:48.837471 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de3734-71c8-4e3a-af6c-3049e351e617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:48.838126 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de3734-71c8-4e3a-af6c-3049e351e617 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:48.838408 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de3734-71c8-4e3a-af6c-3049e351e617 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:48.838713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de3734-71c8-4e3a-af6c-3049e351e617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:48.881300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:48.900712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de3734-71c8-4e3a-af6c-3049e351e617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:48.902136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de3734-71c8-4e3a-af6c-3049e351e617 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:48.911604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1112/2239] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:52.305690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912a39d-06ef-4fc9-a6a4-c90e8d3158b5 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:52.390577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912a39d-06ef-4fc9-a6a4-c90e8d3158b5 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:52.396309 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfe6f1-8c44-4cef-b8da-7385f9fe390f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:52.397633 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfe6f1-8c44-4cef-b8da-7385f9fe390f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:52.397928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfe6f1-8c44-4cef-b8da-7385f9fe390f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:52.398259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfe6f1-8c44-4cef-b8da-7385f9fe390f admin admin] PATH_INFO: `/v3/users/6f69ba5ba59b4e6c8bf2598eba737405` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:52.399748 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfe6f1-8c44-4cef-b8da-7385f9fe390f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f69ba5ba59b4e6c8bf2598eba737405)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:52.402971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfe6f1-8c44-4cef-b8da-7385f9fe390f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:52.484418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f5dfe6f1-8c44-4cef-b8da-7385f9fe390f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f69ba5ba59b4e6c8bf2598eba737405'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:52.494811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f5dfe6f1-8c44-4cef-b8da-7385f9fe390f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f69ba5ba59b4e6c8bf2598eba737405'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:52.503699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f5dfe6f1-8c44-4cef-b8da-7385f9fe390f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f69ba5ba59b4e6c8bf2598eba737405'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:52.504596 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f5dfe6f1-8c44-4cef-b8da-7385f9fe390f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f69ba5ba59b4e6c8bf2598eba737405'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:52.510976 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:52.521143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f5dfe6f1-8c44-4cef-b8da-7385f9fe390f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f69ba5ba59b4e6c8bf2598eba737405'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:52.533275 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1128/2240] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:52 2022] DELETE /identity/v3/users/6f69ba5ba59b4e6c8bf2598eba737405 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:52.535125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae41ff-6aba-49bb-a203-9f2047c2895c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:52.535594 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae41ff-6aba-49bb-a203-9f2047c2895c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:52.535733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae41ff-6aba-49bb-a203-9f2047c2895c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:52.554010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-54ae41ff-6aba-49bb-a203-9f2047c2895c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:52.555269 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-54ae41ff-6aba-49bb-a203-9f2047c2895c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:52.628064 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1113/2241] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:52.639300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfe6f1-8c44-4cef-b8da-7385f9fe390f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:52.640755 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f5dfe6f1-8c44-4cef-b8da-7385f9fe390f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:52.702481 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfe6f1-8c44-4cef-b8da-7385f9fe390f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:52.706210 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a875e8-2449-4f17-973f-9104ef279fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:52.706885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a875e8-2449-4f17-973f-9104ef279fae service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:52.707130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a875e8-2449-4f17-973f-9104ef279fae service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:52.707408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a875e8-2449-4f17-973f-9104ef279fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:52.717558 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a875e8-2449-4f17-973f-9104ef279fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:52.718990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a875e8-2449-4f17-973f-9104ef279fae service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:52.729310 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1129/2242] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:53.019927 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae41ff-6aba-49bb-a203-9f2047c2895c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:53.021420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-54ae41ff-6aba-49bb-a203-9f2047c2895c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:53.037213 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae41ff-6aba-49bb-a203-9f2047c2895c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:53.042739 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a58682-136d-4c53-9865-de13d2df6d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:53.043961 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a58682-136d-4c53-9865-de13d2df6d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:53.044238 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a58682-136d-4c53-9865-de13d2df6d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:53.044504 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a58682-136d-4c53-9865-de13d2df6d53 admin admin] PATH_INFO: `/v3/projects/3e029eb1e5eb4c388dd275f748ae2c96` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:53.045812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a58682-136d-4c53-9865-de13d2df6d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e029eb1e5eb4c388dd275f748ae2c96)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:53.059737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a58682-136d-4c53-9865-de13d2df6d53 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:53.114892 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-99a58682-136d-4c53-9865-de13d2df6d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e029eb1e5eb4c388dd275f748ae2c96', 'request_id': 'req-99a58682-136d-4c53-9865-de13d2df6d53'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:53.123268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-99a58682-136d-4c53-9865-de13d2df6d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e029eb1e5eb4c388dd275f748ae2c96', 'request_id': 'req-99a58682-136d-4c53-9865-de13d2df6d53'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:53.129439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-99a58682-136d-4c53-9865-de13d2df6d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e029eb1e5eb4c388dd275f748ae2c96', 'request_id': 'req-99a58682-136d-4c53-9865-de13d2df6d53'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:53.141769 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-99a58682-136d-4c53-9865-de13d2df6d53 admin admin] The token cache is being invalidate because project 3e029eb1e5eb4c388dd275f748ae2c96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:53.142058 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-99a58682-136d-4c53-9865-de13d2df6d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:53.142701 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-99a58682-136d-4c53-9865-de13d2df6d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:53.144256 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1114/2243] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:53 2022] DELETE /identity/v3/projects/3e029eb1e5eb4c388dd275f748ae2c96 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:53.148343 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a875e8-2449-4f17-973f-9104ef279fae service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:53.158353 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a875e8-2449-4f17-973f-9104ef279fae service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:53.230032 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e74bd-640a-4daf-9a4d-74221721847a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:53.230849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e74bd-640a-4daf-9a4d-74221721847a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:53.231182 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e74bd-640a-4daf-9a4d-74221721847a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:53.231396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e74bd-640a-4daf-9a4d-74221721847a admin admin] PATH_INFO: `/v3/users/95be99520aa34c229fd7e19a4728b662` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:53.232657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e74bd-640a-4daf-9a4d-74221721847a admin admin] RBAC: Authorizing `identity:delete_user(user_id=95be99520aa34c229fd7e19a4728b662)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:53.234600 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e74bd-640a-4daf-9a4d-74221721847a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:53.296702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-117e74bd-640a-4daf-9a4d-74221721847a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95be99520aa34c229fd7e19a4728b662'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:53.306671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-117e74bd-640a-4daf-9a4d-74221721847a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95be99520aa34c229fd7e19a4728b662'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:53.314717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-117e74bd-640a-4daf-9a4d-74221721847a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95be99520aa34c229fd7e19a4728b662'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:53.315417 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-117e74bd-640a-4daf-9a4d-74221721847a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95be99520aa34c229fd7e19a4728b662'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:53.340609 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-117e74bd-640a-4daf-9a4d-74221721847a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95be99520aa34c229fd7e19a4728b662'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:53.348036 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1130/2244] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:29:53 2022] DELETE /identity/v3/users/95be99520aa34c229fd7e19a4728b662 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:53.645321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a58682-136d-4c53-9865-de13d2df6d53 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:53.648344 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-99a58682-136d-4c53-9865-de13d2df6d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:53.663398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a58682-136d-4c53-9865-de13d2df6d53 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:53.730471 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec4c77-baf9-43ff-ad60-f60a8f82377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:53.731344 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec4c77-baf9-43ff-ad60-f60a8f82377c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:53.731617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec4c77-baf9-43ff-ad60-f60a8f82377c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:53.731883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec4c77-baf9-43ff-ad60-f60a8f82377c admin admin] PATH_INFO: `/v3/projects/da447edea05348d88f403795d5892cf3` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:53.733087 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec4c77-baf9-43ff-ad60-f60a8f82377c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da447edea05348d88f403795d5892cf3)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:53.735078 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec4c77-baf9-43ff-ad60-f60a8f82377c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:53.737367 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:53.785332 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-23ec4c77-baf9-43ff-ad60-f60a8f82377c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da447edea05348d88f403795d5892cf3', 'request_id': 'req-23ec4c77-baf9-43ff-ad60-f60a8f82377c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:53.795302 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-23ec4c77-baf9-43ff-ad60-f60a8f82377c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da447edea05348d88f403795d5892cf3', 'request_id': 'req-23ec4c77-baf9-43ff-ad60-f60a8f82377c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:53.801190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-23ec4c77-baf9-43ff-ad60-f60a8f82377c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da447edea05348d88f403795d5892cf3', 'request_id': 'req-23ec4c77-baf9-43ff-ad60-f60a8f82377c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:53.812262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-23ec4c77-baf9-43ff-ad60-f60a8f82377c admin admin] The token cache is being invalidate because project da447edea05348d88f403795d5892cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:29:53.812578 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-23ec4c77-baf9-43ff-ad60-f60a8f82377c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:53.813447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-23ec4c77-baf9-43ff-ad60-f60a8f82377c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:29:53.814991 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1115/2245] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:29:53 2022] DELETE /identity/v3/projects/da447edea05348d88f403795d5892cf3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:53.819970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee7152-5c7f-46c8-946c-8548ea94783a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:53.820250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee7152-5c7f-46c8-946c-8548ea94783a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:53.820540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee7152-5c7f-46c8-946c-8548ea94783a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:53.832760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:53.838776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a4ee7152-5c7f-46c8-946c-8548ea94783a None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:53.841029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a4ee7152-5c7f-46c8-946c-8548ea94783a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:53.904765 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1131/2246] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:53.913526 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c78058-405f-446c-89a3-3fbcb13f1880 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:53.913818 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c78058-405f-446c-89a3-3fbcb13f1880 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:53.914083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c78058-405f-446c-89a3-3fbcb13f1880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:53.932946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-14c78058-405f-446c-89a3-3fbcb13f1880 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:53.934078 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-14c78058-405f-446c-89a3-3fbcb13f1880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:53.943112 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1116/2247] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:53.947442 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee7152-5c7f-46c8-946c-8548ea94783a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:53.957717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee7152-5c7f-46c8-946c-8548ea94783a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:53.963227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaba977-4dc0-4cd1-94fe-33c4afcb9805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:53.963908 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaba977-4dc0-4cd1-94fe-33c4afcb9805 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:53.964191 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaba977-4dc0-4cd1-94fe-33c4afcb9805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:53.964465 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaba977-4dc0-4cd1-94fe-33c4afcb9805 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:53.965249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaba977-4dc0-4cd1-94fe-33c4afcb9805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:29:53.965556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaba977-4dc0-4cd1-94fe-33c4afcb9805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:53.967185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaba977-4dc0-4cd1-94fe-33c4afcb9805 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:53.979634 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1132/2248] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:29:53.984134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c78058-405f-446c-89a3-3fbcb13f1880 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:53.994017 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c78058-405f-446c-89a3-3fbcb13f1880 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:53.998961 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae03b1e-fd9d-41ac-b619-a80afeb6ac78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:53.999651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03b1e-fd9d-41ac-b619-a80afeb6ac78 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:53.999927 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03b1e-fd9d-41ac-b619-a80afeb6ac78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:54.000191 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03b1e-fd9d-41ac-b619-a80afeb6ac78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:54.001006 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae03b1e-fd9d-41ac-b619-a80afeb6ac78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:54.003019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae03b1e-fd9d-41ac-b619-a80afeb6ac78 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:54.034449 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1117/2249] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:53 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:54.035743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaba977-4dc0-4cd1-94fe-33c4afcb9805 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:54.045926 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaba977-4dc0-4cd1-94fe-33c4afcb9805 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:54.102478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f26a4-5754-450c-91a1-cfce7193c74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:54.103150 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f26a4-5754-450c-91a1-cfce7193c74e admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:54.103430 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f26a4-5754-450c-91a1-cfce7193c74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:54.103702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f26a4-5754-450c-91a1-cfce7193c74e admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:54.104395 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f26a4-5754-450c-91a1-cfce7193c74e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:54.106381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f26a4-5754-450c-91a1-cfce7193c74e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:54.127965 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1133/2250] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:54 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:54.132221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae03b1e-fd9d-41ac-b619-a80afeb6ac78 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:54.143132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae03b1e-fd9d-41ac-b619-a80afeb6ac78 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:54.148148 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55938ff-2c4e-4e80-b1c0-cfb62f3fcdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:54.148840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55938ff-2c4e-4e80-b1c0-cfb62f3fcdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:54.149122 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55938ff-2c4e-4e80-b1c0-cfb62f3fcdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:54.149395 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55938ff-2c4e-4e80-b1c0-cfb62f3fcdd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:54.150182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55938ff-2c4e-4e80-b1c0-cfb62f3fcdd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:54.151819 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55938ff-2c4e-4e80-b1c0-cfb62f3fcdd7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:54.163834 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1118/2251] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:29:54.167673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f26a4-5754-450c-91a1-cfce7193c74e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:54.177925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f26a4-5754-450c-91a1-cfce7193c74e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:54.182631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a4995-2877-4ee5-a108-6a3542cdb479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:54.183349 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a4995-2877-4ee5-a108-6a3542cdb479 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:54.183572 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a4995-2877-4ee5-a108-6a3542cdb479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:54.183845 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a4995-2877-4ee5-a108-6a3542cdb479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:54.184609 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a4995-2877-4ee5-a108-6a3542cdb479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:54.186224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a4995-2877-4ee5-a108-6a3542cdb479 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:54.200131 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1134/2252] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:54.201330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55938ff-2c4e-4e80-b1c0-cfb62f3fcdd7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:54.212163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55938ff-2c4e-4e80-b1c0-cfb62f3fcdd7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:54.217381 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4b659-fe2e-4e61-a78c-77899125e40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:54.218288 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b659-fe2e-4e61-a78c-77899125e40a admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:54.218545 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b659-fe2e-4e61-a78c-77899125e40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:54.218818 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b659-fe2e-4e61-a78c-77899125e40a admin admin] PATH_INFO: `/v3/projects/d74ad84bce3d45a298891523022c6ce9/users/1751f4d349bf4d55bc8ab3eddc80eecd/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:54.236357 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4b659-fe2e-4e61-a78c-77899125e40a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74ad84bce3d45a298891523022c6ce9, user_id=1751f4d349bf4d55bc8ab3eddc80eecd, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:54.239027 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4b659-fe2e-4e61-a78c-77899125e40a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:54.254001 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1119/2253] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:54 2022] PUT /identity/v3/projects/d74ad84bce3d45a298891523022c6ce9/users/1751f4d349bf4d55bc8ab3eddc80eecd/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:54.264440 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3e3ee-3081-40a3-bd9b-bf666dc00395 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:54.264733 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3e3ee-3081-40a3-bd9b-bf666dc00395 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:54.265005 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3e3ee-3081-40a3-bd9b-bf666dc00395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:54.294114 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-98f3e3ee-3081-40a3-bd9b-bf666dc00395 None None] MFA Rules not processed for user `1751f4d349bf4d55bc8ab3eddc80eecd`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:54.295359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-98f3e3ee-3081-40a3-bd9b-bf666dc00395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:54.360569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1135/2254] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:29:54.364837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4b659-fe2e-4e61-a78c-77899125e40a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:54.436831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4b659-fe2e-4e61-a78c-77899125e40a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:54.443744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6910e8-a5b7-4d55-be54-6e6d6cdadd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:54.444555 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6910e8-a5b7-4d55-be54-6e6d6cdadd08 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:54.444842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6910e8-a5b7-4d55-be54-6e6d6cdadd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:54.445106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6910e8-a5b7-4d55-be54-6e6d6cdadd08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:54.445825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6910e8-a5b7-4d55-be54-6e6d6cdadd08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:54.448032 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6910e8-a5b7-4d55-be54-6e6d6cdadd08 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:54.489761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1120/2255] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:54 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:54.493434 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3e3ee-3081-40a3-bd9b-bf666dc00395 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:54.501089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:54.511207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3e3ee-3081-40a3-bd9b-bf666dc00395 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:54.594270 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6bd50-d2e3-48e6-b378-32693f569075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:54.595539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6bd50-d2e3-48e6-b378-32693f569075 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:54.595820 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6bd50-d2e3-48e6-b378-32693f569075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:54.596250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6bd50-d2e3-48e6-b378-32693f569075 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:54.596986 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6bd50-d2e3-48e6-b378-32693f569075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:54.599683 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6bd50-d2e3-48e6-b378-32693f569075 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:54.630029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1136/2256] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:54 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:54.633772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6910e8-a5b7-4d55-be54-6e6d6cdadd08 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:54.648306 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6910e8-a5b7-4d55-be54-6e6d6cdadd08 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:54.672278 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33146531-8019-4421-ac3e-40d803dd5aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:54.673170 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33146531-8019-4421-ac3e-40d803dd5aae admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:54.673459 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33146531-8019-4421-ac3e-40d803dd5aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:54.673753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33146531-8019-4421-ac3e-40d803dd5aae admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:54.674621 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33146531-8019-4421-ac3e-40d803dd5aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:54.682443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33146531-8019-4421-ac3e-40d803dd5aae admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:54.698286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1121/2257] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:54.699485 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6bd50-d2e3-48e6-b378-32693f569075 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:54.716956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6bd50-d2e3-48e6-b378-32693f569075 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:54.723146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711e6ff-2b84-4ed4-87c0-1dc73ff21b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:54.723955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711e6ff-2b84-4ed4-87c0-1dc73ff21b57 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:54.724114 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711e6ff-2b84-4ed4-87c0-1dc73ff21b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:54.724387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711e6ff-2b84-4ed4-87c0-1dc73ff21b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:54.725300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711e6ff-2b84-4ed4-87c0-1dc73ff21b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:54.726989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711e6ff-2b84-4ed4-87c0-1dc73ff21b57 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:54.738275 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1137/2258] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:54.742810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33146531-8019-4421-ac3e-40d803dd5aae admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:54.751643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:54.758810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33146531-8019-4421-ac3e-40d803dd5aae admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:54.770438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36591a71-662f-42cf-badc-d572ddcb40ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:54.771701 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36591a71-662f-42cf-badc-d572ddcb40ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:54.772070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36591a71-662f-42cf-badc-d572ddcb40ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:54.772588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36591a71-662f-42cf-badc-d572ddcb40ad admin admin] PATH_INFO: `/v3/projects/57cc4f813de240d8a093a8d17f3f30f9/users/8e1d5fc2dfda442689bdbe7c85ea06c0/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:54.791146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36591a71-662f-42cf-badc-d572ddcb40ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=57cc4f813de240d8a093a8d17f3f30f9, user_id=8e1d5fc2dfda442689bdbe7c85ea06c0, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:54.794485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36591a71-662f-42cf-badc-d572ddcb40ad admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:54.816162 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1122/2259] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:54 2022] PUT /identity/v3/projects/57cc4f813de240d8a093a8d17f3f30f9/users/8e1d5fc2dfda442689bdbe7c85ea06c0/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:54.827183 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0ab51-e424-4f47-9783-5bd8f9c77291 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:54.827461 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0ab51-e424-4f47-9783-5bd8f9c77291 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:54.827739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0ab51-e424-4f47-9783-5bd8f9c77291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:54.871037 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1fd0ab51-e424-4f47-9783-5bd8f9c77291 None None] MFA Rules not processed for user `8e1d5fc2dfda442689bdbe7c85ea06c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:54.872738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1fd0ab51-e424-4f47-9783-5bd8f9c77291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:54.961971 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1138/2260] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:54.966322 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36591a71-662f-42cf-badc-d572ddcb40ad admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:55.033556 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36591a71-662f-42cf-badc-d572ddcb40ad admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:55.039078 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e349b06-2e8d-43bc-9443-08c68cc5423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:55.039745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e349b06-2e8d-43bc-9443-08c68cc5423e admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:55.040028 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e349b06-2e8d-43bc-9443-08c68cc5423e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:55.040297 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e349b06-2e8d-43bc-9443-08c68cc5423e admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:55.041032 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e349b06-2e8d-43bc-9443-08c68cc5423e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:55.043035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e349b06-2e8d-43bc-9443-08c68cc5423e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:55.074332 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1123/2261] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:29:54 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:55.075506 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0ab51-e424-4f47-9783-5bd8f9c77291 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:55.088745 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0ab51-e424-4f47-9783-5bd8f9c77291 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:55.153240 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bfb0e-496d-4354-9273-fa5fde9a18c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:55.153947 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bfb0e-496d-4354-9273-fa5fde9a18c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:55.154189 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bfb0e-496d-4354-9273-fa5fde9a18c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:55.154536 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bfb0e-496d-4354-9273-fa5fde9a18c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:55.155386 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bfb0e-496d-4354-9273-fa5fde9a18c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:55.158773 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bfb0e-496d-4354-9273-fa5fde9a18c7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:55.178996 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:55.190264 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1139/2262] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:29:55 2022] POST /identity/v3/users => generated 295 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:29:55.191354 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e349b06-2e8d-43bc-9443-08c68cc5423e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:55.202060 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e349b06-2e8d-43bc-9443-08c68cc5423e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:55.207749 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20903bdf-1aca-4133-96bc-95f61a591e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:55.208417 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20903bdf-1aca-4133-96bc-95f61a591e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:55.208729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20903bdf-1aca-4133-96bc-95f61a591e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:55.208990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20903bdf-1aca-4133-96bc-95f61a591e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:55.209728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20903bdf-1aca-4133-96bc-95f61a591e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:55.211340 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20903bdf-1aca-4133-96bc-95f61a591e0d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:55.224166 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1124/2263] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:29:55.228563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bfb0e-496d-4354-9273-fa5fde9a18c7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:55.239287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bfb0e-496d-4354-9273-fa5fde9a18c7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:55.244923 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0b373-3307-4ed6-874a-419b1a0b22bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:55.245893 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0b373-3307-4ed6-874a-419b1a0b22bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:55.246171 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0b373-3307-4ed6-874a-419b1a0b22bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:55.246441 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0b373-3307-4ed6-874a-419b1a0b22bb admin admin] PATH_INFO: `/v3/projects/02a1a3c7aaf244bf8c0b3eaa9a9ad668/users/fb1225620e9c421dadf13f7dd2798e76/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:55.263280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0b373-3307-4ed6-874a-419b1a0b22bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a1a3c7aaf244bf8c0b3eaa9a9ad668, user_id=fb1225620e9c421dadf13f7dd2798e76, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:55.266083 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0b373-3307-4ed6-874a-419b1a0b22bb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:55.282103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1140/2264] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:55 2022] PUT /identity/v3/projects/02a1a3c7aaf244bf8c0b3eaa9a9ad668/users/fb1225620e9c421dadf13f7dd2798e76/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:55.286411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20903bdf-1aca-4133-96bc-95f61a591e0d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:55.297784 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20903bdf-1aca-4133-96bc-95f61a591e0d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:55.371918 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46986c63-7ebb-44a0-a391-0dbab5cf4185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:55.372636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986c63-7ebb-44a0-a391-0dbab5cf4185 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:55.372912 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986c63-7ebb-44a0-a391-0dbab5cf4185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:55.373233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986c63-7ebb-44a0-a391-0dbab5cf4185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:55.374003 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46986c63-7ebb-44a0-a391-0dbab5cf4185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:55.375643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46986c63-7ebb-44a0-a391-0dbab5cf4185 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:55.386725 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1125/2265] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:29:55.390796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0b373-3307-4ed6-874a-419b1a0b22bb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:55.402032 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0b373-3307-4ed6-874a-419b1a0b22bb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:55.407491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289ef58-a9d5-491f-a0d9-6700cd257408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:55.408319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289ef58-a9d5-491f-a0d9-6700cd257408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:55.408694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289ef58-a9d5-491f-a0d9-6700cd257408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:55.409035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289ef58-a9d5-491f-a0d9-6700cd257408 admin admin] PATH_INFO: `/v3/projects/02a1a3c7aaf244bf8c0b3eaa9a9ad668/users/fb1225620e9c421dadf13f7dd2798e76/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:55.411642 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289ef58-a9d5-491f-a0d9-6700cd257408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a1a3c7aaf244bf8c0b3eaa9a9ad668, user_id=fb1225620e9c421dadf13f7dd2798e76, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:55.414508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289ef58-a9d5-491f-a0d9-6700cd257408 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:55.426788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1141/2266] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:29:55 2022] PUT /identity/v3/projects/02a1a3c7aaf244bf8c0b3eaa9a9ad668/users/fb1225620e9c421dadf13f7dd2798e76/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:29:55.438218 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b330e3c-44e7-4bb7-be3d-053cc8fac7b2 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:55.438501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b330e3c-44e7-4bb7-be3d-053cc8fac7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:55.438776 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b330e3c-44e7-4bb7-be3d-053cc8fac7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:55.469000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2b330e3c-44e7-4bb7-be3d-053cc8fac7b2 None None] MFA Rules not processed for user `fb1225620e9c421dadf13f7dd2798e76`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:29:55.470841 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2b330e3c-44e7-4bb7-be3d-053cc8fac7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:55.512495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:29:55.552075 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1126/2267] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:29:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:29:55.563758 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289ef58-a9d5-491f-a0d9-6700cd257408 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:55.565524 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2289ef58-a9d5-491f-a0d9-6700cd257408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:29:55.629644 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289ef58-a9d5-491f-a0d9-6700cd257408 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:55.633664 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e9711-33ff-4271-9f20-3b6a9992c70d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:55.634310 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e9711-33ff-4271-9f20-3b6a9992c70d service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:55.634588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e9711-33ff-4271-9f20-3b6a9992c70d service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:55.634857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e9711-33ff-4271-9f20-3b6a9992c70d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:55.696464 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e9711-33ff-4271-9f20-3b6a9992c70d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:55.697972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e9711-33ff-4271-9f20-3b6a9992c70d service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:55.708002 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1142/2268] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:57.268986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b330e3c-44e7-4bb7-be3d-053cc8fac7b2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:57.279174 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b330e3c-44e7-4bb7-be3d-053cc8fac7b2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:57.283126 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10b48a-fb47-46a1-a761-f17f053db0fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:57.283817 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b48a-fb47-46a1-a761-f17f053db0fa service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:57.284720 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b48a-fb47-46a1-a761-f17f053db0fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:57.285029 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b48a-fb47-46a1-a761-f17f053db0fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:57.349635 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10b48a-fb47-46a1-a761-f17f053db0fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:57.351130 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10b48a-fb47-46a1-a761-f17f053db0fa service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:57.362433 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1127/2269] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:29:57.954053 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e9711-33ff-4271-9f20-3b6a9992c70d service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:29:57.962956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e9711-33ff-4271-9f20-3b6a9992c70d service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:29:57.966582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1cda3-26af-475b-87dd-b94de6ad4615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:29:57.967230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1cda3-26af-475b-87dd-b94de6ad4615 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:29:57.967509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1cda3-26af-475b-87dd-b94de6ad4615 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:29:57.967783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1cda3-26af-475b-87dd-b94de6ad4615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:29:57.978301 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1cda3-26af-475b-87dd-b94de6ad4615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:29:57.979806 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1cda3-26af-475b-87dd-b94de6ad4615 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:29:57.989692 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1143/2270] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:29:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:30:00.542567 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10b48a-fb47-46a1-a761-f17f053db0fa service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:00.544130 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cf10b48a-fb47-46a1-a761-f17f053db0fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:00.616299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10b48a-fb47-46a1-a761-f17f053db0fa service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:00.620956 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ec5cb-4cd1-4bb0-9b52-c387990927a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:00.621850 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ec5cb-4cd1-4bb0-9b52-c387990927a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:00.622115 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ec5cb-4cd1-4bb0-9b52-c387990927a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:00.622402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ec5cb-4cd1-4bb0-9b52-c387990927a3 admin admin] PATH_INFO: `/v3/users/c623c78e978649c3b7a3187007326ca1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:00.623613 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ec5cb-4cd1-4bb0-9b52-c387990927a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c623c78e978649c3b7a3187007326ca1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:00.625689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ec5cb-4cd1-4bb0-9b52-c387990927a3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:00.698960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-759ec5cb-4cd1-4bb0-9b52-c387990927a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c623c78e978649c3b7a3187007326ca1'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:00.717293 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-759ec5cb-4cd1-4bb0-9b52-c387990927a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c623c78e978649c3b7a3187007326ca1'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:00.732924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-759ec5cb-4cd1-4bb0-9b52-c387990927a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c623c78e978649c3b7a3187007326ca1'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:00.733629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-759ec5cb-4cd1-4bb0-9b52-c387990927a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c623c78e978649c3b7a3187007326ca1'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:00.739042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:00.743272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-759ec5cb-4cd1-4bb0-9b52-c387990927a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c623c78e978649c3b7a3187007326ca1'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:00.750736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c4c18-26cb-40d5-9267-1d905693fbbb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:00.751217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c4c18-26cb-40d5-9267-1d905693fbbb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:00.751461 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c4c18-26cb-40d5-9267-1d905693fbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:00.757078 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1128/2271] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:30:00 2022] DELETE /identity/v3/users/c623c78e978649c3b7a3187007326ca1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:00.761068 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e11b6-c606-4a69-8b3e-f34742169194 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:00.761354 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e11b6-c606-4a69-8b3e-f34742169194 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:00.761631 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e11b6-c606-4a69-8b3e-f34742169194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:00.775578 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f41c4c18-26cb-40d5-9267-1d905693fbbb None None] MFA Rules not processed for user `e23aea853cce44698b19d6bc087093c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:00.776811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f41c4c18-26cb-40d5-9267-1d905693fbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:00.780723 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-dc1e11b6-c606-4a69-8b3e-f34742169194 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:00.781992 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-dc1e11b6-c606-4a69-8b3e-f34742169194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:00.846156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1144/2272] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 03:30:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:30:00.854923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1129/2273] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:00.866143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c4c18-26cb-40d5-9267-1d905693fbbb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:00.867438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f41c4c18-26cb-40d5-9267-1d905693fbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:00.878360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:00.905403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e11b6-c606-4a69-8b3e-f34742169194 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:00.907032 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-dc1e11b6-c606-4a69-8b3e-f34742169194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:00.927953 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c4c18-26cb-40d5-9267-1d905693fbbb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:00.931821 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49229f2-38a7-4330-90f7-2db2a26e1851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:00.932479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49229f2-38a7-4330-90f7-2db2a26e1851 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:00.932822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49229f2-38a7-4330-90f7-2db2a26e1851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:00.933095 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49229f2-38a7-4330-90f7-2db2a26e1851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:00.943220 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49229f2-38a7-4330-90f7-2db2a26e1851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:00.944726 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49229f2-38a7-4330-90f7-2db2a26e1851 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:00.956694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1145/2274] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:30:00.995133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e11b6-c606-4a69-8b3e-f34742169194 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:01.000964 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3126e-cff1-4303-9a63-50e24e53344a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc4cbd87dd249868cfb704535774126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:01.001709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3126e-cff1-4303-9a63-50e24e53344a service swift] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:01.001991 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3126e-cff1-4303-9a63-50e24e53344a service swift] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:01.002265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3126e-cff1-4303-9a63-50e24e53344a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:01.011949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3126e-cff1-4303-9a63-50e24e53344a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:01.013805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3126e-cff1-4303-9a63-50e24e53344a service swift] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:01.023517 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1130/2275] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 03:30:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 03:30:01.326310 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49229f2-38a7-4330-90f7-2db2a26e1851 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:01.327793 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f49229f2-38a7-4330-90f7-2db2a26e1851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:01.372498 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49229f2-38a7-4330-90f7-2db2a26e1851 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:01.381964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899be04-18d0-4613-8aaa-a2eb8f6d3b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:01.382850 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899be04-18d0-4613-8aaa-a2eb8f6d3b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:01.383132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899be04-18d0-4613-8aaa-a2eb8f6d3b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:01.383407 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899be04-18d0-4613-8aaa-a2eb8f6d3b1f admin admin] PATH_INFO: `/v3/projects/3e16547a2f3e4aec9da94c76670a2751` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:01.385850 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899be04-18d0-4613-8aaa-a2eb8f6d3b1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e16547a2f3e4aec9da94c76670a2751)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:01.388359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899be04-18d0-4613-8aaa-a2eb8f6d3b1f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:01.463252 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d899be04-18d0-4613-8aaa-a2eb8f6d3b1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e16547a2f3e4aec9da94c76670a2751', 'request_id': 'req-d899be04-18d0-4613-8aaa-a2eb8f6d3b1f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:01.477636 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d899be04-18d0-4613-8aaa-a2eb8f6d3b1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e16547a2f3e4aec9da94c76670a2751', 'request_id': 'req-d899be04-18d0-4613-8aaa-a2eb8f6d3b1f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:01.491226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d899be04-18d0-4613-8aaa-a2eb8f6d3b1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e16547a2f3e4aec9da94c76670a2751', 'request_id': 'req-d899be04-18d0-4613-8aaa-a2eb8f6d3b1f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:01.512778 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d899be04-18d0-4613-8aaa-a2eb8f6d3b1f admin admin] The token cache is being invalidate because project 3e16547a2f3e4aec9da94c76670a2751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:30:01.513069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d899be04-18d0-4613-8aaa-a2eb8f6d3b1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:01.513958 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d899be04-18d0-4613-8aaa-a2eb8f6d3b1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:01.515540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1146/2276] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:30:01 2022] DELETE /identity/v3/projects/3e16547a2f3e4aec9da94c76670a2751 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:01.520489 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4f0c0-185c-45d5-8839-5a522a1e5abc None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:01.520801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4f0c0-185c-45d5-8839-5a522a1e5abc None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:01.521079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4f0c0-185c-45d5-8839-5a522a1e5abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:01.548865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6fb4f0c0-185c-45d5-8839-5a522a1e5abc None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:01.550677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6fb4f0c0-185c-45d5-8839-5a522a1e5abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:01.636673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1131/2277] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:01.642077 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b2430-3db7-47d0-84fa-27f24fe160d3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:01.643196 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b2430-3db7-47d0-84fa-27f24fe160d3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:01.643657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b2430-3db7-47d0-84fa-27f24fe160d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:01.668289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bd7b2430-3db7-47d0-84fa-27f24fe160d3 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:01.669670 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bd7b2430-3db7-47d0-84fa-27f24fe160d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:01.686903 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1147/2278] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:01.692271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4f0c0-185c-45d5-8839-5a522a1e5abc None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:01.708847 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4f0c0-185c-45d5-8839-5a522a1e5abc None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:01.722845 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefe7fe-99ba-4c61-a7da-f8d8f51f9188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:01.723734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefe7fe-99ba-4c61-a7da-f8d8f51f9188 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:01.724064 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefe7fe-99ba-4c61-a7da-f8d8f51f9188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:01.724471 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefe7fe-99ba-4c61-a7da-f8d8f51f9188 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:01.725573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefe7fe-99ba-4c61-a7da-f8d8f51f9188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:30:01.725915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefe7fe-99ba-4c61-a7da-f8d8f51f9188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:01.728561 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefe7fe-99ba-4c61-a7da-f8d8f51f9188 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:01.749782 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1132/2279] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:30:01.754129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b2430-3db7-47d0-84fa-27f24fe160d3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:01.767678 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b2430-3db7-47d0-84fa-27f24fe160d3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:01.773420 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b1abc-8404-48e6-b860-e6b959295b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:01.774087 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b1abc-8404-48e6-b860-e6b959295b6a admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:01.774377 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b1abc-8404-48e6-b860-e6b959295b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:01.774640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b1abc-8404-48e6-b860-e6b959295b6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:01.775385 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b1abc-8404-48e6-b860-e6b959295b6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:01.777631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b1abc-8404-48e6-b860-e6b959295b6a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:01.808160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1148/2280] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:30:01 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:30:01.812377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefe7fe-99ba-4c61-a7da-f8d8f51f9188 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:01.825162 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefe7fe-99ba-4c61-a7da-f8d8f51f9188 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:01.832470 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:01.972921 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b1abc-8404-48e6-b860-e6b959295b6a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:01.974649 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-466b1abc-8404-48e6-b860-e6b959295b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:01.980990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3f146-dcc9-4baf-9ebc-c742153dba64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:01.981683 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3f146-dcc9-4baf-9ebc-c742153dba64 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:01.982026 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3f146-dcc9-4baf-9ebc-c742153dba64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:01.982322 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3f146-dcc9-4baf-9ebc-c742153dba64 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:01.984027 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3f146-dcc9-4baf-9ebc-c742153dba64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:01.986600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3f146-dcc9-4baf-9ebc-c742153dba64 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:02.013752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1133/2281] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:30:01 2022] POST /identity/v3/users => generated 283 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:30:02.018350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3f146-dcc9-4baf-9ebc-c742153dba64 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:02.029197 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3f146-dcc9-4baf-9ebc-c742153dba64 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:02.034338 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1899dc5-3766-4df1-935d-b9beb157f055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:02.035262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1899dc5-3766-4df1-935d-b9beb157f055 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:02.035386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1899dc5-3766-4df1-935d-b9beb157f055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:02.035648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1899dc5-3766-4df1-935d-b9beb157f055 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:02.036428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1899dc5-3766-4df1-935d-b9beb157f055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:02.038474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1899dc5-3766-4df1-935d-b9beb157f055 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:02.051604 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1134/2282] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:30:02.055521 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1899dc5-3766-4df1-935d-b9beb157f055 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:02.056376 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b1abc-8404-48e6-b860-e6b959295b6a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:02.062544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8ef02-3617-4bcb-a5c0-0f5a8d358741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:02.064054 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8ef02-3617-4bcb-a5c0-0f5a8d358741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:02.064422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8ef02-3617-4bcb-a5c0-0f5a8d358741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:02.064804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8ef02-3617-4bcb-a5c0-0f5a8d358741 admin admin] PATH_INFO: `/v3/users/1751f4d349bf4d55bc8ab3eddc80eecd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:02.066102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8ef02-3617-4bcb-a5c0-0f5a8d358741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1751f4d349bf4d55bc8ab3eddc80eecd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:02.067531 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1899dc5-3766-4df1-935d-b9beb157f055 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:02.068328 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8ef02-3617-4bcb-a5c0-0f5a8d358741 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:02.073074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc59f8e-e615-4017-b85b-b3dea4b4c195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:02.073816 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc59f8e-e615-4017-b85b-b3dea4b4c195 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:02.074165 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc59f8e-e615-4017-b85b-b3dea4b4c195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:02.074515 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc59f8e-e615-4017-b85b-b3dea4b4c195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:02.075427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc59f8e-e615-4017-b85b-b3dea4b4c195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:02.075870 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:02.077273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc59f8e-e615-4017-b85b-b3dea4b4c195 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:02.095518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1135/2283] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:30:02.097342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc59f8e-e615-4017-b85b-b3dea4b4c195 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:02.108729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc59f8e-e615-4017-b85b-b3dea4b4c195 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:02.115316 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c11853-5438-4274-92b2-84a94af0f908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:02.116393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11853-5438-4274-92b2-84a94af0f908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:02.116752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11853-5438-4274-92b2-84a94af0f908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:02.117207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11853-5438-4274-92b2-84a94af0f908 admin admin] PATH_INFO: `/v3/projects/9189d895806a497c830a2a3356983469/users/ff8c19cb927f4be4a91dc0324866fe35/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:02.133447 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3ca8ef02-3617-4bcb-a5c0-0f5a8d358741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1751f4d349bf4d55bc8ab3eddc80eecd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:02.135184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c11853-5438-4274-92b2-84a94af0f908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9189d895806a497c830a2a3356983469, user_id=ff8c19cb927f4be4a91dc0324866fe35, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:02.138047 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c11853-5438-4274-92b2-84a94af0f908 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:02.147553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3ca8ef02-3617-4bcb-a5c0-0f5a8d358741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1751f4d349bf4d55bc8ab3eddc80eecd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:02.156272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1136/2284] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:30:02 2022] PUT /identity/v3/projects/9189d895806a497c830a2a3356983469/users/ff8c19cb927f4be4a91dc0324866fe35/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:02.160791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3ca8ef02-3617-4bcb-a5c0-0f5a8d358741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1751f4d349bf4d55bc8ab3eddc80eecd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:02.161460 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3ca8ef02-3617-4bcb-a5c0-0f5a8d358741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1751f4d349bf4d55bc8ab3eddc80eecd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:02.167201 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef053445-7cc8-4b2a-9532-18940fa0efe1 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:02.167501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef053445-7cc8-4b2a-9532-18940fa0efe1 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:02.167770 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef053445-7cc8-4b2a-9532-18940fa0efe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:02.181575 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3ca8ef02-3617-4bcb-a5c0-0f5a8d358741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1751f4d349bf4d55bc8ab3eddc80eecd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:02.199232 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1149/2285] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:30:01 2022] DELETE /identity/v3/users/1751f4d349bf4d55bc8ab3eddc80eecd => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:30:02.200772 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64295024-d43f-4b6a-a3a6-b089d3818b34 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:02.201067 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64295024-d43f-4b6a-a3a6-b089d3818b34 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:02.201345 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64295024-d43f-4b6a-a3a6-b089d3818b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:02.204021 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ef053445-7cc8-4b2a-9532-18940fa0efe1 None None] MFA Rules not processed for user `ff8c19cb927f4be4a91dc0324866fe35`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:02.205778 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ef053445-7cc8-4b2a-9532-18940fa0efe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:02.221386 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-64295024-d43f-4b6a-a3a6-b089d3818b34 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:02.222662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-64295024-d43f-4b6a-a3a6-b089d3818b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:02.298469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1137/2286] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:02.309735 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef053445-7cc8-4b2a-9532-18940fa0efe1 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:02.311556 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ef053445-7cc8-4b2a-9532-18940fa0efe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:02.314723 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1150/2287] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:30:02.326529 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64295024-d43f-4b6a-a3a6-b089d3818b34 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:02.329081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-64295024-d43f-4b6a-a3a6-b089d3818b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:02.387181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:02.406070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef053445-7cc8-4b2a-9532-18940fa0efe1 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:02.407491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64295024-d43f-4b6a-a3a6-b089d3818b34 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:02.411377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5bd00-d9cb-4fa3-93e3-93411def63bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:02.413756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c8ad2-279d-4413-8d7e-ddfbb8ed611a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:02.413756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c8ad2-279d-4413-8d7e-ddfbb8ed611a service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:02.414049 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5bd00-d9cb-4fa3-93e3-93411def63bb service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:02.414155 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c8ad2-279d-4413-8d7e-ddfbb8ed611a service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:02.414155 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c8ad2-279d-4413-8d7e-ddfbb8ed611a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:02.414831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5bd00-d9cb-4fa3-93e3-93411def63bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:02.415243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5bd00-d9cb-4fa3-93e3-93411def63bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:02.426296 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c8ad2-279d-4413-8d7e-ddfbb8ed611a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:02.428471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c8ad2-279d-4413-8d7e-ddfbb8ed611a service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:02.429867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5bd00-d9cb-4fa3-93e3-93411def63bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:02.431396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5bd00-d9cb-4fa3-93e3-93411def63bb service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:02.444452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1138/2288] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:30:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:30:02.457140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1151/2289] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:30:02.923573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5bd00-d9cb-4fa3-93e3-93411def63bb service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:02.926679 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3db5bd00-d9cb-4fa3-93e3-93411def63bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:02.942497 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5bd00-d9cb-4fa3-93e3-93411def63bb service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:02.954080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8045c-a91c-464d-b88c-136a971c4f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:02.956495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8045c-a91c-464d-b88c-136a971c4f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:02.957302 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8045c-a91c-464d-b88c-136a971c4f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:02.957684 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8045c-a91c-464d-b88c-136a971c4f63 admin admin] PATH_INFO: `/v3/projects/d74ad84bce3d45a298891523022c6ce9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:02.959152 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8045c-a91c-464d-b88c-136a971c4f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74ad84bce3d45a298891523022c6ce9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:02.963137 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8045c-a91c-464d-b88c-136a971c4f63 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:03.027556 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4af8045c-a91c-464d-b88c-136a971c4f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74ad84bce3d45a298891523022c6ce9', 'request_id': 'req-4af8045c-a91c-464d-b88c-136a971c4f63'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:03.037753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4af8045c-a91c-464d-b88c-136a971c4f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74ad84bce3d45a298891523022c6ce9', 'request_id': 'req-4af8045c-a91c-464d-b88c-136a971c4f63'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:03.045020 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4af8045c-a91c-464d-b88c-136a971c4f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74ad84bce3d45a298891523022c6ce9', 'request_id': 'req-4af8045c-a91c-464d-b88c-136a971c4f63'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:03.057818 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4af8045c-a91c-464d-b88c-136a971c4f63 admin admin] The token cache is being invalidate because project d74ad84bce3d45a298891523022c6ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:30:03.058142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4af8045c-a91c-464d-b88c-136a971c4f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:03.058811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4af8045c-a91c-464d-b88c-136a971c4f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:03.060669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1139/2290] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:30:02 2022] DELETE /identity/v3/projects/d74ad84bce3d45a298891523022c6ce9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:03.065053 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c8ad2-279d-4413-8d7e-ddfbb8ed611a service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:03.075252 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c8ad2-279d-4413-8d7e-ddfbb8ed611a service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:03.104328 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:03.141181 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeac43-fb19-4686-808e-1b2448a9a8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:03.142089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeac43-fb19-4686-808e-1b2448a9a8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:03.142361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeac43-fb19-4686-808e-1b2448a9a8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:03.142723 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeac43-fb19-4686-808e-1b2448a9a8d3 admin admin] PATH_INFO: `/v3/users/8e1d5fc2dfda442689bdbe7c85ea06c0` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:03.143900 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeac43-fb19-4686-808e-1b2448a9a8d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e1d5fc2dfda442689bdbe7c85ea06c0)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:03.145873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeac43-fb19-4686-808e-1b2448a9a8d3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:03.210853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-37aeac43-fb19-4686-808e-1b2448a9a8d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e1d5fc2dfda442689bdbe7c85ea06c0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:03.220554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-37aeac43-fb19-4686-808e-1b2448a9a8d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e1d5fc2dfda442689bdbe7c85ea06c0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:03.229963 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-37aeac43-fb19-4686-808e-1b2448a9a8d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e1d5fc2dfda442689bdbe7c85ea06c0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:03.230652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-37aeac43-fb19-4686-808e-1b2448a9a8d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e1d5fc2dfda442689bdbe7c85ea06c0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:03.243758 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-37aeac43-fb19-4686-808e-1b2448a9a8d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e1d5fc2dfda442689bdbe7c85ea06c0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:03.252197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1152/2291] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:30:03 2022] DELETE /identity/v3/users/8e1d5fc2dfda442689bdbe7c85ea06c0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:03.608998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8045c-a91c-464d-b88c-136a971c4f63 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:03.611061 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4af8045c-a91c-464d-b88c-136a971c4f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:03.634005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8045c-a91c-464d-b88c-136a971c4f63 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:03.716543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac212b-3f7d-46ae-9772-8032caecc694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:03.717724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac212b-3f7d-46ae-9772-8032caecc694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:03.718001 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac212b-3f7d-46ae-9772-8032caecc694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:03.718271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac212b-3f7d-46ae-9772-8032caecc694 admin admin] PATH_INFO: `/v3/projects/57cc4f813de240d8a093a8d17f3f30f9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:03.720104 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac212b-3f7d-46ae-9772-8032caecc694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57cc4f813de240d8a093a8d17f3f30f9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:03.721893 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac212b-3f7d-46ae-9772-8032caecc694 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:03.783118 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d5ac212b-3f7d-46ae-9772-8032caecc694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57cc4f813de240d8a093a8d17f3f30f9', 'request_id': 'req-d5ac212b-3f7d-46ae-9772-8032caecc694'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:03.794344 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d5ac212b-3f7d-46ae-9772-8032caecc694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57cc4f813de240d8a093a8d17f3f30f9', 'request_id': 'req-d5ac212b-3f7d-46ae-9772-8032caecc694'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:03.800672 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d5ac212b-3f7d-46ae-9772-8032caecc694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57cc4f813de240d8a093a8d17f3f30f9', 'request_id': 'req-d5ac212b-3f7d-46ae-9772-8032caecc694'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:03.808356 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:03.817557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d5ac212b-3f7d-46ae-9772-8032caecc694 admin admin] The token cache is being invalidate because project 57cc4f813de240d8a093a8d17f3f30f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:30:03.818071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d5ac212b-3f7d-46ae-9772-8032caecc694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:03.836002 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d5ac212b-3f7d-46ae-9772-8032caecc694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:03.841642 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1140/2292] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:30:03 2022] DELETE /identity/v3/projects/57cc4f813de240d8a093a8d17f3f30f9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:03.842837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeac43-fb19-4686-808e-1b2448a9a8d3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:03.846004 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-37aeac43-fb19-4686-808e-1b2448a9a8d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:03.879928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeac43-fb19-4686-808e-1b2448a9a8d3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:03.972306 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cbb4e-c495-4a5a-be1f-f2452c20dbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:03.973603 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cbb4e-c495-4a5a-be1f-f2452c20dbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:03.973966 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cbb4e-c495-4a5a-be1f-f2452c20dbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:03.974340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cbb4e-c495-4a5a-be1f-f2452c20dbed admin admin] PATH_INFO: `/v3/users/fb1225620e9c421dadf13f7dd2798e76` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:03.975687 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cbb4e-c495-4a5a-be1f-f2452c20dbed admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb1225620e9c421dadf13f7dd2798e76)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:03.978490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cbb4e-c495-4a5a-be1f-f2452c20dbed admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:04.053442 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7b1cbb4e-c495-4a5a-be1f-f2452c20dbed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1225620e9c421dadf13f7dd2798e76'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:04.057770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:04.068402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7b1cbb4e-c495-4a5a-be1f-f2452c20dbed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1225620e9c421dadf13f7dd2798e76'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:04.079392 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7b1cbb4e-c495-4a5a-be1f-f2452c20dbed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1225620e9c421dadf13f7dd2798e76'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:04.080158 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7b1cbb4e-c495-4a5a-be1f-f2452c20dbed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1225620e9c421dadf13f7dd2798e76'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:04.101040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7b1cbb4e-c495-4a5a-be1f-f2452c20dbed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1225620e9c421dadf13f7dd2798e76'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:04.108762 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1153/2293] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:30:03 2022] DELETE /identity/v3/users/fb1225620e9c421dadf13f7dd2798e76 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:30:04.492947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac212b-3f7d-46ae-9772-8032caecc694 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:04.495897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d5ac212b-3f7d-46ae-9772-8032caecc694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:04.510013 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac212b-3f7d-46ae-9772-8032caecc694 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:04.576838 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672e188-4335-4ff4-844d-10a188fae520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:04.577727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672e188-4335-4ff4-844d-10a188fae520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:04.578000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672e188-4335-4ff4-844d-10a188fae520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:04.578353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672e188-4335-4ff4-844d-10a188fae520 admin admin] PATH_INFO: `/v3/projects/02a1a3c7aaf244bf8c0b3eaa9a9ad668` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:04.581010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672e188-4335-4ff4-844d-10a188fae520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02a1a3c7aaf244bf8c0b3eaa9a9ad668)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:04.582322 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672e188-4335-4ff4-844d-10a188fae520 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:04.649110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e672e188-4335-4ff4-844d-10a188fae520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02a1a3c7aaf244bf8c0b3eaa9a9ad668', 'request_id': 'req-e672e188-4335-4ff4-844d-10a188fae520'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:04.671329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e672e188-4335-4ff4-844d-10a188fae520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02a1a3c7aaf244bf8c0b3eaa9a9ad668', 'request_id': 'req-e672e188-4335-4ff4-844d-10a188fae520'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:04.681200 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e672e188-4335-4ff4-844d-10a188fae520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02a1a3c7aaf244bf8c0b3eaa9a9ad668', 'request_id': 'req-e672e188-4335-4ff4-844d-10a188fae520'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:04.695394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e672e188-4335-4ff4-844d-10a188fae520 admin admin] The token cache is being invalidate because project 02a1a3c7aaf244bf8c0b3eaa9a9ad668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:30:04.695867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e672e188-4335-4ff4-844d-10a188fae520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:04.696661 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e672e188-4335-4ff4-844d-10a188fae520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:04.698648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1141/2294] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:30:04 2022] DELETE /identity/v3/projects/02a1a3c7aaf244bf8c0b3eaa9a9ad668 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:04.703527 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a64b71-d665-4b97-af6f-80027ad4c929 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:04.704053 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a64b71-d665-4b97-af6f-80027ad4c929 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:04.705201 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a64b71-d665-4b97-af6f-80027ad4c929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:04.731510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d9a64b71-d665-4b97-af6f-80027ad4c929 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:04.734055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d9a64b71-d665-4b97-af6f-80027ad4c929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:04.822865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1154/2295] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:04.831722 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e8bef-7718-4e45-a869-70dedeeda824 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:04.832008 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e8bef-7718-4e45-a869-70dedeeda824 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:04.832428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e8bef-7718-4e45-a869-70dedeeda824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:04.855740 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5c9e8bef-7718-4e45-a869-70dedeeda824 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:04.857285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5c9e8bef-7718-4e45-a869-70dedeeda824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:04.870377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1142/2296] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:30:04.871813 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a64b71-d665-4b97-af6f-80027ad4c929 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:04.882598 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a64b71-d665-4b97-af6f-80027ad4c929 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:04.887467 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7f3dc-2953-4307-87ab-69ebb96d8839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:04.888151 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7f3dc-2953-4307-87ab-69ebb96d8839 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:04.888433 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7f3dc-2953-4307-87ab-69ebb96d8839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:04.888912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7f3dc-2953-4307-87ab-69ebb96d8839 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:04.889675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7f3dc-2953-4307-87ab-69ebb96d8839 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:30:04.889998 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7f3dc-2953-4307-87ab-69ebb96d8839 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:04.896716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7f3dc-2953-4307-87ab-69ebb96d8839 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:04.908006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1155/2297] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:30:04.912608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e8bef-7718-4e45-a869-70dedeeda824 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:04.923229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e8bef-7718-4e45-a869-70dedeeda824 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:04.928126 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7b867-7de2-4c8e-843a-494fd72d147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:04.928837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7b867-7de2-4c8e-843a-494fd72d147d admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:04.929134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7b867-7de2-4c8e-843a-494fd72d147d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:04.929388 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7b867-7de2-4c8e-843a-494fd72d147d admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:04.930131 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7b867-7de2-4c8e-843a-494fd72d147d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:04.932074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7b867-7de2-4c8e-843a-494fd72d147d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:04.971723 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1143/2298] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:30:04 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:30:04.972899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7f3dc-2953-4307-87ab-69ebb96d8839 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:04.984280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7f3dc-2953-4307-87ab-69ebb96d8839 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:05.051168 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ffec0-3153-4d49-a662-b0f4356405cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:05.051883 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ffec0-3153-4d49-a662-b0f4356405cd admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:05.052166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ffec0-3153-4d49-a662-b0f4356405cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:05.052443 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ffec0-3153-4d49-a662-b0f4356405cd admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:05.053185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ffec0-3153-4d49-a662-b0f4356405cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:05.055136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ffec0-3153-4d49-a662-b0f4356405cd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:05.080752 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1156/2299] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:30:04 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:30:05.084661 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7b867-7de2-4c8e-843a-494fd72d147d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:05.098152 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7b867-7de2-4c8e-843a-494fd72d147d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:05.105390 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7002e3d-c42e-4aec-94f6-b168cfaaf307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:05.106196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7002e3d-c42e-4aec-94f6-b168cfaaf307 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:05.106487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7002e3d-c42e-4aec-94f6-b168cfaaf307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:05.106898 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7002e3d-c42e-4aec-94f6-b168cfaaf307 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:05.107498 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7002e3d-c42e-4aec-94f6-b168cfaaf307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:05.109292 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7002e3d-c42e-4aec-94f6-b168cfaaf307 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:05.130839 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1144/2300] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:30:05.131891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ffec0-3153-4d49-a662-b0f4356405cd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:05.143606 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ffec0-3153-4d49-a662-b0f4356405cd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:05.150857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d60c1-593e-40a3-960e-33a96850f06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:05.151898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d60c1-593e-40a3-960e-33a96850f06b admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:05.152313 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d60c1-593e-40a3-960e-33a96850f06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:05.152694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d60c1-593e-40a3-960e-33a96850f06b admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:05.153763 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d60c1-593e-40a3-960e-33a96850f06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:05.155902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d60c1-593e-40a3-960e-33a96850f06b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:05.175747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7002e3d-c42e-4aec-94f6-b168cfaaf307 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:05.181430 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1157/2301] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:30:05.188772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7002e3d-c42e-4aec-94f6-b168cfaaf307 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:05.195053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04820699-bbf4-4c9e-a03e-299ab954ded0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:05.195993 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04820699-bbf4-4c9e-a03e-299ab954ded0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:05.196277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04820699-bbf4-4c9e-a03e-299ab954ded0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:05.196734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04820699-bbf4-4c9e-a03e-299ab954ded0 admin admin] PATH_INFO: `/v3/projects/b89e0865f95a4ec6859e47d1f14abfb3/users/80c975dcb83743aeadbd2407858e92b1/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:05.217960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04820699-bbf4-4c9e-a03e-299ab954ded0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89e0865f95a4ec6859e47d1f14abfb3, user_id=80c975dcb83743aeadbd2407858e92b1, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:05.221756 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04820699-bbf4-4c9e-a03e-299ab954ded0 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:05.251259 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1145/2302] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:30:05 2022] PUT /identity/v3/projects/b89e0865f95a4ec6859e47d1f14abfb3/users/80c975dcb83743aeadbd2407858e92b1/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:05.261691 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2399f-988e-4d7f-9350-779d043016b1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:05.262275 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2399f-988e-4d7f-9350-779d043016b1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:05.262758 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2399f-988e-4d7f-9350-779d043016b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:05.315307 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-76d2399f-988e-4d7f-9350-779d043016b1 None None] MFA Rules not processed for user `80c975dcb83743aeadbd2407858e92b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:05.317743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-76d2399f-988e-4d7f-9350-779d043016b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:05.347434 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:05.420564 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1158/2303] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:30:05.430337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04820699-bbf4-4c9e-a03e-299ab954ded0 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:05.432814 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-04820699-bbf4-4c9e-a03e-299ab954ded0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:05.470069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:05.508508 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04820699-bbf4-4c9e-a03e-299ab954ded0 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:05.514392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c5daa-cb9b-470d-9ff4-b5642fad4c35 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97fe9d04ccb445208f3783a8b55cd31e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:05.515191 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c5daa-cb9b-470d-9ff4-b5642fad4c35 service glance] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:05.516040 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c5daa-cb9b-470d-9ff4-b5642fad4c35 service glance] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:05.516224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c5daa-cb9b-470d-9ff4-b5642fad4c35 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:05.528630 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c5daa-cb9b-470d-9ff4-b5642fad4c35 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:05.530376 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c5daa-cb9b-470d-9ff4-b5642fad4c35 service glance] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:05.541408 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1146/2304] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:30:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:30:13.755757 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed8fc-1454-46d0-87cf-d5d664844cc2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:13.756479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed8fc-1454-46d0-87cf-d5d664844cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:13.756479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed8fc-1454-46d0-87cf-d5d664844cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:13.775138 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-365ed8fc-1454-46d0-87cf-d5d664844cc2 None None] MFA Rules not processed for user `d8e90b4b09dd453f9685fb034227a136`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:13.776447 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-365ed8fc-1454-46d0-87cf-d5d664844cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:13.875849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1159/2305] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:30:15.536037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=15 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:23.859645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=42 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:27.757083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dca3b-8d0b-4ee5-8540-4303b3c5bb8c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:27.757083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dca3b-8d0b-4ee5-8540-4303b3c5bb8c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:27.757083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dca3b-8d0b-4ee5-8540-4303b3c5bb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:27.786304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c38dca3b-8d0b-4ee5-8540-4303b3c5bb8c None None] MFA Rules not processed for user `e23aea853cce44698b19d6bc087093c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:27.787813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c38dca3b-8d0b-4ee5-8540-4303b3c5bb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:27.895552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1147/2306] 10.222.0.26 () {58 vars in 967 bytes} [Tue Jul 12 03:30:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:27.911745 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ed8fc-1454-46d0-87cf-d5d664844cc2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:27.918745 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-365ed8fc-1454-46d0-87cf-d5d664844cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:28.050612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ed8fc-1454-46d0-87cf-d5d664844cc2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:28.063915 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9ffa1-56a5-411f-859f-8e441d43d843 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc4cbd87dd249868cfb704535774126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:28.064956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9ffa1-56a5-411f-859f-8e441d43d843 service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:28.065235 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9ffa1-56a5-411f-859f-8e441d43d843 service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:28.065516 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9ffa1-56a5-411f-859f-8e441d43d843 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:28.077418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9ffa1-56a5-411f-859f-8e441d43d843 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:28.079059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9ffa1-56a5-411f-859f-8e441d43d843 service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:28.090276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1160/2307] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 03:30:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 03:30:31.003461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38dca3b-8d0b-4ee5-8540-4303b3c5bb8c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:31.004949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c38dca3b-8d0b-4ee5-8540-4303b3c5bb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:31.153391 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38dca3b-8d0b-4ee5-8540-4303b3c5bb8c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:31.167463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dafb3-1ea6-4240-8920-d2c3444b6027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:31.168757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dafb3-1ea6-4240-8920-d2c3444b6027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:31.169025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dafb3-1ea6-4240-8920-d2c3444b6027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:31.169296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dafb3-1ea6-4240-8920-d2c3444b6027 admin admin] PATH_INFO: `/v3/users/31bd41139867408b8cdc6b7f6be968de` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:31.170546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dafb3-1ea6-4240-8920-d2c3444b6027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31bd41139867408b8cdc6b7f6be968de)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:31.173861 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dafb3-1ea6-4240-8920-d2c3444b6027 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:31.244394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4a1dafb3-1ea6-4240-8920-d2c3444b6027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31bd41139867408b8cdc6b7f6be968de'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:31.259611 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4a1dafb3-1ea6-4240-8920-d2c3444b6027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31bd41139867408b8cdc6b7f6be968de'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:31.281079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4a1dafb3-1ea6-4240-8920-d2c3444b6027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31bd41139867408b8cdc6b7f6be968de'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:31.281840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4a1dafb3-1ea6-4240-8920-d2c3444b6027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31bd41139867408b8cdc6b7f6be968de'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:31.305920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4a1dafb3-1ea6-4240-8920-d2c3444b6027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31bd41139867408b8cdc6b7f6be968de'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:31.314977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1148/2308] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:30:31 2022] DELETE /identity/v3/users/31bd41139867408b8cdc6b7f6be968de => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:31.618627 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9ffa1-56a5-411f-859f-8e441d43d843 service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:31.640142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9ffa1-56a5-411f-859f-8e441d43d843 service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:31.735240 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d1ad6-0536-43b6-a9c2-81d40198a2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:31.736742 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d1ad6-0536-43b6-a9c2-81d40198a2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:31.737299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d1ad6-0536-43b6-a9c2-81d40198a2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:31.737501 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d1ad6-0536-43b6-a9c2-81d40198a2a5 admin admin] PATH_INFO: `/v3/projects/32ef6c0a4e76499c95757904df4e6e1e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:31.739650 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d1ad6-0536-43b6-a9c2-81d40198a2a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ef6c0a4e76499c95757904df4e6e1e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:31.745022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d1ad6-0536-43b6-a9c2-81d40198a2a5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:31.858999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-941d1ad6-0536-43b6-a9c2-81d40198a2a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ef6c0a4e76499c95757904df4e6e1e', 'request_id': 'req-941d1ad6-0536-43b6-a9c2-81d40198a2a5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:31.869788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-941d1ad6-0536-43b6-a9c2-81d40198a2a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ef6c0a4e76499c95757904df4e6e1e', 'request_id': 'req-941d1ad6-0536-43b6-a9c2-81d40198a2a5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:31.881855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-941d1ad6-0536-43b6-a9c2-81d40198a2a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ef6c0a4e76499c95757904df4e6e1e', 'request_id': 'req-941d1ad6-0536-43b6-a9c2-81d40198a2a5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:31.901555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-941d1ad6-0536-43b6-a9c2-81d40198a2a5 admin admin] The token cache is being invalidate because project 32ef6c0a4e76499c95757904df4e6e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:30:31.902333 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-941d1ad6-0536-43b6-a9c2-81d40198a2a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:31.903394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-941d1ad6-0536-43b6-a9c2-81d40198a2a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:31.905258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1161/2309] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:30:31 2022] DELETE /identity/v3/projects/32ef6c0a4e76499c95757904df4e6e1e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:31.911241 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebb012-8e34-4287-b3d7-c443611f9c30 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:31.911737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebb012-8e34-4287-b3d7-c443611f9c30 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:31.912274 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebb012-8e34-4287-b3d7-c443611f9c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:31.952511 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-48ebb012-8e34-4287-b3d7-c443611f9c30 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:31.956501 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-48ebb012-8e34-4287-b3d7-c443611f9c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:32.015760 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:32.073442 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1149/2310] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:32.082468 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa6fe0-a24a-42ea-874e-553bc0432cdc None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:32.083273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa6fe0-a24a-42ea-874e-553bc0432cdc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:32.084509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa6fe0-a24a-42ea-874e-553bc0432cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:32.111957 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-34aa6fe0-a24a-42ea-874e-553bc0432cdc None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:32.113336 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-34aa6fe0-a24a-42ea-874e-553bc0432cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:32.124360 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1162/2311] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:32.128859 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebb012-8e34-4287-b3d7-c443611f9c30 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:32.152796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebb012-8e34-4287-b3d7-c443611f9c30 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:32.160859 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144b0d1-6912-44a2-8c0a-39457703919c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:32.161838 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144b0d1-6912-44a2-8c0a-39457703919c admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:32.162184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144b0d1-6912-44a2-8c0a-39457703919c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:32.162515 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144b0d1-6912-44a2-8c0a-39457703919c admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:32.163431 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144b0d1-6912-44a2-8c0a-39457703919c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:30:32.163944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144b0d1-6912-44a2-8c0a-39457703919c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:32.165859 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144b0d1-6912-44a2-8c0a-39457703919c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:32.179143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1150/2312] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:30:32.184124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa6fe0-a24a-42ea-874e-553bc0432cdc None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:32.200932 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa6fe0-a24a-42ea-874e-553bc0432cdc None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:32.208261 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a284030-9c4d-4ab7-bd7f-3c8ff7be9f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:32.208972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a284030-9c4d-4ab7-bd7f-3c8ff7be9f3f admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:32.209253 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a284030-9c4d-4ab7-bd7f-3c8ff7be9f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:32.209524 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a284030-9c4d-4ab7-bd7f-3c8ff7be9f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:32.210492 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a284030-9c4d-4ab7-bd7f-3c8ff7be9f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:32.212145 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a284030-9c4d-4ab7-bd7f-3c8ff7be9f3f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:32.229588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:32.249604 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1163/2313] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:30:32 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:30:32.254155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144b0d1-6912-44a2-8c0a-39457703919c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:32.267754 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144b0d1-6912-44a2-8c0a-39457703919c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:32.366364 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9845b-01d0-4ef4-93fc-72f68e2c3ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:32.367054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9845b-01d0-4ef4-93fc-72f68e2c3ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:32.367537 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9845b-01d0-4ef4-93fc-72f68e2c3ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:32.367839 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9845b-01d0-4ef4-93fc-72f68e2c3ebe admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:32.368792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9845b-01d0-4ef4-93fc-72f68e2c3ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:32.370851 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9845b-01d0-4ef4-93fc-72f68e2c3ebe admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:32.401896 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1151/2314] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:30:32 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:30:32.405741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a284030-9c4d-4ab7-bd7f-3c8ff7be9f3f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:32.422089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a284030-9c4d-4ab7-bd7f-3c8ff7be9f3f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:32.432581 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce314d1-2a3e-40aa-b4e3-2f87e3754d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:32.433063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce314d1-2a3e-40aa-b4e3-2f87e3754d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:32.433393 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce314d1-2a3e-40aa-b4e3-2f87e3754d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:32.433763 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce314d1-2a3e-40aa-b4e3-2f87e3754d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:32.434685 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce314d1-2a3e-40aa-b4e3-2f87e3754d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:32.436460 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce314d1-2a3e-40aa-b4e3-2f87e3754d2e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:32.453687 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1164/2315] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:30:32.454440 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9845b-01d0-4ef4-93fc-72f68e2c3ebe admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:32.465864 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9845b-01d0-4ef4-93fc-72f68e2c3ebe admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:32.471435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cf4b8-a6f7-4aa4-9721-1c315472d24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:32.472195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cf4b8-a6f7-4aa4-9721-1c315472d24b admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:32.472606 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cf4b8-a6f7-4aa4-9721-1c315472d24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:32.473041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cf4b8-a6f7-4aa4-9721-1c315472d24b admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:32.473962 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cf4b8-a6f7-4aa4-9721-1c315472d24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:32.475582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cf4b8-a6f7-4aa4-9721-1c315472d24b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:32.486566 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1152/2316] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:30:32.490876 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce314d1-2a3e-40aa-b4e3-2f87e3754d2e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:32.501894 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce314d1-2a3e-40aa-b4e3-2f87e3754d2e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:32.506815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab0c87-31bb-4e15-a265-7032a65dc7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:32.507710 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0c87-31bb-4e15-a265-7032a65dc7b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:32.507984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0c87-31bb-4e15-a265-7032a65dc7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:32.508252 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0c87-31bb-4e15-a265-7032a65dc7b9 admin admin] PATH_INFO: `/v3/projects/66410346533041ab8396a40e0fc5fa2c/users/e82f1cbaa8d14b20b22f709ec10be9fa/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:32.523856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab0c87-31bb-4e15-a265-7032a65dc7b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66410346533041ab8396a40e0fc5fa2c, user_id=e82f1cbaa8d14b20b22f709ec10be9fa, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:32.526617 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab0c87-31bb-4e15-a265-7032a65dc7b9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:32.542862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1165/2317] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:30:32 2022] PUT /identity/v3/projects/66410346533041ab8396a40e0fc5fa2c/users/e82f1cbaa8d14b20b22f709ec10be9fa/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:32.553238 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f80c45-bd21-4e58-a7d6-25683ac783ff None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:32.553518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f80c45-bd21-4e58-a7d6-25683ac783ff None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:32.553788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f80c45-bd21-4e58-a7d6-25683ac783ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:32.583998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-88f80c45-bd21-4e58-a7d6-25683ac783ff None None] MFA Rules not processed for user `e82f1cbaa8d14b20b22f709ec10be9fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:32.585394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-88f80c45-bd21-4e58-a7d6-25683ac783ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:32.657102 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1153/2318] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:32.670079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab0c87-31bb-4e15-a265-7032a65dc7b9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:32.672152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-82ab0c87-31bb-4e15-a265-7032a65dc7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:32.738911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab0c87-31bb-4e15-a265-7032a65dc7b9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:32.743622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4a01c-9bb6-42eb-830b-b95acd60c765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:32.744316 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4a01c-9bb6-42eb-830b-b95acd60c765 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:32.744631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4a01c-9bb6-42eb-830b-b95acd60c765 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:32.744902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4a01c-9bb6-42eb-830b-b95acd60c765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:32.754136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4a01c-9bb6-42eb-830b-b95acd60c765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:32.755674 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4a01c-9bb6-42eb-830b-b95acd60c765 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:32.769447 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1166/2319] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:30:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:30:36.017621 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218387c-e7ec-4080-bb84-b660fd400cc7 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:36.018161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218387c-e7ec-4080-bb84-b660fd400cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:36.018161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218387c-e7ec-4080-bb84-b660fd400cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:36.038059 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3218387c-e7ec-4080-bb84-b660fd400cc7 None None] MFA Rules not processed for user `6e67edcef8454b3fa4565fea949f1781`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:36.039337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3218387c-e7ec-4080-bb84-b660fd400cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:36.058541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:36.114458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1154/2320] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:36.623633 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4a01c-9bb6-42eb-830b-b95acd60c765 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:36.842153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4a01c-9bb6-42eb-830b-b95acd60c765 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:36.852496 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea5258-e741-4251-a6f3-6350f5b9d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:36.853627 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea5258-e741-4251-a6f3-6350f5b9d6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:36.854129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea5258-e741-4251-a6f3-6350f5b9d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:36.854664 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea5258-e741-4251-a6f3-6350f5b9d6aa admin admin] PATH_INFO: `/v3/users/e82f1cbaa8d14b20b22f709ec10be9fa` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:36.856968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea5258-e741-4251-a6f3-6350f5b9d6aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e82f1cbaa8d14b20b22f709ec10be9fa)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:36.859194 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea5258-e741-4251-a6f3-6350f5b9d6aa admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:36.950635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-47ea5258-e741-4251-a6f3-6350f5b9d6aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e82f1cbaa8d14b20b22f709ec10be9fa'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:36.968379 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-47ea5258-e741-4251-a6f3-6350f5b9d6aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e82f1cbaa8d14b20b22f709ec10be9fa'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:36.980331 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:36.985941 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-47ea5258-e741-4251-a6f3-6350f5b9d6aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e82f1cbaa8d14b20b22f709ec10be9fa'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:36.987243 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-47ea5258-e741-4251-a6f3-6350f5b9d6aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e82f1cbaa8d14b20b22f709ec10be9fa'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:37.010928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-47ea5258-e741-4251-a6f3-6350f5b9d6aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e82f1cbaa8d14b20b22f709ec10be9fa'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:37.017832 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1167/2321] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:30:36 2022] DELETE /identity/v3/users/e82f1cbaa8d14b20b22f709ec10be9fa => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:37.023671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72b564-c575-4f58-a906-59fe0bb834fe None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:37.024737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72b564-c575-4f58-a906-59fe0bb834fe None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:37.025011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72b564-c575-4f58-a906-59fe0bb834fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:37.069350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-be72b564-c575-4f58-a906-59fe0bb834fe None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:37.070857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-be72b564-c575-4f58-a906-59fe0bb834fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:37.222001 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1155/2322] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:37.232077 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea5258-e741-4251-a6f3-6350f5b9d6aa admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:37.234605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-47ea5258-e741-4251-a6f3-6350f5b9d6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:37.305015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea5258-e741-4251-a6f3-6350f5b9d6aa admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:37.308898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74067ee-b3fe-44c5-8ac3-823b021ddf4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:37.309624 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74067ee-b3fe-44c5-8ac3-823b021ddf4c service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:37.309879 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74067ee-b3fe-44c5-8ac3-823b021ddf4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:37.310150 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74067ee-b3fe-44c5-8ac3-823b021ddf4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:37.324471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74067ee-b3fe-44c5-8ac3-823b021ddf4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:37.326284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74067ee-b3fe-44c5-8ac3-823b021ddf4c service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:37.339184 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1168/2323] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:30:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:30:37.722045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72b564-c575-4f58-a906-59fe0bb834fe None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:37.723619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-be72b564-c575-4f58-a906-59fe0bb834fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:37.736303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72b564-c575-4f58-a906-59fe0bb834fe None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:37.749339 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40073484-5b21-489b-ab03-cb6618f07071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:37.752399 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40073484-5b21-489b-ab03-cb6618f07071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:37.752399 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40073484-5b21-489b-ab03-cb6618f07071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:37.752399 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40073484-5b21-489b-ab03-cb6618f07071 admin admin] PATH_INFO: `/v3/projects/66410346533041ab8396a40e0fc5fa2c` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:37.753993 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40073484-5b21-489b-ab03-cb6618f07071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66410346533041ab8396a40e0fc5fa2c)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:37.757003 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40073484-5b21-489b-ab03-cb6618f07071 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:37.809621 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74067ee-b3fe-44c5-8ac3-823b021ddf4c service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:37.811559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d74067ee-b3fe-44c5-8ac3-823b021ddf4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:37.824429 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-40073484-5b21-489b-ab03-cb6618f07071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66410346533041ab8396a40e0fc5fa2c', 'request_id': 'req-40073484-5b21-489b-ab03-cb6618f07071'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:37.825180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74067ee-b3fe-44c5-8ac3-823b021ddf4c service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:37.833456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-40073484-5b21-489b-ab03-cb6618f07071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66410346533041ab8396a40e0fc5fa2c', 'request_id': 'req-40073484-5b21-489b-ab03-cb6618f07071'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:37.841419 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-40073484-5b21-489b-ab03-cb6618f07071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66410346533041ab8396a40e0fc5fa2c', 'request_id': 'req-40073484-5b21-489b-ab03-cb6618f07071'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:37.853782 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-40073484-5b21-489b-ab03-cb6618f07071 admin admin] The token cache is being invalidate because project 66410346533041ab8396a40e0fc5fa2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:30:37.854069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-40073484-5b21-489b-ab03-cb6618f07071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:37.854748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-40073484-5b21-489b-ab03-cb6618f07071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:37.856333 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1156/2324] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:30:37 2022] DELETE /identity/v3/projects/66410346533041ab8396a40e0fc5fa2c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:37.862776 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0990b45-46e6-4834-8005-12288ae32114 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:37.862776 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0990b45-46e6-4834-8005-12288ae32114 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:37.862776 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0990b45-46e6-4834-8005-12288ae32114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:37.885347 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-b0990b45-46e6-4834-8005-12288ae32114 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:37.886720 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b0990b45-46e6-4834-8005-12288ae32114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:37.905236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d96be-a4e5-4eea-a417-1e4aa289ae1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:37.906030 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d96be-a4e5-4eea-a417-1e4aa289ae1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:37.906303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d96be-a4e5-4eea-a417-1e4aa289ae1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:37.906570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d96be-a4e5-4eea-a417-1e4aa289ae1b admin admin] PATH_INFO: `/v3/users/80c975dcb83743aeadbd2407858e92b1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:37.923007 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d96be-a4e5-4eea-a417-1e4aa289ae1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c975dcb83743aeadbd2407858e92b1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:37.925135 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d96be-a4e5-4eea-a417-1e4aa289ae1b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:37.956629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:37.990580 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1157/2325] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:37.992590 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd7816-0a7f-40b4-a081-3fb3d57fb8ba None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:37.992966 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd7816-0a7f-40b4-a081-3fb3d57fb8ba None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:37.993390 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd7816-0a7f-40b4-a081-3fb3d57fb8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:38.018696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-57bd7816-0a7f-40b4-a081-3fb3d57fb8ba None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:38.020109 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-57bd7816-0a7f-40b4-a081-3fb3d57fb8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:38.029065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1158/2326] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:38.032919 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd7816-0a7f-40b4-a081-3fb3d57fb8ba None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:38.040737 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-da0d96be-a4e5-4eea-a417-1e4aa289ae1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c975dcb83743aeadbd2407858e92b1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:38.045322 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd7816-0a7f-40b4-a081-3fb3d57fb8ba None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:38.052737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357baeb-8c2f-4736-a299-6c4993b35c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:38.054170 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357baeb-8c2f-4736-a299-6c4993b35c42 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:38.054462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357baeb-8c2f-4736-a299-6c4993b35c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:38.054754 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357baeb-8c2f-4736-a299-6c4993b35c42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:38.055644 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357baeb-8c2f-4736-a299-6c4993b35c42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:30:38.056237 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357baeb-8c2f-4736-a299-6c4993b35c42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:38.057081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-da0d96be-a4e5-4eea-a417-1e4aa289ae1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c975dcb83743aeadbd2407858e92b1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:38.058313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357baeb-8c2f-4736-a299-6c4993b35c42 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:38.065963 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-da0d96be-a4e5-4eea-a417-1e4aa289ae1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c975dcb83743aeadbd2407858e92b1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:38.067224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-da0d96be-a4e5-4eea-a417-1e4aa289ae1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c975dcb83743aeadbd2407858e92b1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:38.077805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1159/2327] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:30:38.079010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357baeb-8c2f-4736-a299-6c4993b35c42 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:38.081118 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c357baeb-8c2f-4736-a299-6c4993b35c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:38.083781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-da0d96be-a4e5-4eea-a417-1e4aa289ae1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c975dcb83743aeadbd2407858e92b1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:38.086481 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:38.096130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1169/2328] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:30:37 2022] DELETE /identity/v3/users/80c975dcb83743aeadbd2407858e92b1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:30:38.097820 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a0ff4-fdc6-44c6-ba42-4afa106b02de None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:38.098286 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a0ff4-fdc6-44c6-ba42-4afa106b02de None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:38.098729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a0ff4-fdc6-44c6-ba42-4afa106b02de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:38.101812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357baeb-8c2f-4736-a299-6c4993b35c42 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:38.125802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-703a0ff4-fdc6-44c6-ba42-4afa106b02de None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:38.129235 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-703a0ff4-fdc6-44c6-ba42-4afa106b02de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:38.220054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a62fc3-1cbe-45c4-9094-7782a07be89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:38.220839 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a62fc3-1cbe-45c4-9094-7782a07be89e admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:38.221289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a62fc3-1cbe-45c4-9094-7782a07be89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:38.222222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a62fc3-1cbe-45c4-9094-7782a07be89e admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:38.223486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a62fc3-1cbe-45c4-9094-7782a07be89e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:38.233516 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a62fc3-1cbe-45c4-9094-7782a07be89e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:38.270598 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1170/2329] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:38.273584 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1160/2330] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:30:38 2022] POST /identity/v3/projects => generated 391 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:30:38.277432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a0ff4-fdc6-44c6-ba42-4afa106b02de None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:38.312473 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a0ff4-fdc6-44c6-ba42-4afa106b02de None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:38.318116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a62fc3-1cbe-45c4-9094-7782a07be89e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:38.323798 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-17a62fc3-1cbe-45c4-9094-7782a07be89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:38.390213 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a62fc3-1cbe-45c4-9094-7782a07be89e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:38.391596 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adf888-7bd2-4139-b882-d4e9bcffc72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:38.392493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adf888-7bd2-4139-b882-d4e9bcffc72d admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:38.392817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adf888-7bd2-4139-b882-d4e9bcffc72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:38.393191 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adf888-7bd2-4139-b882-d4e9bcffc72d admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:38.393942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adf888-7bd2-4139-b882-d4e9bcffc72d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:38.394063 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005dade-1059-4f47-b0a9-98b93f83f387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:38.394649 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005dade-1059-4f47-b0a9-98b93f83f387 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:38.394927 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005dade-1059-4f47-b0a9-98b93f83f387 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:38.395203 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005dade-1059-4f47-b0a9-98b93f83f387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:38.396171 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adf888-7bd2-4139-b882-d4e9bcffc72d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:38.404541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005dade-1059-4f47-b0a9-98b93f83f387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:38.405992 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005dade-1059-4f47-b0a9-98b93f83f387 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:38.416548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1161/2331] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:30:38.419270 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1171/2332] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:30:38 2022] POST /identity/v3/users => generated 296 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:30:38.423306 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005dade-1059-4f47-b0a9-98b93f83f387 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:38.437135 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005dade-1059-4f47-b0a9-98b93f83f387 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:38.443959 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1777b-0e6f-4097-9500-6ed209dbc5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:38.444797 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1777b-0e6f-4097-9500-6ed209dbc5ca admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:38.445133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1777b-0e6f-4097-9500-6ed209dbc5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:38.445509 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1777b-0e6f-4097-9500-6ed209dbc5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:38.446335 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1777b-0e6f-4097-9500-6ed209dbc5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:38.448049 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1777b-0e6f-4097-9500-6ed209dbc5ca admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:38.467088 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1162/2333] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:30:38.470941 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adf888-7bd2-4139-b882-d4e9bcffc72d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:38.485527 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adf888-7bd2-4139-b882-d4e9bcffc72d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:38.494604 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f587661-709d-4b7f-85e7-c61010544548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:38.495452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f587661-709d-4b7f-85e7-c61010544548 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:38.495839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f587661-709d-4b7f-85e7-c61010544548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:38.496112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f587661-709d-4b7f-85e7-c61010544548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:38.496887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f587661-709d-4b7f-85e7-c61010544548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:38.498500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f587661-709d-4b7f-85e7-c61010544548 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:38.510658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1172/2334] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:30:38.514658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1777b-0e6f-4097-9500-6ed209dbc5ca admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:38.525628 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1777b-0e6f-4097-9500-6ed209dbc5ca admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:38.530366 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def10518-cbc4-4b72-83f7-205eaad614f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:38.531300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def10518-cbc4-4b72-83f7-205eaad614f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:38.531516 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def10518-cbc4-4b72-83f7-205eaad614f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:38.531861 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def10518-cbc4-4b72-83f7-205eaad614f6 admin admin] PATH_INFO: `/v3/projects/9be35231414d490a81c091e03e0008ba/users/644de76699ea4a78a4da11bf27b832c1/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:38.547576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def10518-cbc4-4b72-83f7-205eaad614f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be35231414d490a81c091e03e0008ba, user_id=644de76699ea4a78a4da11bf27b832c1, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:38.550479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def10518-cbc4-4b72-83f7-205eaad614f6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:38.565722 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1163/2335] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:30:38 2022] PUT /identity/v3/projects/9be35231414d490a81c091e03e0008ba/users/644de76699ea4a78a4da11bf27b832c1/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:38.577047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78395388-33bb-455a-a40e-43e930911b14 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:38.577399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78395388-33bb-455a-a40e-43e930911b14 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:38.577729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78395388-33bb-455a-a40e-43e930911b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:38.628468 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-78395388-33bb-455a-a40e-43e930911b14 None None] MFA Rules not processed for user `644de76699ea4a78a4da11bf27b832c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:38.629730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-78395388-33bb-455a-a40e-43e930911b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:38.719000 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1173/2336] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:38.725931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def10518-cbc4-4b72-83f7-205eaad614f6 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:38.729023 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-def10518-cbc4-4b72-83f7-205eaad614f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:38.748382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78395388-33bb-455a-a40e-43e930911b14 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:38.753699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-78395388-33bb-455a-a40e-43e930911b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:38.777558 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:38.801567 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:38.853150 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78395388-33bb-455a-a40e-43e930911b14 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:38.853851 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def10518-cbc4-4b72-83f7-205eaad614f6 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:38.858245 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2a81a-72cf-421f-80d2-c2a049a88542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:38.858419 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92323ea-5775-4d59-857e-e6949632807e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:38.858954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92323ea-5775-4d59-857e-e6949632807e service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:38.859131 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2a81a-72cf-421f-80d2-c2a049a88542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:38.859233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92323ea-5775-4d59-857e-e6949632807e service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:38.859414 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2a81a-72cf-421f-80d2-c2a049a88542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:38.859515 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92323ea-5775-4d59-857e-e6949632807e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:38.859681 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2a81a-72cf-421f-80d2-c2a049a88542 admin admin] PATH_INFO: `/v3/projects/b89e0865f95a4ec6859e47d1f14abfb3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:38.861036 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2a81a-72cf-421f-80d2-c2a049a88542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b89e0865f95a4ec6859e47d1f14abfb3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:38.862970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2a81a-72cf-421f-80d2-c2a049a88542 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:38.868482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92323ea-5775-4d59-857e-e6949632807e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:38.869931 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92323ea-5775-4d59-857e-e6949632807e service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:38.879609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1164/2337] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:30:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:30:38.910944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-31a2a81a-72cf-421f-80d2-c2a049a88542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89e0865f95a4ec6859e47d1f14abfb3', 'request_id': 'req-31a2a81a-72cf-421f-80d2-c2a049a88542'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:38.919889 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-31a2a81a-72cf-421f-80d2-c2a049a88542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89e0865f95a4ec6859e47d1f14abfb3', 'request_id': 'req-31a2a81a-72cf-421f-80d2-c2a049a88542'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:38.927220 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-31a2a81a-72cf-421f-80d2-c2a049a88542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89e0865f95a4ec6859e47d1f14abfb3', 'request_id': 'req-31a2a81a-72cf-421f-80d2-c2a049a88542'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:38.938442 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-31a2a81a-72cf-421f-80d2-c2a049a88542 admin admin] The token cache is being invalidate because project b89e0865f95a4ec6859e47d1f14abfb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:30:38.938726 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-31a2a81a-72cf-421f-80d2-c2a049a88542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:38.939384 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-31a2a81a-72cf-421f-80d2-c2a049a88542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:38.941277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1174/2338] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:30:38 2022] DELETE /identity/v3/projects/b89e0865f95a4ec6859e47d1f14abfb3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:38.946266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe8d9a-d475-4e47-b64e-c53fdaa571b8 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:38.946549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe8d9a-d475-4e47-b64e-c53fdaa571b8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:38.946905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe8d9a-d475-4e47-b64e-c53fdaa571b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:38.964342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-dffe8d9a-d475-4e47-b64e-c53fdaa571b8 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:38.965515 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-dffe8d9a-d475-4e47-b64e-c53fdaa571b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:39.040220 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1165/2339] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:30:39.048223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258dc74-eb71-487c-a87b-80d78ea538be None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:39.048859 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258dc74-eb71-487c-a87b-80d78ea538be None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:39.049168 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258dc74-eb71-487c-a87b-80d78ea538be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:39.079781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0258dc74-eb71-487c-a87b-80d78ea538be None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:39.081970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0258dc74-eb71-487c-a87b-80d78ea538be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:39.091437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1175/2340] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:39.099727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe8d9a-d475-4e47-b64e-c53fdaa571b8 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:39.121877 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe8d9a-d475-4e47-b64e-c53fdaa571b8 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:39.127683 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c3b22-c17c-4d5c-bbdc-a934995eec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:39.128997 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c3b22-c17c-4d5c-bbdc-a934995eec9e admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:39.130403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c3b22-c17c-4d5c-bbdc-a934995eec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:39.130756 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c3b22-c17c-4d5c-bbdc-a934995eec9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:39.131591 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c3b22-c17c-4d5c-bbdc-a934995eec9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:30:39.133587 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c3b22-c17c-4d5c-bbdc-a934995eec9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:39.135414 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c3b22-c17c-4d5c-bbdc-a934995eec9e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:39.152252 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1166/2341] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:30:39.158065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258dc74-eb71-487c-a87b-80d78ea538be None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:39.168318 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258dc74-eb71-487c-a87b-80d78ea538be None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:39.177883 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d80be5-a862-4a4c-96bb-3789e7f7326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:39.178682 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80be5-a862-4a4c-96bb-3789e7f7326f admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:39.179057 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80be5-a862-4a4c-96bb-3789e7f7326f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:39.179735 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80be5-a862-4a4c-96bb-3789e7f7326f admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:39.180180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d80be5-a862-4a4c-96bb-3789e7f7326f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:39.182242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d80be5-a862-4a4c-96bb-3789e7f7326f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:39.226111 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1176/2342] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:30:39 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:30:39.230230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c3b22-c17c-4d5c-bbdc-a934995eec9e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:39.245697 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c3b22-c17c-4d5c-bbdc-a934995eec9e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:39.337669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95f6c8-90c5-4449-8a03-a80f0895527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:39.338369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95f6c8-90c5-4449-8a03-a80f0895527f admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:39.338648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95f6c8-90c5-4449-8a03-a80f0895527f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:39.339010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95f6c8-90c5-4449-8a03-a80f0895527f admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:39.339727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95f6c8-90c5-4449-8a03-a80f0895527f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:39.341999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95f6c8-90c5-4449-8a03-a80f0895527f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:39.372163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1167/2343] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:30:39 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:30:39.373837 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d80be5-a862-4a4c-96bb-3789e7f7326f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:39.389505 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d80be5-a862-4a4c-96bb-3789e7f7326f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:39.396689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ba98e-d5bd-4872-9896-7aae88b60161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:39.398567 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ba98e-d5bd-4872-9896-7aae88b60161 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:39.399123 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ba98e-d5bd-4872-9896-7aae88b60161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:39.399470 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ba98e-d5bd-4872-9896-7aae88b60161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:39.400382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ba98e-d5bd-4872-9896-7aae88b60161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:39.402487 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ba98e-d5bd-4872-9896-7aae88b60161 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:39.418071 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1177/2344] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:30:39.422411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95f6c8-90c5-4449-8a03-a80f0895527f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:39.434125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95f6c8-90c5-4449-8a03-a80f0895527f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:39.440037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572d111-4527-44d9-8ca7-6249e8248521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:39.440759 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572d111-4527-44d9-8ca7-6249e8248521 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:39.441138 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572d111-4527-44d9-8ca7-6249e8248521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:39.441305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572d111-4527-44d9-8ca7-6249e8248521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:39.442061 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572d111-4527-44d9-8ca7-6249e8248521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:39.443674 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572d111-4527-44d9-8ca7-6249e8248521 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:39.456045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1168/2345] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:30:39.459864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ba98e-d5bd-4872-9896-7aae88b60161 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:39.470839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ba98e-d5bd-4872-9896-7aae88b60161 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:39.475685 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f96cee-953a-4727-8a1f-e08958f6abeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:39.476620 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f96cee-953a-4727-8a1f-e08958f6abeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:39.476905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f96cee-953a-4727-8a1f-e08958f6abeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:39.477177 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f96cee-953a-4727-8a1f-e08958f6abeb admin admin] PATH_INFO: `/v3/projects/43ab217025c647d597f22b4292e4505b/users/1582f8c2bac64f8798dfdbe1c8cc95fa/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:39.492350 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f96cee-953a-4727-8a1f-e08958f6abeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ab217025c647d597f22b4292e4505b, user_id=1582f8c2bac64f8798dfdbe1c8cc95fa, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:39.495082 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f96cee-953a-4727-8a1f-e08958f6abeb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:39.513539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1178/2346] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:30:39 2022] PUT /identity/v3/projects/43ab217025c647d597f22b4292e4505b/users/1582f8c2bac64f8798dfdbe1c8cc95fa/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:39.524238 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e82920-e1f7-40ff-9a2c-fb133b24a6f9 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:39.524552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e82920-e1f7-40ff-9a2c-fb133b24a6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:39.524857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e82920-e1f7-40ff-9a2c-fb133b24a6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:39.558250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a8e82920-e1f7-40ff-9a2c-fb133b24a6f9 None None] MFA Rules not processed for user `1582f8c2bac64f8798dfdbe1c8cc95fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:39.559504 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a8e82920-e1f7-40ff-9a2c-fb133b24a6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:39.589168 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:39.648508 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1169/2347] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:39.660378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f96cee-953a-4727-8a1f-e08958f6abeb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:39.662164 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d7f96cee-953a-4727-8a1f-e08958f6abeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:39.717344 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:39.739358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f96cee-953a-4727-8a1f-e08958f6abeb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:39.743019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb4608-bf4a-485d-a168-8f9814aa6630 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:39.743702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb4608-bf4a-485d-a168-8f9814aa6630 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:39.744034 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb4608-bf4a-485d-a168-8f9814aa6630 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:39.744312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb4608-bf4a-485d-a168-8f9814aa6630 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:39.753925 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb4608-bf4a-485d-a168-8f9814aa6630 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:39.755501 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb4608-bf4a-485d-a168-8f9814aa6630 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:39.765032 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1179/2348] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:30:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:30:41.138525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4509de-677e-419a-be58-eedbee4296a3 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:41.139031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4509de-677e-419a-be58-eedbee4296a3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:41.139229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4509de-677e-419a-be58-eedbee4296a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:41.158454 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ad4509de-677e-419a-be58-eedbee4296a3 None None] MFA Rules not processed for user `1582f8c2bac64f8798dfdbe1c8cc95fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:41.159745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ad4509de-677e-419a-be58-eedbee4296a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:41.168458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1170/2349] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:46.267033 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb4608-bf4a-485d-a168-8f9814aa6630 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:46.269131 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a2bb4608-bf4a-485d-a168-8f9814aa6630 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:46.393353 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb4608-bf4a-485d-a168-8f9814aa6630 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:46.397319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50d504-92cd-46d0-82bb-380047d77901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:46.398368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50d504-92cd-46d0-82bb-380047d77901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:46.398652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50d504-92cd-46d0-82bb-380047d77901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:46.398930 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50d504-92cd-46d0-82bb-380047d77901 admin admin] PATH_INFO: `/v3/users/ff8c19cb927f4be4a91dc0324866fe35` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:46.400199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50d504-92cd-46d0-82bb-380047d77901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff8c19cb927f4be4a91dc0324866fe35)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:46.402236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50d504-92cd-46d0-82bb-380047d77901 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:46.494466 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1f50d504-92cd-46d0-82bb-380047d77901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff8c19cb927f4be4a91dc0324866fe35'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:46.510543 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1f50d504-92cd-46d0-82bb-380047d77901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff8c19cb927f4be4a91dc0324866fe35'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:46.522292 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1f50d504-92cd-46d0-82bb-380047d77901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff8c19cb927f4be4a91dc0324866fe35'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:46.525130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1f50d504-92cd-46d0-82bb-380047d77901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff8c19cb927f4be4a91dc0324866fe35'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:46.543454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1f50d504-92cd-46d0-82bb-380047d77901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff8c19cb927f4be4a91dc0324866fe35'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:46.553250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1180/2350] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:30:46 2022] DELETE /identity/v3/users/ff8c19cb927f4be4a91dc0324866fe35 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:30:46.554672 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ef57b-55d7-4546-80da-43af1ee94198 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:46.555126 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ef57b-55d7-4546-80da-43af1ee94198 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:46.555217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ef57b-55d7-4546-80da-43af1ee94198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:46.575775 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-792ef57b-55d7-4546-80da-43af1ee94198 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:46.577222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-792ef57b-55d7-4546-80da-43af1ee94198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:46.651266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1171/2351] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:46.662646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50d504-92cd-46d0-82bb-380047d77901 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:46.664286 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1f50d504-92cd-46d0-82bb-380047d77901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:46.745252 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50d504-92cd-46d0-82bb-380047d77901 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:46.749124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97df4b4-2bf9-4e96-a67f-6a7bafadedf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:46.749783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97df4b4-2bf9-4e96-a67f-6a7bafadedf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:46.750065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97df4b4-2bf9-4e96-a67f-6a7bafadedf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:46.750375 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97df4b4-2bf9-4e96-a67f-6a7bafadedf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:46.759847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97df4b4-2bf9-4e96-a67f-6a7bafadedf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:46.761308 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97df4b4-2bf9-4e96-a67f-6a7bafadedf4 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:46.766274 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:46.773783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1181/2352] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:30:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:30:47.117715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ef57b-55d7-4546-80da-43af1ee94198 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:47.119897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-792ef57b-55d7-4546-80da-43af1ee94198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:47.134143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ef57b-55d7-4546-80da-43af1ee94198 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:47.138799 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b72ce-6a97-4707-835d-19ddb22712bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:47.139736 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b72ce-6a97-4707-835d-19ddb22712bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:47.140084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b72ce-6a97-4707-835d-19ddb22712bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:47.140425 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b72ce-6a97-4707-835d-19ddb22712bb admin admin] PATH_INFO: `/v3/projects/9189d895806a497c830a2a3356983469` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:47.141747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b72ce-6a97-4707-835d-19ddb22712bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9189d895806a497c830a2a3356983469)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:47.144042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b72ce-6a97-4707-835d-19ddb22712bb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:47.194100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1a0b72ce-6a97-4707-835d-19ddb22712bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9189d895806a497c830a2a3356983469', 'request_id': 'req-1a0b72ce-6a97-4707-835d-19ddb22712bb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:47.202287 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1a0b72ce-6a97-4707-835d-19ddb22712bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9189d895806a497c830a2a3356983469', 'request_id': 'req-1a0b72ce-6a97-4707-835d-19ddb22712bb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:47.208285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1a0b72ce-6a97-4707-835d-19ddb22712bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9189d895806a497c830a2a3356983469', 'request_id': 'req-1a0b72ce-6a97-4707-835d-19ddb22712bb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:47.223691 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1a0b72ce-6a97-4707-835d-19ddb22712bb admin admin] The token cache is being invalidate because project 9189d895806a497c830a2a3356983469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:30:47.223986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1a0b72ce-6a97-4707-835d-19ddb22712bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:47.224936 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1a0b72ce-6a97-4707-835d-19ddb22712bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:47.226560 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1172/2353] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:30:47 2022] DELETE /identity/v3/projects/9189d895806a497c830a2a3356983469 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:49.413537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97df4b4-2bf9-4e96-a67f-6a7bafadedf4 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:49.415092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a97df4b4-2bf9-4e96-a67f-6a7bafadedf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:49.428305 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97df4b4-2bf9-4e96-a67f-6a7bafadedf4 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:49.497140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1402dd-d71f-4b0d-a785-25b1ed3be0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:49.498011 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1402dd-d71f-4b0d-a785-25b1ed3be0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:49.498316 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1402dd-d71f-4b0d-a785-25b1ed3be0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:49.498585 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1402dd-d71f-4b0d-a785-25b1ed3be0ff admin admin] PATH_INFO: `/v3/users/644de76699ea4a78a4da11bf27b832c1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:49.499885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1402dd-d71f-4b0d-a785-25b1ed3be0ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=644de76699ea4a78a4da11bf27b832c1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:49.501912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1402dd-d71f-4b0d-a785-25b1ed3be0ff admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:49.547861 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fb1402dd-d71f-4b0d-a785-25b1ed3be0ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '644de76699ea4a78a4da11bf27b832c1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:49.555185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fb1402dd-d71f-4b0d-a785-25b1ed3be0ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '644de76699ea4a78a4da11bf27b832c1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:49.562010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fb1402dd-d71f-4b0d-a785-25b1ed3be0ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '644de76699ea4a78a4da11bf27b832c1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:49.562627 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fb1402dd-d71f-4b0d-a785-25b1ed3be0ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '644de76699ea4a78a4da11bf27b832c1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:49.574771 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fb1402dd-d71f-4b0d-a785-25b1ed3be0ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '644de76699ea4a78a4da11bf27b832c1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:49.581404 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1182/2354] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:30:49 2022] DELETE /identity/v3/users/644de76699ea4a78a4da11bf27b832c1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:49.586028 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3b5e3-bd0c-4fbe-b604-1fe6d9ee93b3 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:49.586512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3b5e3-bd0c-4fbe-b604-1fe6d9ee93b3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:49.586665 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3b5e3-bd0c-4fbe-b604-1fe6d9ee93b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:49.605719 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e3f3b5e3-bd0c-4fbe-b604-1fe6d9ee93b3 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:49.606938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e3f3b5e3-bd0c-4fbe-b604-1fe6d9ee93b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:49.641354 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:49.675724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1173/2355] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:49.685499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1402dd-d71f-4b0d-a785-25b1ed3be0ff admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:49.687180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fb1402dd-d71f-4b0d-a785-25b1ed3be0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:49.746772 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1402dd-d71f-4b0d-a785-25b1ed3be0ff admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:49.750965 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1382b18-cf1e-4aa2-af3a-61a710a6bfe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:49.751601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1382b18-cf1e-4aa2-af3a-61a710a6bfe0 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:49.751879 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1382b18-cf1e-4aa2-af3a-61a710a6bfe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:49.752148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1382b18-cf1e-4aa2-af3a-61a710a6bfe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:49.762767 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1382b18-cf1e-4aa2-af3a-61a710a6bfe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:49.764194 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1382b18-cf1e-4aa2-af3a-61a710a6bfe0 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:49.774286 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1183/2356] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:30:50.056783 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3b5e3-bd0c-4fbe-b604-1fe6d9ee93b3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:50.058350 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e3f3b5e3-bd0c-4fbe-b604-1fe6d9ee93b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:50.073473 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3b5e3-bd0c-4fbe-b604-1fe6d9ee93b3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:50.079434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7621d6c-3cc7-4ec4-963e-67367f638cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:50.080320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7621d6c-3cc7-4ec4-963e-67367f638cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:50.080632 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7621d6c-3cc7-4ec4-963e-67367f638cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:50.080906 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7621d6c-3cc7-4ec4-963e-67367f638cb7 admin admin] PATH_INFO: `/v3/projects/9be35231414d490a81c091e03e0008ba` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:50.082183 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7621d6c-3cc7-4ec4-963e-67367f638cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be35231414d490a81c091e03e0008ba)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:50.084071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7621d6c-3cc7-4ec4-963e-67367f638cb7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:50.134213 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b7621d6c-3cc7-4ec4-963e-67367f638cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be35231414d490a81c091e03e0008ba', 'request_id': 'req-b7621d6c-3cc7-4ec4-963e-67367f638cb7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:50.142569 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b7621d6c-3cc7-4ec4-963e-67367f638cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be35231414d490a81c091e03e0008ba', 'request_id': 'req-b7621d6c-3cc7-4ec4-963e-67367f638cb7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:50.147940 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b7621d6c-3cc7-4ec4-963e-67367f638cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be35231414d490a81c091e03e0008ba', 'request_id': 'req-b7621d6c-3cc7-4ec4-963e-67367f638cb7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:50.159348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b7621d6c-3cc7-4ec4-963e-67367f638cb7 admin admin] The token cache is being invalidate because project 9be35231414d490a81c091e03e0008ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:30:50.159634 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b7621d6c-3cc7-4ec4-963e-67367f638cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:50.160367 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b7621d6c-3cc7-4ec4-963e-67367f638cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:30:50.162000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1174/2357] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:30:50 2022] DELETE /identity/v3/projects/9be35231414d490a81c091e03e0008ba => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:50.167196 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a0e16-df58-404c-b6fd-a866c2d5d743 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:50.167481 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a0e16-df58-404c-b6fd-a866c2d5d743 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:50.167757 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a0e16-df58-404c-b6fd-a866c2d5d743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:50.185269 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-082a0e16-df58-404c-b6fd-a866c2d5d743 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:50.186459 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-082a0e16-df58-404c-b6fd-a866c2d5d743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:50.205307 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:50.251815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1184/2358] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:50.259778 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37481e5-f75d-46a4-ac5f-6c556c6de0ec None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:50.260060 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37481e5-f75d-46a4-ac5f-6c556c6de0ec None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:50.260331 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37481e5-f75d-46a4-ac5f-6c556c6de0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:50.279849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c37481e5-f75d-46a4-ac5f-6c556c6de0ec None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:50.281084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c37481e5-f75d-46a4-ac5f-6c556c6de0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:50.290826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1175/2359] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:50.295095 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a0e16-df58-404c-b6fd-a866c2d5d743 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:50.305646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a0e16-df58-404c-b6fd-a866c2d5d743 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:50.311419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab784618-ff32-47aa-8d6f-59e82bdaa1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:50.312070 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab784618-ff32-47aa-8d6f-59e82bdaa1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:50.312346 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab784618-ff32-47aa-8d6f-59e82bdaa1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:50.312650 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab784618-ff32-47aa-8d6f-59e82bdaa1e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:50.313443 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab784618-ff32-47aa-8d6f-59e82bdaa1e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:30:50.313745 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab784618-ff32-47aa-8d6f-59e82bdaa1e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:50.315344 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab784618-ff32-47aa-8d6f-59e82bdaa1e6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:50.327673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1185/2360] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:30:50.332162 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37481e5-f75d-46a4-ac5f-6c556c6de0ec None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:50.341904 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37481e5-f75d-46a4-ac5f-6c556c6de0ec None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:50.348848 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76186493-30df-47f9-a901-e3a286fa9e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:50.349754 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76186493-30df-47f9-a901-e3a286fa9e6e admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:50.350087 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76186493-30df-47f9-a901-e3a286fa9e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:50.350361 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76186493-30df-47f9-a901-e3a286fa9e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:50.351262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76186493-30df-47f9-a901-e3a286fa9e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:50.353439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76186493-30df-47f9-a901-e3a286fa9e6e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:50.383106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1176/2361] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:30:50 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:30:50.387270 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab784618-ff32-47aa-8d6f-59e82bdaa1e6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:50.398192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab784618-ff32-47aa-8d6f-59e82bdaa1e6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:50.489861 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288472f-7ee5-4227-8e82-fac05cf736ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:50.490532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288472f-7ee5-4227-8e82-fac05cf736ef admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:50.491320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288472f-7ee5-4227-8e82-fac05cf736ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:50.491681 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288472f-7ee5-4227-8e82-fac05cf736ef admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:50.492639 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288472f-7ee5-4227-8e82-fac05cf736ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:50.494651 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288472f-7ee5-4227-8e82-fac05cf736ef admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:50.523893 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1186/2362] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:30:50 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:30:50.527687 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76186493-30df-47f9-a901-e3a286fa9e6e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:50.542487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76186493-30df-47f9-a901-e3a286fa9e6e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:50.547540 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb2d20-8bff-4a31-9bd8-4394120c0ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:50.548210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb2d20-8bff-4a31-9bd8-4394120c0ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:50.548567 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb2d20-8bff-4a31-9bd8-4394120c0ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:50.548848 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb2d20-8bff-4a31-9bd8-4394120c0ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:50.549754 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb2d20-8bff-4a31-9bd8-4394120c0ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:50.553061 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb2d20-8bff-4a31-9bd8-4394120c0ea9 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:50.568649 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1177/2363] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:30:50.570214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288472f-7ee5-4227-8e82-fac05cf736ef admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:50.586396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288472f-7ee5-4227-8e82-fac05cf736ef admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:50.596303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105e128-2c29-4a0b-89b5-ad8617db837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:50.597247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105e128-2c29-4a0b-89b5-ad8617db837d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:50.597720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105e128-2c29-4a0b-89b5-ad8617db837d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:50.598167 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105e128-2c29-4a0b-89b5-ad8617db837d admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:50.599082 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105e128-2c29-4a0b-89b5-ad8617db837d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:50.600983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105e128-2c29-4a0b-89b5-ad8617db837d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:50.616976 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1187/2364] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:30:50.617647 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb2d20-8bff-4a31-9bd8-4394120c0ea9 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:50.637708 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb2d20-8bff-4a31-9bd8-4394120c0ea9 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:50.644310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578f6cf-683a-41bd-8fa0-ba92007b89f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:50.645349 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578f6cf-683a-41bd-8fa0-ba92007b89f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:50.645627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578f6cf-683a-41bd-8fa0-ba92007b89f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:50.645897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578f6cf-683a-41bd-8fa0-ba92007b89f7 admin admin] PATH_INFO: `/v3/projects/621712fccf02439cbe3265bdafc1680c/users/33fd711472d643628d1f9961247e5ef6/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:50.662736 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578f6cf-683a-41bd-8fa0-ba92007b89f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=621712fccf02439cbe3265bdafc1680c, user_id=33fd711472d643628d1f9961247e5ef6, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:50.666511 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578f6cf-683a-41bd-8fa0-ba92007b89f7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:50.686273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1178/2365] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:30:50 2022] PUT /identity/v3/projects/621712fccf02439cbe3265bdafc1680c/users/33fd711472d643628d1f9961247e5ef6/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:50.691738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec51a3-2b02-4a42-a945-8c3a956ccee1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:50.692027 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec51a3-2b02-4a42-a945-8c3a956ccee1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:50.692337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec51a3-2b02-4a42-a945-8c3a956ccee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:50.712242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-06ec51a3-2b02-4a42-a945-8c3a956ccee1 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:50.713498 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-06ec51a3-2b02-4a42-a945-8c3a956ccee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:50.776982 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1188/2366] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:50.786726 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578f6cf-683a-41bd-8fa0-ba92007b89f7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:50.788510 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d578f6cf-683a-41bd-8fa0-ba92007b89f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:50.848963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578f6cf-683a-41bd-8fa0-ba92007b89f7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:50.852594 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e629be-27de-4e99-9c23-e5df4fe565ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:50.853243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e629be-27de-4e99-9c23-e5df4fe565ab service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:50.853518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e629be-27de-4e99-9c23-e5df4fe565ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:50.853789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e629be-27de-4e99-9c23-e5df4fe565ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:50.862536 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e629be-27de-4e99-9c23-e5df4fe565ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:50.863958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e629be-27de-4e99-9c23-e5df4fe565ab service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:50.868847 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:50.879809 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1179/2367] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:30:55.339137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea593b-1656-4379-bfc5-97f210589152 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:55.339592 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea593b-1656-4379-bfc5-97f210589152 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:55.339670 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea593b-1656-4379-bfc5-97f210589152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:55.389729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-71ea593b-1656-4379-bfc5-97f210589152 None None] MFA Rules not processed for user `33fd711472d643628d1f9961247e5ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:30:55.391195 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-71ea593b-1656-4379-bfc5-97f210589152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:30:55.410782 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:30:55.472819 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1189/2368] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:30:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:30:55.476393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e629be-27de-4e99-9c23-e5df4fe565ab service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:55.497883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e629be-27de-4e99-9c23-e5df4fe565ab service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:55.505889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42561521-c8c9-4365-b075-16b0e810cbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:55.506561 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42561521-c8c9-4365-b075-16b0e810cbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:55.506890 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42561521-c8c9-4365-b075-16b0e810cbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:55.507107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42561521-c8c9-4365-b075-16b0e810cbc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:55.507816 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42561521-c8c9-4365-b075-16b0e810cbc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:55.509953 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42561521-c8c9-4365-b075-16b0e810cbc5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:55.544654 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1180/2369] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:30:55 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:30:55.546949 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea593b-1656-4379-bfc5-97f210589152 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:55.558576 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea593b-1656-4379-bfc5-97f210589152 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:55.635106 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94dafd-ece7-400e-97ac-d9c56a6bbf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:55.635887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94dafd-ece7-400e-97ac-d9c56a6bbf96 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:55.636214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94dafd-ece7-400e-97ac-d9c56a6bbf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:55.636587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94dafd-ece7-400e-97ac-d9c56a6bbf96 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:55.637352 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94dafd-ece7-400e-97ac-d9c56a6bbf96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:55.639563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94dafd-ece7-400e-97ac-d9c56a6bbf96 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:55.665192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1190/2370] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:30:55 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:30:55.669256 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42561521-c8c9-4365-b075-16b0e810cbc5 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:55.685997 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42561521-c8c9-4365-b075-16b0e810cbc5 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:55.690728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f680a-007e-485d-afcb-e7124e352f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:55.691404 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f680a-007e-485d-afcb-e7124e352f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:55.691687 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f680a-007e-485d-afcb-e7124e352f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:55.691960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f680a-007e-485d-afcb-e7124e352f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:55.692735 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f680a-007e-485d-afcb-e7124e352f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:55.694509 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f680a-007e-485d-afcb-e7124e352f0c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:55.709177 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1181/2371] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:30:55.713498 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94dafd-ece7-400e-97ac-d9c56a6bbf96 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:55.727615 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94dafd-ece7-400e-97ac-d9c56a6bbf96 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:55.730726 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86b9e9-8d08-4c17-aef7-abe99d618a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:55.731687 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86b9e9-8d08-4c17-aef7-abe99d618a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:55.732031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86b9e9-8d08-4c17-aef7-abe99d618a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:55.732366 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86b9e9-8d08-4c17-aef7-abe99d618a27 admin admin] PATH_INFO: `/v3/projects/0d6972c4589e49d4b23dcbbef8fa8a91/users/038f355798144d31ac5c211364ff8c62/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:55.751152 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86b9e9-8d08-4c17-aef7-abe99d618a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6972c4589e49d4b23dcbbef8fa8a91, user_id=038f355798144d31ac5c211364ff8c62, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:55.754055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86b9e9-8d08-4c17-aef7-abe99d618a27 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:55.770624 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1191/2372] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:30:55 2022] PUT /identity/v3/projects/0d6972c4589e49d4b23dcbbef8fa8a91/users/038f355798144d31ac5c211364ff8c62/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:30:55.774636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f680a-007e-485d-afcb-e7124e352f0c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:55.790592 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f680a-007e-485d-afcb-e7124e352f0c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:55.884680 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f425aa-162a-443f-b8c0-55c61f5d3217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:55.885462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f425aa-162a-443f-b8c0-55c61f5d3217 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:55.885799 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f425aa-162a-443f-b8c0-55c61f5d3217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:55.886176 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f425aa-162a-443f-b8c0-55c61f5d3217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:55.886996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f425aa-162a-443f-b8c0-55c61f5d3217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:55.888703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f425aa-162a-443f-b8c0-55c61f5d3217 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:55.900069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1182/2373] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:30:55.904219 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86b9e9-8d08-4c17-aef7-abe99d618a27 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:30:55.917778 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86b9e9-8d08-4c17-aef7-abe99d618a27 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:30:55.923718 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c48a7c-98e4-45ab-a177-772f308a549f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:30:55.925387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c48a7c-98e4-45ab-a177-772f308a549f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:30:55.925741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c48a7c-98e4-45ab-a177-772f308a549f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:30:55.926092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c48a7c-98e4-45ab-a177-772f308a549f admin admin] PATH_INFO: `/v3/projects/0d6972c4589e49d4b23dcbbef8fa8a91/users/038f355798144d31ac5c211364ff8c62/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:30:55.928129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c48a7c-98e4-45ab-a177-772f308a549f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6972c4589e49d4b23dcbbef8fa8a91, user_id=038f355798144d31ac5c211364ff8c62, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:30:55.930846 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c48a7c-98e4-45ab-a177-772f308a549f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:30:55.943722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1192/2374] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:30:55 2022] PUT /identity/v3/projects/0d6972c4589e49d4b23dcbbef8fa8a91/users/038f355798144d31ac5c211364ff8c62/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:31:00.817755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb509f6-4292-4243-b8b2-115d8e834c06 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:00.819025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb509f6-4292-4243-b8b2-115d8e834c06 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:00.819496 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb509f6-4292-4243-b8b2-115d8e834c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:00.843381 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-bdb509f6-4292-4243-b8b2-115d8e834c06 None None] MFA Rules not processed for user `e23aea853cce44698b19d6bc087093c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:31:00.845120 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bdb509f6-4292-4243-b8b2-115d8e834c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:00.939388 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1183/2375] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 03:31:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:31:00.963956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c48a7c-98e4-45ab-a177-772f308a549f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:00.965791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c7c48a7c-98e4-45ab-a177-772f308a549f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:01.061669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c48a7c-98e4-45ab-a177-772f308a549f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:01.062883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b94796-9319-4f15-a77b-b7abf5f9730e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:01.063544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b94796-9319-4f15-a77b-b7abf5f9730e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:01.063829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b94796-9319-4f15-a77b-b7abf5f9730e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:01.067151 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042103ad-75ae-4ae0-99e5-4a0b5b9ce9e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc4cbd87dd249868cfb704535774126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:01.067791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042103ad-75ae-4ae0-99e5-4a0b5b9ce9e7 service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:01.068069 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042103ad-75ae-4ae0-99e5-4a0b5b9ce9e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:01.068336 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042103ad-75ae-4ae0-99e5-4a0b5b9ce9e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:01.079601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042103ad-75ae-4ae0-99e5-4a0b5b9ce9e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:01.081202 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042103ad-75ae-4ae0-99e5-4a0b5b9ce9e7 service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:01.086322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:31:01.090879 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1193/2376] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 03:31:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 03:31:01.098621 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-29b94796-9319-4f15-a77b-b7abf5f9730e None None] MFA Rules not processed for user `038f355798144d31ac5c211364ff8c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:31:01.099864 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-29b94796-9319-4f15-a77b-b7abf5f9730e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:01.180271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:31:01.198430 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1184/2377] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:31:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:31:01.211145 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042103ad-75ae-4ae0-99e5-4a0b5b9ce9e7 service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:01.212869 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-042103ad-75ae-4ae0-99e5-4a0b5b9ce9e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:01.295688 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042103ad-75ae-4ae0-99e5-4a0b5b9ce9e7 service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:01.300058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb5155-8aa1-4baf-8a4f-737cbded200c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97fe9d04ccb445208f3783a8b55cd31e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:01.301215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb5155-8aa1-4baf-8a4f-737cbded200c service glance] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:01.301691 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb5155-8aa1-4baf-8a4f-737cbded200c service glance] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:01.302150 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb5155-8aa1-4baf-8a4f-737cbded200c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:01.378314 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb5155-8aa1-4baf-8a4f-737cbded200c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:01.379788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb5155-8aa1-4baf-8a4f-737cbded200c service glance] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:01.389796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1194/2378] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:31:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:31:01.508651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdbff4-5f4e-4b16-b424-75bb604dcf4a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:01.509115 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdbff4-5f4e-4b16-b424-75bb604dcf4a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:01.509413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdbff4-5f4e-4b16-b424-75bb604dcf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:01.541856 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6fbdbff4-5f4e-4b16-b424-75bb604dcf4a None None] MFA Rules not processed for user `e23aea853cce44698b19d6bc087093c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:31:01.543172 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6fbdbff4-5f4e-4b16-b424-75bb604dcf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:01.558248 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1185/2379] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 03:31:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:31:01.566339 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb5155-8aa1-4baf-8a4f-737cbded200c service glance] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:01.582926 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb5155-8aa1-4baf-8a4f-737cbded200c service glance] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:01.588511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80646e9-e254-4ddf-acfd-f8228d3c1f7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc4cbd87dd249868cfb704535774126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:01.590323 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80646e9-e254-4ddf-acfd-f8228d3c1f7a service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:01.590483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80646e9-e254-4ddf-acfd-f8228d3c1f7a service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:01.590876 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80646e9-e254-4ddf-acfd-f8228d3c1f7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:01.601007 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80646e9-e254-4ddf-acfd-f8228d3c1f7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:01.602949 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80646e9-e254-4ddf-acfd-f8228d3c1f7a service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:01.615622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1195/2380] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 03:31:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 03:31:01.865785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65830960-1f99-4286-9add-01d4fc6f9a12 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:01.866267 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65830960-1f99-4286-9add-01d4fc6f9a12 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:01.866365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65830960-1f99-4286-9add-01d4fc6f9a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:01.898444 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-65830960-1f99-4286-9add-01d4fc6f9a12 None None] MFA Rules not processed for user `e23aea853cce44698b19d6bc087093c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:31:01.899678 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-65830960-1f99-4286-9add-01d4fc6f9a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:01.914905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1186/2381] 10.222.0.26 () {58 vars in 967 bytes} [Tue Jul 12 03:31:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:31:01.937694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80646e9-e254-4ddf-acfd-f8228d3c1f7a service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:01.961393 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80646e9-e254-4ddf-acfd-f8228d3c1f7a service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:01.971072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9af53-ccce-4c1c-a4e5-963e084eac99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc4cbd87dd249868cfb704535774126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:01.971899 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9af53-ccce-4c1c-a4e5-963e084eac99 service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:01.972356 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9af53-ccce-4c1c-a4e5-963e084eac99 service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:01.972700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9af53-ccce-4c1c-a4e5-963e084eac99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:01.986826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9af53-ccce-4c1c-a4e5-963e084eac99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:01.987742 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9af53-ccce-4c1c-a4e5-963e084eac99 service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:01.997841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1196/2382] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 03:31:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 03:31:02.303540 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a0e42-53fc-461a-937d-7bb9773e8741 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:02.303829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a0e42-53fc-461a-937d-7bb9773e8741 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:02.304550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a0e42-53fc-461a-937d-7bb9773e8741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:02.327180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ba0a0e42-53fc-461a-937d-7bb9773e8741 None None] MFA Rules not processed for user `e23aea853cce44698b19d6bc087093c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:31:02.328883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ba0a0e42-53fc-461a-937d-7bb9773e8741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:02.340498 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1187/2383] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 03:31:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:31:02.357071 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9af53-ccce-4c1c-a4e5-963e084eac99 service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:02.370288 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9af53-ccce-4c1c-a4e5-963e084eac99 service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:02.377521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc7c90-a26b-4afa-83dc-46a29b5bddc1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc4cbd87dd249868cfb704535774126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:02.378174 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc7c90-a26b-4afa-83dc-46a29b5bddc1 service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:02.378465 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc7c90-a26b-4afa-83dc-46a29b5bddc1 service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:02.378732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc7c90-a26b-4afa-83dc-46a29b5bddc1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:02.403761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc7c90-a26b-4afa-83dc-46a29b5bddc1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:02.415964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc7c90-a26b-4afa-83dc-46a29b5bddc1 service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:02.435652 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1197/2384] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 03:31:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 03:31:02.984124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ded43-fcd6-4f0c-92e9-1dce089cbca6 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:02.984889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ded43-fcd6-4f0c-92e9-1dce089cbca6 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:02.984889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ded43-fcd6-4f0c-92e9-1dce089cbca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:03.013681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-1c1ded43-fcd6-4f0c-92e9-1dce089cbca6 None None] MFA Rules not processed for user `e23aea853cce44698b19d6bc087093c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:31:03.015014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1c1ded43-fcd6-4f0c-92e9-1dce089cbca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:03.023634 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1188/2385] 10.222.0.26 () {58 vars in 967 bytes} [Tue Jul 12 03:31:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:31:03.043919 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc7c90-a26b-4afa-83dc-46a29b5bddc1 service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:03.058653 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc7c90-a26b-4afa-83dc-46a29b5bddc1 service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:03.066151 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5ef33-81d8-4208-a2d6-73c6e4fbe67d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc4cbd87dd249868cfb704535774126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:03.068556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5ef33-81d8-4208-a2d6-73c6e4fbe67d service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:03.068556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5ef33-81d8-4208-a2d6-73c6e4fbe67d service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:03.069232 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5ef33-81d8-4208-a2d6-73c6e4fbe67d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:03.083496 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5ef33-81d8-4208-a2d6-73c6e4fbe67d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:03.085508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5ef33-81d8-4208-a2d6-73c6e4fbe67d service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:03.098679 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1198/2386] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 03:31:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 03:31:05.503768 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ded43-fcd6-4f0c-92e9-1dce089cbca6 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:05.505817 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1c1ded43-fcd6-4f0c-92e9-1dce089cbca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:05.648492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ded43-fcd6-4f0c-92e9-1dce089cbca6 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:05.659566 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8ccf6-5dc2-4026-999b-fc2fbf3f32f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:05.660401 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8ccf6-5dc2-4026-999b-fc2fbf3f32f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:05.660709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8ccf6-5dc2-4026-999b-fc2fbf3f32f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:05.661424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8ccf6-5dc2-4026-999b-fc2fbf3f32f7 admin admin] PATH_INFO: `/v3/users/1582f8c2bac64f8798dfdbe1c8cc95fa` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:05.666062 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8ccf6-5dc2-4026-999b-fc2fbf3f32f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1582f8c2bac64f8798dfdbe1c8cc95fa)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:05.668313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8ccf6-5dc2-4026-999b-fc2fbf3f32f7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:05.814476 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-17c8ccf6-5dc2-4026-999b-fc2fbf3f32f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1582f8c2bac64f8798dfdbe1c8cc95fa'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:05.834158 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-17c8ccf6-5dc2-4026-999b-fc2fbf3f32f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1582f8c2bac64f8798dfdbe1c8cc95fa'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:05.854205 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-17c8ccf6-5dc2-4026-999b-fc2fbf3f32f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1582f8c2bac64f8798dfdbe1c8cc95fa'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:05.855294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-17c8ccf6-5dc2-4026-999b-fc2fbf3f32f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1582f8c2bac64f8798dfdbe1c8cc95fa'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:05.863696 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-17c8ccf6-5dc2-4026-999b-fc2fbf3f32f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1582f8c2bac64f8798dfdbe1c8cc95fa'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:05.871603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1189/2387] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:31:05 2022] DELETE /identity/v3/users/1582f8c2bac64f8798dfdbe1c8cc95fa => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:31:05.876020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484db4-427d-4764-9e0b-8fc4f3c6fb6f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:05.878247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484db4-427d-4764-9e0b-8fc4f3c6fb6f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:05.878728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484db4-427d-4764-9e0b-8fc4f3c6fb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:05.912509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-87484db4-427d-4764-9e0b-8fc4f3c6fb6f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:31:05.913996 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-87484db4-427d-4764-9e0b-8fc4f3c6fb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:06.009981 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1199/2388] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:31:06.016672 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8ccf6-5dc2-4026-999b-fc2fbf3f32f7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:06.018582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-17c8ccf6-5dc2-4026-999b-fc2fbf3f32f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:06.108738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:31:06.116399 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8ccf6-5dc2-4026-999b-fc2fbf3f32f7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:06.123276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d9402-7ec5-438b-ba92-f9d0ba5bb2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:06.123868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d9402-7ec5-438b-ba92-f9d0ba5bb2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:06.124148 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d9402-7ec5-438b-ba92-f9d0ba5bb2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:06.124455 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d9402-7ec5-438b-ba92-f9d0ba5bb2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:06.136403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d9402-7ec5-438b-ba92-f9d0ba5bb2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:06.139830 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d9402-7ec5-438b-ba92-f9d0ba5bb2b4 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:06.154484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1190/2389] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:31:06.372631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87484db4-427d-4764-9e0b-8fc4f3c6fb6f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:06.374341 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-87484db4-427d-4764-9e0b-8fc4f3c6fb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:06.381757 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:31:06.393531 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87484db4-427d-4764-9e0b-8fc4f3c6fb6f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:06.398548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11433213-de37-4a08-849c-453a9868b936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:06.399417 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11433213-de37-4a08-849c-453a9868b936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:06.399933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11433213-de37-4a08-849c-453a9868b936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:06.400203 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11433213-de37-4a08-849c-453a9868b936 admin admin] PATH_INFO: `/v3/projects/43ab217025c647d597f22b4292e4505b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:06.401496 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11433213-de37-4a08-849c-453a9868b936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ab217025c647d597f22b4292e4505b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:06.403415 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11433213-de37-4a08-849c-453a9868b936 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:06.466391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-11433213-de37-4a08-849c-453a9868b936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ab217025c647d597f22b4292e4505b', 'request_id': 'req-11433213-de37-4a08-849c-453a9868b936'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:06.478473 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-11433213-de37-4a08-849c-453a9868b936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ab217025c647d597f22b4292e4505b', 'request_id': 'req-11433213-de37-4a08-849c-453a9868b936'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:06.485618 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-11433213-de37-4a08-849c-453a9868b936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ab217025c647d597f22b4292e4505b', 'request_id': 'req-11433213-de37-4a08-849c-453a9868b936'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:06.502130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-11433213-de37-4a08-849c-453a9868b936 admin admin] The token cache is being invalidate because project 43ab217025c647d597f22b4292e4505b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:31:06.502450 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-11433213-de37-4a08-849c-453a9868b936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:06.503108 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-11433213-de37-4a08-849c-453a9868b936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:06.504719 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1200/2390] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:31:06 2022] DELETE /identity/v3/projects/43ab217025c647d597f22b4292e4505b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:31:06.509671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a487b50-6063-483f-93d2-1eeaf1d3c691 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:06.510634 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a487b50-6063-483f-93d2-1eeaf1d3c691 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:06.511058 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a487b50-6063-483f-93d2-1eeaf1d3c691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:06.532379 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5a487b50-6063-483f-93d2-1eeaf1d3c691 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:31:06.533737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5a487b50-6063-483f-93d2-1eeaf1d3c691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:06.613397 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1191/2391] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:31:06.620910 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ce9b0-9bfc-4eae-a565-c224eda18f45 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:06.621325 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ce9b0-9bfc-4eae-a565-c224eda18f45 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:06.621677 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ce9b0-9bfc-4eae-a565-c224eda18f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:06.649779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6f3ce9b0-9bfc-4eae-a565-c224eda18f45 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:31:06.651148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6f3ce9b0-9bfc-4eae-a565-c224eda18f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:06.660805 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1201/2392] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:31:06.664867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a487b50-6063-483f-93d2-1eeaf1d3c691 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:06.678053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a487b50-6063-483f-93d2-1eeaf1d3c691 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:06.690485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1b478-3e99-4cb9-9abb-4fc9613ab9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:06.691166 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1b478-3e99-4cb9-9abb-4fc9613ab9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:06.691443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1b478-3e99-4cb9-9abb-4fc9613ab9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:06.691712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1b478-3e99-4cb9-9abb-4fc9613ab9b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:06.692464 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1b478-3e99-4cb9-9abb-4fc9613ab9b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:31:06.692798 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1b478-3e99-4cb9-9abb-4fc9613ab9b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:06.694415 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1b478-3e99-4cb9-9abb-4fc9613ab9b2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:06.716319 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1192/2393] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:31:06.721491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ce9b0-9bfc-4eae-a565-c224eda18f45 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:06.734460 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ce9b0-9bfc-4eae-a565-c224eda18f45 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:06.741819 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a992-0b20-462d-bed0-de3603e44c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:06.742500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a992-0b20-462d-bed0-de3603e44c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:06.742783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a992-0b20-462d-bed0-de3603e44c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:06.743061 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a992-0b20-462d-bed0-de3603e44c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:06.743959 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67a992-0b20-462d-bed0-de3603e44c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:06.745896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67a992-0b20-462d-bed0-de3603e44c00 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:06.788428 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1202/2394] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:31:06 2022] POST /identity/v3/projects => generated 397 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:31:06.792810 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1b478-3e99-4cb9-9abb-4fc9613ab9b2 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:06.808483 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1b478-3e99-4cb9-9abb-4fc9613ab9b2 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:06.890977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d3a5f-dc90-4843-9ae4-0c051396da4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:06.891666 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3a5f-dc90-4843-9ae4-0c051396da4e admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:06.891968 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3a5f-dc90-4843-9ae4-0c051396da4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:06.892211 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3a5f-dc90-4843-9ae4-0c051396da4e admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:06.892961 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d3a5f-dc90-4843-9ae4-0c051396da4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:06.894897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d3a5f-dc90-4843-9ae4-0c051396da4e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:06.926289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1193/2395] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:31:06 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:31:06.927713 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a992-0b20-462d-bed0-de3603e44c00 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:06.943943 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a992-0b20-462d-bed0-de3603e44c00 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:06.956394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230adf25-f8d4-4421-8f71-a75a138bbc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:06.957130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230adf25-f8d4-4421-8f71-a75a138bbc5e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:06.957445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230adf25-f8d4-4421-8f71-a75a138bbc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:06.957687 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230adf25-f8d4-4421-8f71-a75a138bbc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:06.958572 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230adf25-f8d4-4421-8f71-a75a138bbc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:06.960328 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230adf25-f8d4-4421-8f71-a75a138bbc5e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:06.984896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1203/2396] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:31:06.986129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d3a5f-dc90-4843-9ae4-0c051396da4e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:06.996707 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d3a5f-dc90-4843-9ae4-0c051396da4e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:07.002227 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca6438-4654-48a0-bc47-51443bb3fe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:07.002954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca6438-4654-48a0-bc47-51443bb3fe7e admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:07.003255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca6438-4654-48a0-bc47-51443bb3fe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:07.003532 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca6438-4654-48a0-bc47-51443bb3fe7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:07.004267 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca6438-4654-48a0-bc47-51443bb3fe7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:07.007379 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca6438-4654-48a0-bc47-51443bb3fe7e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:07.020317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1194/2397] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:31:07.021527 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230adf25-f8d4-4421-8f71-a75a138bbc5e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:07.033712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230adf25-f8d4-4421-8f71-a75a138bbc5e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:07.040132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1b0eb-d7e0-4793-920e-754021b4a421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:07.041429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1b0eb-d7e0-4793-920e-754021b4a421 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:07.041429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1b0eb-d7e0-4793-920e-754021b4a421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:07.041429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1b0eb-d7e0-4793-920e-754021b4a421 admin admin] PATH_INFO: `/v3/projects/0e95f2a2a071458786405a3c876f8540/users/eb1a63e708804e6eb8b1646353357be6/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:07.059794 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1b0eb-d7e0-4793-920e-754021b4a421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e95f2a2a071458786405a3c876f8540, user_id=eb1a63e708804e6eb8b1646353357be6, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:07.062755 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1b0eb-d7e0-4793-920e-754021b4a421 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:07.086830 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1204/2398] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:31:07 2022] PUT /identity/v3/projects/0e95f2a2a071458786405a3c876f8540/users/eb1a63e708804e6eb8b1646353357be6/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:31:07.161142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0518b89-171e-4e69-831e-ce9df68ed4a9 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:07.161834 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0518b89-171e-4e69-831e-ce9df68ed4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:07.162205 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0518b89-171e-4e69-831e-ce9df68ed4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:07.191530 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a0518b89-171e-4e69-831e-ce9df68ed4a9 None None] MFA Rules not processed for user `eb1a63e708804e6eb8b1646353357be6`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:31:07.193077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a0518b89-171e-4e69-831e-ce9df68ed4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:07.263330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:31:07.292240 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1195/2399] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:31:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:31:07.305818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1b0eb-d7e0-4793-920e-754021b4a421 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:07.307577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-45c1b0eb-d7e0-4793-920e-754021b4a421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:07.399052 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1b0eb-d7e0-4793-920e-754021b4a421 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:07.403864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fc325-bbc3-4602-8708-4906e85e0f27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:07.404911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fc325-bbc3-4602-8708-4906e85e0f27 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:07.404911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fc325-bbc3-4602-8708-4906e85e0f27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:07.405112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fc325-bbc3-4602-8708-4906e85e0f27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:07.416015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fc325-bbc3-4602-8708-4906e85e0f27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:07.417698 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fc325-bbc3-4602-8708-4906e85e0f27 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:07.441872 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1205/2400] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:31:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:31:11.037872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00932c5-c9a5-42f0-9cfa-b939909811b9 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:11.038367 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00932c5-c9a5-42f0-9cfa-b939909811b9 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:11.038490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00932c5-c9a5-42f0-9cfa-b939909811b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:11.055960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c00932c5-c9a5-42f0-9cfa-b939909811b9 None None] MFA Rules not processed for user `33fd711472d643628d1f9961247e5ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:31:11.057313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c00932c5-c9a5-42f0-9cfa-b939909811b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:11.127466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1196/2401] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:31:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:31:12.598996 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fc325-bbc3-4602-8708-4906e85e0f27 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:12.628296 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:31:12.669635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fc325-bbc3-4602-8708-4906e85e0f27 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:12.675575 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8457fe-9129-42a8-b68f-6babcc0c5627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:12.676442 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8457fe-9129-42a8-b68f-6babcc0c5627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:12.676760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8457fe-9129-42a8-b68f-6babcc0c5627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:12.677027 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8457fe-9129-42a8-b68f-6babcc0c5627 admin admin] PATH_INFO: `/v3/users/eb1a63e708804e6eb8b1646353357be6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:12.678278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8457fe-9129-42a8-b68f-6babcc0c5627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb1a63e708804e6eb8b1646353357be6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:12.680205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8457fe-9129-42a8-b68f-6babcc0c5627 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:12.734274 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-aa8457fe-9129-42a8-b68f-6babcc0c5627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb1a63e708804e6eb8b1646353357be6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:12.744175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-aa8457fe-9129-42a8-b68f-6babcc0c5627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb1a63e708804e6eb8b1646353357be6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:12.752215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-aa8457fe-9129-42a8-b68f-6babcc0c5627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb1a63e708804e6eb8b1646353357be6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:12.753124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-aa8457fe-9129-42a8-b68f-6babcc0c5627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb1a63e708804e6eb8b1646353357be6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:12.770455 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-aa8457fe-9129-42a8-b68f-6babcc0c5627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb1a63e708804e6eb8b1646353357be6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:12.780983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1206/2402] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:31:12 2022] DELETE /identity/v3/users/eb1a63e708804e6eb8b1646353357be6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:31:12.783041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e14ffb-6089-49be-aae9-1ec95333ea0c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:12.784009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e14ffb-6089-49be-aae9-1ec95333ea0c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:12.784817 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e14ffb-6089-49be-aae9-1ec95333ea0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:12.802841 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-b1e14ffb-6089-49be-aae9-1ec95333ea0c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:31:12.804080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b1e14ffb-6089-49be-aae9-1ec95333ea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:12.873781 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1197/2403] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:31:12.884324 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8457fe-9129-42a8-b68f-6babcc0c5627 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:12.885370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-aa8457fe-9129-42a8-b68f-6babcc0c5627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:12.954836 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8457fe-9129-42a8-b68f-6babcc0c5627 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:12.958620 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c95a19-4427-4935-acea-46787224ec31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:12.959367 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c95a19-4427-4935-acea-46787224ec31 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:12.959708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c95a19-4427-4935-acea-46787224ec31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:12.960042 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c95a19-4427-4935-acea-46787224ec31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:12.971060 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c95a19-4427-4935-acea-46787224ec31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:12.972468 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c95a19-4427-4935-acea-46787224ec31 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:12.982255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1207/2404] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:31:13.063052 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6670a-e333-46a3-a8fd-6045fbcf4336 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:13.063496 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6670a-e333-46a3-a8fd-6045fbcf4336 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:13.064107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6670a-e333-46a3-a8fd-6045fbcf4336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:13.088009 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-24a6670a-e333-46a3-a8fd-6045fbcf4336 None None] MFA Rules not processed for user `e23aea853cce44698b19d6bc087093c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:31:13.089418 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-24a6670a-e333-46a3-a8fd-6045fbcf4336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:13.179578 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1198/2405] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 03:31:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:31:13.193539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c95a19-4427-4935-acea-46787224ec31 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:13.196060 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-51c95a19-4427-4935-acea-46787224ec31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:13.249721 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:31:13.276696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c95a19-4427-4935-acea-46787224ec31 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:13.283034 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c7f0b-dca9-46bd-b76f-c68d16a229ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc4cbd87dd249868cfb704535774126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:13.283791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c7f0b-dca9-46bd-b76f-c68d16a229ae service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:13.284162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c7f0b-dca9-46bd-b76f-c68d16a229ae service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:13.284601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c7f0b-dca9-46bd-b76f-c68d16a229ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:13.286226 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6670a-e333-46a3-a8fd-6045fbcf4336 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:13.287689 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-24a6670a-e333-46a3-a8fd-6045fbcf4336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:13.304408 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c7f0b-dca9-46bd-b76f-c68d16a229ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:13.306061 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c7f0b-dca9-46bd-b76f-c68d16a229ae service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:13.315874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1208/2406] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 03:31:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 03:31:13.324160 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6670a-e333-46a3-a8fd-6045fbcf4336 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:13.334381 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a81f81-aafd-421a-8073-544fb7ed169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:13.335385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a81f81-aafd-421a-8073-544fb7ed169c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:13.335737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a81f81-aafd-421a-8073-544fb7ed169c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:13.336076 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a81f81-aafd-421a-8073-544fb7ed169c admin admin] PATH_INFO: `/v3/projects/0e95f2a2a071458786405a3c876f8540` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:13.337576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a81f81-aafd-421a-8073-544fb7ed169c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e95f2a2a071458786405a3c876f8540)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:13.339788 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a81f81-aafd-421a-8073-544fb7ed169c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:13.391130 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:31:13.429115 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-55a81f81-aafd-421a-8073-544fb7ed169c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e95f2a2a071458786405a3c876f8540', 'request_id': 'req-55a81f81-aafd-421a-8073-544fb7ed169c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:13.440703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-55a81f81-aafd-421a-8073-544fb7ed169c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e95f2a2a071458786405a3c876f8540', 'request_id': 'req-55a81f81-aafd-421a-8073-544fb7ed169c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:13.448187 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-55a81f81-aafd-421a-8073-544fb7ed169c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e95f2a2a071458786405a3c876f8540', 'request_id': 'req-55a81f81-aafd-421a-8073-544fb7ed169c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:13.475865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-55a81f81-aafd-421a-8073-544fb7ed169c admin admin] The token cache is being invalidate because project 0e95f2a2a071458786405a3c876f8540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:31:13.476099 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-55a81f81-aafd-421a-8073-544fb7ed169c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:13.479265 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-55a81f81-aafd-421a-8073-544fb7ed169c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:31:13.484881 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1199/2407] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:31:13 2022] DELETE /identity/v3/projects/0e95f2a2a071458786405a3c876f8540 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:31:23.312498 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=11 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:31:23.468948 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=13,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:31:26.490630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c7f0b-dca9-46bd-b76f-c68d16a229ae service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:26.492359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-365c7f0b-dca9-46bd-b76f-c68d16a229ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:26.561059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c7f0b-dca9-46bd-b76f-c68d16a229ae service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:26.630382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46320353-192d-4359-bf3a-765768960b43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '361ad35021eb43cca46d9b66e6f24ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:26.631401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46320353-192d-4359-bf3a-765768960b43 service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:26.631845 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46320353-192d-4359-bf3a-765768960b43 service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:26.632305 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46320353-192d-4359-bf3a-765768960b43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:26.635784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-46320353-192d-4359-bf3a-765768960b43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:26.650213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46320353-192d-4359-bf3a-765768960b43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:26.651794 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46320353-192d-4359-bf3a-765768960b43 service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:26.662386 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1209/2408] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:31:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:31:36.658072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=58 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:31:38.724215 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a81f81-aafd-421a-8073-544fb7ed169c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:31:38.725757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-55a81f81-aafd-421a-8073-544fb7ed169c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:38.792676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a81f81-aafd-421a-8073-544fb7ed169c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:31:38.797449 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287509d6-90ea-45a2-b79f-f8286c15656c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:31:38.798855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287509d6-90ea-45a2-b79f-f8286c15656c service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:38.798855 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287509d6-90ea-45a2-b79f-f8286c15656c service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:38.799177 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287509d6-90ea-45a2-b79f-f8286c15656c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:38.801025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-287509d6-90ea-45a2-b79f-f8286c15656c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:38.881970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287509d6-90ea-45a2-b79f-f8286c15656c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:31:38.883729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287509d6-90ea-45a2-b79f-f8286c15656c service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:31:38.893914 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1200/2409] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:31:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:31:40.266042 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343afd7-8a1f-4007-a821-9c17cfe508f2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:40.266042 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343afd7-8a1f-4007-a821-9c17cfe508f2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:40.266042 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343afd7-8a1f-4007-a821-9c17cfe508f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:40.284852 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c343afd7-8a1f-4007-a821-9c17cfe508f2 None None] MFA Rules not processed for user `d8e90b4b09dd453f9685fb034227a136`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:31:40.285856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c343afd7-8a1f-4007-a821-9c17cfe508f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:40.361250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1210/2410] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:31:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:31:48.888932 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=50 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:31:50.347048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=25 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:31:59.910894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7c100-08de-419b-874b-dccf3541d1a9 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:31:59.911451 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7c100-08de-419b-874b-dccf3541d1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:31:59.911451 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7c100-08de-419b-874b-dccf3541d1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:31:59.928996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f4f7c100-08de-419b-874b-dccf3541d1a9 None None] MFA Rules not processed for user `6e67edcef8454b3fa4565fea949f1781`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:31:59.930198 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f4f7c100-08de-419b-874b-dccf3541d1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:31:59.990792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1201/2411] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:31:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:32:09.983158 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=25 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:32:27.264015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b228e-b4b7-4fef-989b-9ee9d7f6c2bd None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:32:27.264623 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b228e-b4b7-4fef-989b-9ee9d7f6c2bd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:32:27.264623 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b228e-b4b7-4fef-989b-9ee9d7f6c2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:32:27.283700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7f0b228e-b4b7-4fef-989b-9ee9d7f6c2bd None None] MFA Rules not processed for user `dbfe7a2a6c144b598057e446e426688e`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:32:27.285407 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7f0b228e-b4b7-4fef-989b-9ee9d7f6c2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:32:27.349345 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1211/2412] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:32:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:32:37.341895 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=25 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:32:51.151370 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6919b1a-f898-402f-8419-1d4424604953 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:32:51.151923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6919b1a-f898-402f-8419-1d4424604953 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:32:51.152059 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6919b1a-f898-402f-8419-1d4424604953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:32:51.171568 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-d6919b1a-f898-402f-8419-1d4424604953 None None] MFA Rules not processed for user `d8e90b4b09dd453f9685fb034227a136`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:32:51.172830 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d6919b1a-f898-402f-8419-1d4424604953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:32:51.180925 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1202/2413] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:32:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:33:01.166044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:08.580573 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b228e-b4b7-4fef-989b-9ee9d7f6c2bd None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:08.583056 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7f0b228e-b4b7-4fef-989b-9ee9d7f6c2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:08.651987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b228e-b4b7-4fef-989b-9ee9d7f6c2bd None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:08.656876 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79683cd5-06fc-40e9-ab6f-4b8fb9f185b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:08.657759 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683cd5-06fc-40e9-ab6f-4b8fb9f185b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:08.658031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683cd5-06fc-40e9-ab6f-4b8fb9f185b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:08.658301 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683cd5-06fc-40e9-ab6f-4b8fb9f185b3 admin admin] PATH_INFO: `/v3/users/6e67edcef8454b3fa4565fea949f1781` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:08.659497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79683cd5-06fc-40e9-ab6f-4b8fb9f185b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e67edcef8454b3fa4565fea949f1781)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:08.661473 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79683cd5-06fc-40e9-ab6f-4b8fb9f185b3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:08.719350 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-79683cd5-06fc-40e9-ab6f-4b8fb9f185b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e67edcef8454b3fa4565fea949f1781'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:08.734431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-79683cd5-06fc-40e9-ab6f-4b8fb9f185b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e67edcef8454b3fa4565fea949f1781'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:08.748658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-79683cd5-06fc-40e9-ab6f-4b8fb9f185b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e67edcef8454b3fa4565fea949f1781'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:08.749657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-79683cd5-06fc-40e9-ab6f-4b8fb9f185b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e67edcef8454b3fa4565fea949f1781'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:08.779122 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-79683cd5-06fc-40e9-ab6f-4b8fb9f185b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e67edcef8454b3fa4565fea949f1781'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:08.787915 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1212/2414] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:33:08 2022] DELETE /identity/v3/users/6e67edcef8454b3fa4565fea949f1781 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:33:09.237473 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6919b1a-f898-402f-8419-1d4424604953 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:09.257332 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6919b1a-f898-402f-8419-1d4424604953 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:09.341353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc473e0-8a3f-4239-bbbc-d01695650088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:09.343078 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc473e0-8a3f-4239-bbbc-d01695650088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:09.343532 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc473e0-8a3f-4239-bbbc-d01695650088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:09.343963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc473e0-8a3f-4239-bbbc-d01695650088 admin admin] PATH_INFO: `/v3/projects/ef99fada1f25433cadda54b9cf3b9228` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:09.346410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc473e0-8a3f-4239-bbbc-d01695650088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef99fada1f25433cadda54b9cf3b9228)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:09.349371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc473e0-8a3f-4239-bbbc-d01695650088 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:09.432275 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6cc473e0-8a3f-4239-bbbc-d01695650088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef99fada1f25433cadda54b9cf3b9228', 'request_id': 'req-6cc473e0-8a3f-4239-bbbc-d01695650088'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:09.448472 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6cc473e0-8a3f-4239-bbbc-d01695650088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef99fada1f25433cadda54b9cf3b9228', 'request_id': 'req-6cc473e0-8a3f-4239-bbbc-d01695650088'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:09.464793 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6cc473e0-8a3f-4239-bbbc-d01695650088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef99fada1f25433cadda54b9cf3b9228', 'request_id': 'req-6cc473e0-8a3f-4239-bbbc-d01695650088'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:09.477777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6cc473e0-8a3f-4239-bbbc-d01695650088 admin admin] The token cache is being invalidate because project ef99fada1f25433cadda54b9cf3b9228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:33:09.478445 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6cc473e0-8a3f-4239-bbbc-d01695650088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:09.479006 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6cc473e0-8a3f-4239-bbbc-d01695650088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:09.481311 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1203/2415] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:33:09 2022] DELETE /identity/v3/projects/ef99fada1f25433cadda54b9cf3b9228 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:33:09.486822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197e703-520c-4ef0-b8ce-60a35de3f76e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:09.487367 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197e703-520c-4ef0-b8ce-60a35de3f76e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:09.487765 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197e703-520c-4ef0-b8ce-60a35de3f76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:09.506580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9197e703-520c-4ef0-b8ce-60a35de3f76e None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:09.507954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9197e703-520c-4ef0-b8ce-60a35de3f76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:09.581804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1213/2416] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:33:09.589979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfef759-8028-408a-bdf2-63a8d3464c36 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:09.590374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfef759-8028-408a-bdf2-63a8d3464c36 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:09.590651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfef759-8028-408a-bdf2-63a8d3464c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:09.609570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6dfef759-8028-408a-bdf2-63a8d3464c36 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:09.610802 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6dfef759-8028-408a-bdf2-63a8d3464c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:09.619361 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1204/2417] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:33:09.624070 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197e703-520c-4ef0-b8ce-60a35de3f76e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:09.634488 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197e703-520c-4ef0-b8ce-60a35de3f76e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:09.639274 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8ddfb-eb98-4ec4-92d4-a1e5566265e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:09.640006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8ddfb-eb98-4ec4-92d4-a1e5566265e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:09.640348 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8ddfb-eb98-4ec4-92d4-a1e5566265e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:09.640743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8ddfb-eb98-4ec4-92d4-a1e5566265e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:09.641541 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8ddfb-eb98-4ec4-92d4-a1e5566265e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:33:09.641922 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8ddfb-eb98-4ec4-92d4-a1e5566265e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:09.643730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8ddfb-eb98-4ec4-92d4-a1e5566265e9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:09.657346 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1214/2418] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:33:09.661572 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfef759-8028-408a-bdf2-63a8d3464c36 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:09.671075 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfef759-8028-408a-bdf2-63a8d3464c36 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:09.675920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e030e-9df6-4887-b163-e6119094f7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:09.676699 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e030e-9df6-4887-b163-e6119094f7ec admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:09.677064 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e030e-9df6-4887-b163-e6119094f7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:09.677398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e030e-9df6-4887-b163-e6119094f7ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:09.678157 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e030e-9df6-4887-b163-e6119094f7ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:09.680123 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e030e-9df6-4887-b163-e6119094f7ec admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:09.709454 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1205/2419] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:33:09 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:33:09.713697 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8ddfb-eb98-4ec4-92d4-a1e5566265e9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:09.724718 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8ddfb-eb98-4ec4-92d4-a1e5566265e9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:09.728712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:09.785200 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce488ff-77d5-437f-a8b8-1d23ad52e53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:09.785906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce488ff-77d5-437f-a8b8-1d23ad52e53f admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:09.786185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce488ff-77d5-437f-a8b8-1d23ad52e53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:09.786463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce488ff-77d5-437f-a8b8-1d23ad52e53f admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:09.787206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce488ff-77d5-437f-a8b8-1d23ad52e53f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:09.789218 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce488ff-77d5-437f-a8b8-1d23ad52e53f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:09.812561 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1215/2420] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:33:09 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:33:09.814872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e030e-9df6-4887-b163-e6119094f7ec admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:09.826866 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e030e-9df6-4887-b163-e6119094f7ec admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:09.831853 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fa3ed-224f-48d2-84ff-16f0bf4e1632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:09.832621 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fa3ed-224f-48d2-84ff-16f0bf4e1632 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:09.832966 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fa3ed-224f-48d2-84ff-16f0bf4e1632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:09.833298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fa3ed-224f-48d2-84ff-16f0bf4e1632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:09.834090 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fa3ed-224f-48d2-84ff-16f0bf4e1632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:09.835755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fa3ed-224f-48d2-84ff-16f0bf4e1632 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:09.847573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1206/2421] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:33:09.851506 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce488ff-77d5-437f-a8b8-1d23ad52e53f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:09.861965 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce488ff-77d5-437f-a8b8-1d23ad52e53f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:09.866747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417690e-1081-4691-a212-23904345a538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:09.867415 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417690e-1081-4691-a212-23904345a538 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:09.867701 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417690e-1081-4691-a212-23904345a538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:09.867972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417690e-1081-4691-a212-23904345a538 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:09.868730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417690e-1081-4691-a212-23904345a538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:09.870348 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417690e-1081-4691-a212-23904345a538 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:09.883843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1216/2422] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:33:09.885069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fa3ed-224f-48d2-84ff-16f0bf4e1632 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:09.895834 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fa3ed-224f-48d2-84ff-16f0bf4e1632 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:09.901077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33b4c3-dc91-476f-baec-09c7842c5a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:09.901968 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33b4c3-dc91-476f-baec-09c7842c5a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:09.902321 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33b4c3-dc91-476f-baec-09c7842c5a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:09.902617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33b4c3-dc91-476f-baec-09c7842c5a7e admin admin] PATH_INFO: `/v3/projects/aba3c24136af44a0aeb30a154224dc93/users/c9211a496a7a466a9d0032c48363e544/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:09.923069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33b4c3-dc91-476f-baec-09c7842c5a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba3c24136af44a0aeb30a154224dc93, user_id=c9211a496a7a466a9d0032c48363e544, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:09.925944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33b4c3-dc91-476f-baec-09c7842c5a7e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:09.946005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1207/2423] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:33:09 2022] PUT /identity/v3/projects/aba3c24136af44a0aeb30a154224dc93/users/c9211a496a7a466a9d0032c48363e544/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:33:09.951137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214706f5-51f6-4aaf-ae2d-9783651648d5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:09.951418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214706f5-51f6-4aaf-ae2d-9783651648d5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:09.951739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214706f5-51f6-4aaf-ae2d-9783651648d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:09.971071 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-214706f5-51f6-4aaf-ae2d-9783651648d5 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:09.972655 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-214706f5-51f6-4aaf-ae2d-9783651648d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:10.055632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1217/2424] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:33:10.066901 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33b4c3-dc91-476f-baec-09c7842c5a7e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:10.068584 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bc33b4c3-dc91-476f-baec-09c7842c5a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:10.110582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:10.146420 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33b4c3-dc91-476f-baec-09c7842c5a7e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:10.151057 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea156a-efe2-4e09-8251-167682fe55eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:10.151732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea156a-efe2-4e09-8251-167682fe55eb service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:10.152020 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea156a-efe2-4e09-8251-167682fe55eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:10.152349 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea156a-efe2-4e09-8251-167682fe55eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:10.163416 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea156a-efe2-4e09-8251-167682fe55eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:10.165197 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea156a-efe2-4e09-8251-167682fe55eb service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:10.180744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1208/2425] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:33:15.031986 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fef49b-f973-44fc-8b07-9cc142b182d5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:15.032471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fef49b-f973-44fc-8b07-9cc142b182d5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:15.032665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fef49b-f973-44fc-8b07-9cc142b182d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:15.061847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-38fef49b-f973-44fc-8b07-9cc142b182d5 None None] MFA Rules not processed for user `c9211a496a7a466a9d0032c48363e544`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:15.064002 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-38fef49b-f973-44fc-8b07-9cc142b182d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:15.162249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1218/2426] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:33:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:33:15.182789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea156a-efe2-4e09-8251-167682fe55eb service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:15.186991 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-42ea156a-efe2-4e09-8251-167682fe55eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:15.286229 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea156a-efe2-4e09-8251-167682fe55eb service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:15.294152 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450e91a-6e86-41f7-b454-ba88ba842a29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:15.294813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450e91a-6e86-41f7-b454-ba88ba842a29 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:15.295088 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450e91a-6e86-41f7-b454-ba88ba842a29 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:15.295357 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450e91a-6e86-41f7-b454-ba88ba842a29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:15.305905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450e91a-6e86-41f7-b454-ba88ba842a29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:15.308083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450e91a-6e86-41f7-b454-ba88ba842a29 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:15.320977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1209/2427] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:33:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:33:16.748105 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec87fc-f678-48e9-9e38-7aa25b359b88 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:16.748669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec87fc-f678-48e9-9e38-7aa25b359b88 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:16.748794 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec87fc-f678-48e9-9e38-7aa25b359b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:16.769058 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-dcec87fc-f678-48e9-9e38-7aa25b359b88 None None] MFA Rules not processed for user `e23aea853cce44698b19d6bc087093c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:16.770668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dcec87fc-f678-48e9-9e38-7aa25b359b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:16.783719 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:16.848965 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1219/2428] 10.222.0.26 () {58 vars in 967 bytes} [Tue Jul 12 03:33:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:33:16.856091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912906e0-9cfa-4430-bc4a-9c61457aa0a3 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:16.856625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912906e0-9cfa-4430-bc4a-9c61457aa0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:16.856984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912906e0-9cfa-4430-bc4a-9c61457aa0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:16.876352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-912906e0-9cfa-4430-bc4a-9c61457aa0a3 None None] MFA Rules not processed for user `c9211a496a7a466a9d0032c48363e544`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:16.877622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-912906e0-9cfa-4430-bc4a-9c61457aa0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:16.891239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1210/2429] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:33:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:33:16.902972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec87fc-f678-48e9-9e38-7aa25b359b88 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:16.904406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dcec87fc-f678-48e9-9e38-7aa25b359b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:17.001643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec87fc-f678-48e9-9e38-7aa25b359b88 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:17.009340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a775-6d3e-4e12-94f6-2c8e1623cb35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc4cbd87dd249868cfb704535774126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:17.010495 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a775-6d3e-4e12-94f6-2c8e1623cb35 service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:17.011010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a775-6d3e-4e12-94f6-2c8e1623cb35 service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:17.011836 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a775-6d3e-4e12-94f6-2c8e1623cb35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:17.023260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57a775-6d3e-4e12-94f6-2c8e1623cb35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:17.025168 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57a775-6d3e-4e12-94f6-2c8e1623cb35 service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:17.035923 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1220/2430] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 03:33:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 03:33:17.739094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912906e0-9cfa-4430-bc4a-9c61457aa0a3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:17.740750 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-912906e0-9cfa-4430-bc4a-9c61457aa0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:17.769902 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912906e0-9cfa-4430-bc4a-9c61457aa0a3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:17.779495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e42d9-b86b-4216-8afd-062c01e1151d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:17.781231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e42d9-b86b-4216-8afd-062c01e1151d service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:17.781670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e42d9-b86b-4216-8afd-062c01e1151d service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:17.784608 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e42d9-b86b-4216-8afd-062c01e1151d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:17.788846 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3e7e42d9-b86b-4216-8afd-062c01e1151d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:17.808817 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e42d9-b86b-4216-8afd-062c01e1151d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:17.811658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e42d9-b86b-4216-8afd-062c01e1151d service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:17.828573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1211/2431] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:33:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:33:23.000741 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a775-6d3e-4e12-94f6-2c8e1623cb35 service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:23.010944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a775-6d3e-4e12-94f6-2c8e1623cb35 service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:23.014824 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4226f8-8d1e-4e0b-83eb-e2483c8181e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:23.015492 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4226f8-8d1e-4e0b-83eb-e2483c8181e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:23.015769 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4226f8-8d1e-4e0b-83eb-e2483c8181e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:23.016051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4226f8-8d1e-4e0b-83eb-e2483c8181e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:23.018109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5e4226f8-8d1e-4e0b-83eb-e2483c8181e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:23.034009 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4226f8-8d1e-4e0b-83eb-e2483c8181e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:23.035505 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4226f8-8d1e-4e0b-83eb-e2483c8181e1 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:23.048854 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1221/2432] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:33:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:33:25.729402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e42d9-b86b-4216-8afd-062c01e1151d service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:25.731039 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3e7e42d9-b86b-4216-8afd-062c01e1151d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:25.745738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e42d9-b86b-4216-8afd-062c01e1151d service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:25.751125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144bd71-31d8-4f68-8ee7-b451c06ef37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:25.751894 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144bd71-31d8-4f68-8ee7-b451c06ef37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:25.752473 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144bd71-31d8-4f68-8ee7-b451c06ef37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:25.752920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144bd71-31d8-4f68-8ee7-b451c06ef37c admin admin] PATH_INFO: `/v3/users/33fd711472d643628d1f9961247e5ef6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:25.754450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144bd71-31d8-4f68-8ee7-b451c06ef37c admin admin] RBAC: Authorizing `identity:delete_user(user_id=33fd711472d643628d1f9961247e5ef6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:25.760753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144bd71-31d8-4f68-8ee7-b451c06ef37c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:25.812549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8144bd71-31d8-4f68-8ee7-b451c06ef37c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33fd711472d643628d1f9961247e5ef6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:25.821396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8144bd71-31d8-4f68-8ee7-b451c06ef37c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33fd711472d643628d1f9961247e5ef6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:25.834000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8144bd71-31d8-4f68-8ee7-b451c06ef37c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33fd711472d643628d1f9961247e5ef6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:25.834680 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8144bd71-31d8-4f68-8ee7-b451c06ef37c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33fd711472d643628d1f9961247e5ef6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:25.842404 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8144bd71-31d8-4f68-8ee7-b451c06ef37c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33fd711472d643628d1f9961247e5ef6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:25.849724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1212/2433] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:33:25 2022] DELETE /identity/v3/users/33fd711472d643628d1f9961247e5ef6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:33:26.040334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4226f8-8d1e-4e0b-83eb-e2483c8181e1 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:26.055014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4226f8-8d1e-4e0b-83eb-e2483c8181e1 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:26.128786 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:26.129700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:26.130017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:26.130289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4 admin admin] PATH_INFO: `/v3/projects/621712fccf02439cbe3265bdafc1680c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:26.131820 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=621712fccf02439cbe3265bdafc1680c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:26.134344 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:26.186389 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:26.194584 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621712fccf02439cbe3265bdafc1680c', 'request_id': 'req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:26.203459 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621712fccf02439cbe3265bdafc1680c', 'request_id': 'req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:26.210654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621712fccf02439cbe3265bdafc1680c', 'request_id': 'req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:26.222746 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4 admin admin] The token cache is being invalidate because project 621712fccf02439cbe3265bdafc1680c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:33:26.223099 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:26.223863 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:26.225381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1222/2434] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:33:26 2022] DELETE /identity/v3/projects/621712fccf02439cbe3265bdafc1680c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:33:26.229586 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144bd71-31d8-4f68-8ee7-b451c06ef37c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:26.231313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8144bd71-31d8-4f68-8ee7-b451c06ef37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:26.245145 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144bd71-31d8-4f68-8ee7-b451c06ef37c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:26.249291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:26.307801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e403ff-f492-4f41-960d-bccab9bf25c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:26.309181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e403ff-f492-4f41-960d-bccab9bf25c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:26.309748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e403ff-f492-4f41-960d-bccab9bf25c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:26.310050 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e403ff-f492-4f41-960d-bccab9bf25c4 admin admin] PATH_INFO: `/v3/users/038f355798144d31ac5c211364ff8c62` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:26.311254 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e403ff-f492-4f41-960d-bccab9bf25c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=038f355798144d31ac5c211364ff8c62)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:26.313191 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e403ff-f492-4f41-960d-bccab9bf25c4 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:26.365179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-16e403ff-f492-4f41-960d-bccab9bf25c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038f355798144d31ac5c211364ff8c62'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:26.373576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-16e403ff-f492-4f41-960d-bccab9bf25c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038f355798144d31ac5c211364ff8c62'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:26.387872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-16e403ff-f492-4f41-960d-bccab9bf25c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038f355798144d31ac5c211364ff8c62'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:26.388625 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-16e403ff-f492-4f41-960d-bccab9bf25c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038f355798144d31ac5c211364ff8c62'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:26.396048 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-16e403ff-f492-4f41-960d-bccab9bf25c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038f355798144d31ac5c211364ff8c62'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:26.402924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1213/2435] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:33:26 2022] DELETE /identity/v3/users/038f355798144d31ac5c211364ff8c62 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:33:26.609280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:26.610735 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:26.634016 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83d1cd-6ca0-4ee2-ab6f-1714205f22b4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:26.695875 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e837d-8133-4d17-8008-79bec5ed1904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:26.696829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e837d-8133-4d17-8008-79bec5ed1904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:26.697243 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e837d-8133-4d17-8008-79bec5ed1904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:26.697582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e837d-8133-4d17-8008-79bec5ed1904 admin admin] PATH_INFO: `/v3/projects/0d6972c4589e49d4b23dcbbef8fa8a91` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:26.698974 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e837d-8133-4d17-8008-79bec5ed1904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6972c4589e49d4b23dcbbef8fa8a91)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:26.704463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e837d-8133-4d17-8008-79bec5ed1904 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:26.752772 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8d6e837d-8133-4d17-8008-79bec5ed1904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6972c4589e49d4b23dcbbef8fa8a91', 'request_id': 'req-8d6e837d-8133-4d17-8008-79bec5ed1904'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:26.761239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8d6e837d-8133-4d17-8008-79bec5ed1904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6972c4589e49d4b23dcbbef8fa8a91', 'request_id': 'req-8d6e837d-8133-4d17-8008-79bec5ed1904'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:26.767742 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8d6e837d-8133-4d17-8008-79bec5ed1904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6972c4589e49d4b23dcbbef8fa8a91', 'request_id': 'req-8d6e837d-8133-4d17-8008-79bec5ed1904'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:26.779952 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8d6e837d-8133-4d17-8008-79bec5ed1904 admin admin] The token cache is being invalidate because project 0d6972c4589e49d4b23dcbbef8fa8a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:33:26.780242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8d6e837d-8133-4d17-8008-79bec5ed1904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:26.780984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8d6e837d-8133-4d17-8008-79bec5ed1904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:26.782546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1223/2436] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:33:26 2022] DELETE /identity/v3/projects/0d6972c4589e49d4b23dcbbef8fa8a91 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:33:36.398619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=50,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:36.776999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=61,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:37.436974 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e403ff-f492-4f41-960d-bccab9bf25c4 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:37.439266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-16e403ff-f492-4f41-960d-bccab9bf25c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:37.498164 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e403ff-f492-4f41-960d-bccab9bf25c4 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:37.563671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bedfd8-33c9-42f8-a1c8-e2888034e769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:37.564705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bedfd8-33c9-42f8-a1c8-e2888034e769 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:37.564982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bedfd8-33c9-42f8-a1c8-e2888034e769 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:37.565250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bedfd8-33c9-42f8-a1c8-e2888034e769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:37.567305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b4bedfd8-33c9-42f8-a1c8-e2888034e769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:37.629531 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bedfd8-33c9-42f8-a1c8-e2888034e769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:37.631005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bedfd8-33c9-42f8-a1c8-e2888034e769 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:37.640709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1214/2437] 10.222.0.26 () {60 vars in 1396 bytes} [Tue Jul 12 03:33:37 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:33:42.996433 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e837d-8133-4d17-8008-79bec5ed1904 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:42.997991 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8d6e837d-8133-4d17-8008-79bec5ed1904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:43.012165 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e837d-8133-4d17-8008-79bec5ed1904 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:43.016374 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eab3e-8ee1-4167-b9ea-4e7825230fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:43.017070 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eab3e-8ee1-4167-b9ea-4e7825230fbb service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:43.017352 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eab3e-8ee1-4167-b9ea-4e7825230fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:43.017632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eab3e-8ee1-4167-b9ea-4e7825230fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:43.019507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-017eab3e-8ee1-4167-b9ea-4e7825230fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:43.090584 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017eab3e-8ee1-4167-b9ea-4e7825230fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:43.092829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017eab3e-8ee1-4167-b9ea-4e7825230fbb service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:43.103916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1224/2438] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:33:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:33:44.248900 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bedfd8-33c9-42f8-a1c8-e2888034e769 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:44.250509 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b4bedfd8-33c9-42f8-a1c8-e2888034e769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:44.332598 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bedfd8-33c9-42f8-a1c8-e2888034e769 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:44.338765 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f20ae-2318-4a58-af78-b453754fbc99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:44.339437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f20ae-2318-4a58-af78-b453754fbc99 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:44.339728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f20ae-2318-4a58-af78-b453754fbc99 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:44.339988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f20ae-2318-4a58-af78-b453754fbc99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:44.341834 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cd4f20ae-2318-4a58-af78-b453754fbc99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:44.348328 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:44.403939 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f20ae-2318-4a58-af78-b453754fbc99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:44.405577 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f20ae-2318-4a58-af78-b453754fbc99 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:44.415083 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1215/2439] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:33:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:33:46.583554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eab3e-8ee1-4167-b9ea-4e7825230fbb service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:46.585043 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-017eab3e-8ee1-4167-b9ea-4e7825230fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:46.653536 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f20ae-2318-4a58-af78-b453754fbc99 service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:46.655929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cd4f20ae-2318-4a58-af78-b453754fbc99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:46.673454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eab3e-8ee1-4167-b9ea-4e7825230fbb service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:46.674542 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f20ae-2318-4a58-af78-b453754fbc99 service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:46.678796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12858e1-93f0-4da5-956e-110ccb7cf63e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '361ad35021eb43cca46d9b66e6f24ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:46.679128 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c43fd-878c-4085-be7d-e804cec9b5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:46.679574 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12858e1-93f0-4da5-956e-110ccb7cf63e service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:46.679923 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12858e1-93f0-4da5-956e-110ccb7cf63e service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:46.680051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c43fd-878c-4085-be7d-e804cec9b5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:46.680263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c43fd-878c-4085-be7d-e804cec9b5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:46.680392 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12858e1-93f0-4da5-956e-110ccb7cf63e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:46.680837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c43fd-878c-4085-be7d-e804cec9b5a8 admin admin] PATH_INFO: `/v3/users/dbfe7a2a6c144b598057e446e426688e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:46.682282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c43fd-878c-4085-be7d-e804cec9b5a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbfe7a2a6c144b598057e446e426688e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:46.682847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b12858e1-93f0-4da5-956e-110ccb7cf63e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:46.684245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c43fd-878c-4085-be7d-e804cec9b5a8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:46.695567 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12858e1-93f0-4da5-956e-110ccb7cf63e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:46.697184 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12858e1-93f0-4da5-956e-110ccb7cf63e service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:46.710343 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1225/2440] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:33:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:33:46.747085 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-020c43fd-878c-4085-be7d-e804cec9b5a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbfe7a2a6c144b598057e446e426688e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:46.759097 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-020c43fd-878c-4085-be7d-e804cec9b5a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbfe7a2a6c144b598057e446e426688e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:46.775542 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-020c43fd-878c-4085-be7d-e804cec9b5a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbfe7a2a6c144b598057e446e426688e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:46.776253 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-020c43fd-878c-4085-be7d-e804cec9b5a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbfe7a2a6c144b598057e446e426688e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:46.783485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-020c43fd-878c-4085-be7d-e804cec9b5a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbfe7a2a6c144b598057e446e426688e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:46.789407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1216/2441] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:33:46 2022] DELETE /identity/v3/users/dbfe7a2a6c144b598057e446e426688e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:33:46.985711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12858e1-93f0-4da5-956e-110ccb7cf63e service placement] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:46.996747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12858e1-93f0-4da5-956e-110ccb7cf63e service placement] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:47.064235 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75c3ae-1ecb-4167-a91f-e95fe3adb450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:47.065144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75c3ae-1ecb-4167-a91f-e95fe3adb450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:47.065437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75c3ae-1ecb-4167-a91f-e95fe3adb450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:47.065714 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75c3ae-1ecb-4167-a91f-e95fe3adb450 admin admin] PATH_INFO: `/v3/projects/8ddb4f7232324cb59ce0179c4209302a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:47.067038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75c3ae-1ecb-4167-a91f-e95fe3adb450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ddb4f7232324cb59ce0179c4209302a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:47.069019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75c3ae-1ecb-4167-a91f-e95fe3adb450 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:47.104683 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:47.126049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8b75c3ae-1ecb-4167-a91f-e95fe3adb450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ddb4f7232324cb59ce0179c4209302a', 'request_id': 'req-8b75c3ae-1ecb-4167-a91f-e95fe3adb450'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:47.134981 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8b75c3ae-1ecb-4167-a91f-e95fe3adb450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ddb4f7232324cb59ce0179c4209302a', 'request_id': 'req-8b75c3ae-1ecb-4167-a91f-e95fe3adb450'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:47.142163 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8b75c3ae-1ecb-4167-a91f-e95fe3adb450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ddb4f7232324cb59ce0179c4209302a', 'request_id': 'req-8b75c3ae-1ecb-4167-a91f-e95fe3adb450'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:47.154090 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8b75c3ae-1ecb-4167-a91f-e95fe3adb450 admin admin] The token cache is being invalidate because project 8ddb4f7232324cb59ce0179c4209302a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:33:47.154549 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8b75c3ae-1ecb-4167-a91f-e95fe3adb450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:47.155508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8b75c3ae-1ecb-4167-a91f-e95fe3adb450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:47.157847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1226/2442] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:33:46 2022] DELETE /identity/v3/projects/8ddb4f7232324cb59ce0179c4209302a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:33:47.163263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94263946-dae4-48ed-a026-195dc05cce77 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:47.163558 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94263946-dae4-48ed-a026-195dc05cce77 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:47.163837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94263946-dae4-48ed-a026-195dc05cce77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:47.183768 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-94263946-dae4-48ed-a026-195dc05cce77 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:47.185034 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-94263946-dae4-48ed-a026-195dc05cce77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:47.259156 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1217/2443] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:33:47.271033 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab69118-a758-47fe-aa64-df91404f86a3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:47.271326 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab69118-a758-47fe-aa64-df91404f86a3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:47.271605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab69118-a758-47fe-aa64-df91404f86a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:47.290186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0ab69118-a758-47fe-aa64-df91404f86a3 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:47.291402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0ab69118-a758-47fe-aa64-df91404f86a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:47.299569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1227/2444] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:33:47.303900 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94263946-dae4-48ed-a026-195dc05cce77 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:47.313746 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94263946-dae4-48ed-a026-195dc05cce77 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:47.318553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945f89c-07d6-44c6-9985-16d7027478d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:47.319289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945f89c-07d6-44c6-9985-16d7027478d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:47.319653 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945f89c-07d6-44c6-9985-16d7027478d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:47.319993 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945f89c-07d6-44c6-9985-16d7027478d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:47.320920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945f89c-07d6-44c6-9985-16d7027478d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:33:47.321291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945f89c-07d6-44c6-9985-16d7027478d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:47.322956 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945f89c-07d6-44c6-9985-16d7027478d6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:47.339719 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1218/2445] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:33:47.340701 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab69118-a758-47fe-aa64-df91404f86a3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:47.351463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab69118-a758-47fe-aa64-df91404f86a3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:47.356108 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bba6d3-8522-487e-8f32-304456ee5802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:47.356849 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bba6d3-8522-487e-8f32-304456ee5802 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:47.357129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bba6d3-8522-487e-8f32-304456ee5802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:47.357403 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bba6d3-8522-487e-8f32-304456ee5802 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:47.358098 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bba6d3-8522-487e-8f32-304456ee5802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:47.360144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bba6d3-8522-487e-8f32-304456ee5802 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:47.389613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1228/2446] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:33:47 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:33:47.393953 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945f89c-07d6-44c6-9985-16d7027478d6 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:47.404465 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945f89c-07d6-44c6-9985-16d7027478d6 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:47.409924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:47.475421 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e7f4a-351b-4d6d-b9ad-827753f40f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:47.476183 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e7f4a-351b-4d6d-b9ad-827753f40f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:47.476546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e7f4a-351b-4d6d-b9ad-827753f40f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:47.477096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e7f4a-351b-4d6d-b9ad-827753f40f65 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:47.477933 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e7f4a-351b-4d6d-b9ad-827753f40f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:47.479950 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e7f4a-351b-4d6d-b9ad-827753f40f65 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:47.501295 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1219/2447] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:33:47 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:33:47.505389 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bba6d3-8522-487e-8f32-304456ee5802 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:47.516273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bba6d3-8522-487e-8f32-304456ee5802 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:47.521345 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab498ed7-11b3-48da-b42b-5d25a094ecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:47.522008 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab498ed7-11b3-48da-b42b-5d25a094ecfc admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:47.522296 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab498ed7-11b3-48da-b42b-5d25a094ecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:47.522568 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab498ed7-11b3-48da-b42b-5d25a094ecfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:47.524704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab498ed7-11b3-48da-b42b-5d25a094ecfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:47.524968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab498ed7-11b3-48da-b42b-5d25a094ecfc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:47.535734 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1229/2448] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:33:47.540066 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e7f4a-351b-4d6d-b9ad-827753f40f65 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:47.550462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e7f4a-351b-4d6d-b9ad-827753f40f65 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:47.555291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84e3c4-7ddf-41f4-8f09-c9f8debe9a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:47.555957 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84e3c4-7ddf-41f4-8f09-c9f8debe9a40 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:47.556241 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84e3c4-7ddf-41f4-8f09-c9f8debe9a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:47.556530 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84e3c4-7ddf-41f4-8f09-c9f8debe9a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:47.557268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84e3c4-7ddf-41f4-8f09-c9f8debe9a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:47.558934 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84e3c4-7ddf-41f4-8f09-c9f8debe9a40 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:47.575093 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1220/2449] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:33:47.582808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab498ed7-11b3-48da-b42b-5d25a094ecfc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:47.596241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab498ed7-11b3-48da-b42b-5d25a094ecfc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:47.601690 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8efd9-2345-4192-ba76-7db5876a7fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:47.602664 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8efd9-2345-4192-ba76-7db5876a7fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:47.603033 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8efd9-2345-4192-ba76-7db5876a7fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:47.603372 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8efd9-2345-4192-ba76-7db5876a7fdb admin admin] PATH_INFO: `/v3/projects/7f95890041894cb0931f48fec7018a5e/users/02a34732d5c74585b90d5e0b96897505/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:47.621023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8efd9-2345-4192-ba76-7db5876a7fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f95890041894cb0931f48fec7018a5e, user_id=02a34732d5c74585b90d5e0b96897505, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:47.623793 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8efd9-2345-4192-ba76-7db5876a7fdb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:47.641516 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1230/2450] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:33:47 2022] PUT /identity/v3/projects/7f95890041894cb0931f48fec7018a5e/users/02a34732d5c74585b90d5e0b96897505/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:33:47.651838 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aeb87-40eb-45ec-9d3a-5fd1042414f4 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:47.652057 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aeb87-40eb-45ec-9d3a-5fd1042414f4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:47.652324 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aeb87-40eb-45ec-9d3a-5fd1042414f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:47.685030 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-094aeb87-40eb-45ec-9d3a-5fd1042414f4 None None] MFA Rules not processed for user `02a34732d5c74585b90d5e0b96897505`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:47.686282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-094aeb87-40eb-45ec-9d3a-5fd1042414f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:47.755250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1221/2451] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:33:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:33:47.772290 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8efd9-2345-4192-ba76-7db5876a7fdb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:47.775367 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7fb8efd9-2345-4192-ba76-7db5876a7fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:47.841632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8efd9-2345-4192-ba76-7db5876a7fdb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:47.845985 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c6ace-ba6a-48e8-a8d3-fa8f33b8b95b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:47.846653 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c6ace-ba6a-48e8-a8d3-fa8f33b8b95b service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:47.846937 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c6ace-ba6a-48e8-a8d3-fa8f33b8b95b service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:47.847214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c6ace-ba6a-48e8-a8d3-fa8f33b8b95b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:47.856013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c6ace-ba6a-48e8-a8d3-fa8f33b8b95b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:47.857495 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c6ace-ba6a-48e8-a8d3-fa8f33b8b95b service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:47.866677 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1231/2452] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:33:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:33:56.242824 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094aeb87-40eb-45ec-9d3a-5fd1042414f4 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:56.316665 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094aeb87-40eb-45ec-9d3a-5fd1042414f4 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:56.321411 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3e01d-c346-4896-ad94-7def971cfa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:56.322286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3e01d-c346-4896-ad94-7def971cfa2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:56.322568 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3e01d-c346-4896-ad94-7def971cfa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:56.322839 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3e01d-c346-4896-ad94-7def971cfa2b admin admin] PATH_INFO: `/v3/users/02a34732d5c74585b90d5e0b96897505` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:56.324088 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3e01d-c346-4896-ad94-7def971cfa2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a34732d5c74585b90d5e0b96897505)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:56.326074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3e01d-c346-4896-ad94-7def971cfa2b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:56.341957 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:56.375533 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-18a3e01d-c346-4896-ad94-7def971cfa2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a34732d5c74585b90d5e0b96897505'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:56.386535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-18a3e01d-c346-4896-ad94-7def971cfa2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a34732d5c74585b90d5e0b96897505'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:56.398568 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-18a3e01d-c346-4896-ad94-7def971cfa2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a34732d5c74585b90d5e0b96897505'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:56.399197 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-18a3e01d-c346-4896-ad94-7def971cfa2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a34732d5c74585b90d5e0b96897505'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:56.406109 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-18a3e01d-c346-4896-ad94-7def971cfa2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a34732d5c74585b90d5e0b96897505'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:56.411985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1222/2453] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:33:56 2022] DELETE /identity/v3/users/02a34732d5c74585b90d5e0b96897505 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:33:56.416683 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34450024-adb7-41ed-affe-46935c671aa6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:56.417180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34450024-adb7-41ed-affe-46935c671aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:56.417273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34450024-adb7-41ed-affe-46935c671aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:56.435193 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-34450024-adb7-41ed-affe-46935c671aa6 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:56.436362 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-34450024-adb7-41ed-affe-46935c671aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:56.487941 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:56.503325 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1232/2454] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:33:56.514271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3e01d-c346-4896-ad94-7def971cfa2b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:56.515995 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-18a3e01d-c346-4896-ad94-7def971cfa2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:56.576568 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3e01d-c346-4896-ad94-7def971cfa2b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:56.581224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fbe5e-cf82-4118-8717-b63651de066a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:56.581873 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fbe5e-cf82-4118-8717-b63651de066a service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:56.582155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fbe5e-cf82-4118-8717-b63651de066a service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:56.582426 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fbe5e-cf82-4118-8717-b63651de066a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:56.593955 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fbe5e-cf82-4118-8717-b63651de066a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:56.595393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fbe5e-cf82-4118-8717-b63651de066a service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:56.605520 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1223/2455] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:33:56.753022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34450024-adb7-41ed-affe-46935c671aa6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:56.753637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-34450024-adb7-41ed-affe-46935c671aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:56.768241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34450024-adb7-41ed-affe-46935c671aa6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:56.772745 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978aba2-bfe1-45d9-8825-ca4b1a1db4c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:56.773459 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978aba2-bfe1-45d9-8825-ca4b1a1db4c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:56.773738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978aba2-bfe1-45d9-8825-ca4b1a1db4c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:56.774005 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978aba2-bfe1-45d9-8825-ca4b1a1db4c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:56.775955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5978aba2-bfe1-45d9-8825-ca4b1a1db4c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:56.788979 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978aba2-bfe1-45d9-8825-ca4b1a1db4c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:56.790457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978aba2-bfe1-45d9-8825-ca4b1a1db4c5 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:56.803289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1233/2456] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:33:56.903079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fbe5e-cf82-4118-8717-b63651de066a service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:56.904867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fc6fbe5e-cf82-4118-8717-b63651de066a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:56.922055 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fbe5e-cf82-4118-8717-b63651de066a service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:56.926923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36e79b-e73c-4daa-98bc-1373c4921031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:56.927792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36e79b-e73c-4daa-98bc-1373c4921031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:56.928094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36e79b-e73c-4daa-98bc-1373c4921031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:56.928613 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36e79b-e73c-4daa-98bc-1373c4921031 admin admin] PATH_INFO: `/v3/projects/7f95890041894cb0931f48fec7018a5e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:56.929926 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36e79b-e73c-4daa-98bc-1373c4921031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f95890041894cb0931f48fec7018a5e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:56.932307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36e79b-e73c-4daa-98bc-1373c4921031 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:56.982186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ca36e79b-e73c-4daa-98bc-1373c4921031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f95890041894cb0931f48fec7018a5e', 'request_id': 'req-ca36e79b-e73c-4daa-98bc-1373c4921031'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:56.990907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ca36e79b-e73c-4daa-98bc-1373c4921031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f95890041894cb0931f48fec7018a5e', 'request_id': 'req-ca36e79b-e73c-4daa-98bc-1373c4921031'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:56.996419 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ca36e79b-e73c-4daa-98bc-1373c4921031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f95890041894cb0931f48fec7018a5e', 'request_id': 'req-ca36e79b-e73c-4daa-98bc-1373c4921031'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:57.007642 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ca36e79b-e73c-4daa-98bc-1373c4921031 admin admin] The token cache is being invalidate because project 7f95890041894cb0931f48fec7018a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:33:57.007929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ca36e79b-e73c-4daa-98bc-1373c4921031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:57.008594 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ca36e79b-e73c-4daa-98bc-1373c4921031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:57.012601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1224/2457] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:33:56 2022] DELETE /identity/v3/projects/7f95890041894cb0931f48fec7018a5e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:33:57.015304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ecfe6-1221-4623-bb69-795975862d56 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:57.015782 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ecfe6-1221-4623-bb69-795975862d56 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:57.016622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ecfe6-1221-4623-bb69-795975862d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:57.036688 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-aa3ecfe6-1221-4623-bb69-795975862d56 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:57.037900 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-aa3ecfe6-1221-4623-bb69-795975862d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:57.101554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1234/2458] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:33:57.110504 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bde1d7-c9d8-4704-98c7-b9a7aca26661 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:57.110833 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bde1d7-c9d8-4704-98c7-b9a7aca26661 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:57.111119 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bde1d7-c9d8-4704-98c7-b9a7aca26661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:57.130357 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-58bde1d7-c9d8-4704-98c7-b9a7aca26661 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:57.131577 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-58bde1d7-c9d8-4704-98c7-b9a7aca26661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:57.139397 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1225/2459] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:33:57.144365 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ecfe6-1221-4623-bb69-795975862d56 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:57.154453 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ecfe6-1221-4623-bb69-795975862d56 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:57.161111 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01450aeb-040e-4228-a3a2-ab877e9dace3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:57.161906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01450aeb-040e-4228-a3a2-ab877e9dace3 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:57.162188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01450aeb-040e-4228-a3a2-ab877e9dace3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:57.162478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01450aeb-040e-4228-a3a2-ab877e9dace3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:57.163209 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01450aeb-040e-4228-a3a2-ab877e9dace3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:33:57.164217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01450aeb-040e-4228-a3a2-ab877e9dace3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:57.165854 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01450aeb-040e-4228-a3a2-ab877e9dace3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:57.177833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1235/2460] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:33:57.182165 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bde1d7-c9d8-4704-98c7-b9a7aca26661 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:57.191468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bde1d7-c9d8-4704-98c7-b9a7aca26661 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:57.196176 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60289af-aab4-42eb-acfb-22dc6952ce27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:57.196851 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60289af-aab4-42eb-acfb-22dc6952ce27 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:57.197128 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60289af-aab4-42eb-acfb-22dc6952ce27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:57.197398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60289af-aab4-42eb-acfb-22dc6952ce27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:57.198087 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60289af-aab4-42eb-acfb-22dc6952ce27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:57.199989 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60289af-aab4-42eb-acfb-22dc6952ce27 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:57.210373 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:57.229388 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1226/2461] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:33:57 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:33:57.233593 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01450aeb-040e-4228-a3a2-ab877e9dace3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:57.243982 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01450aeb-040e-4228-a3a2-ab877e9dace3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:57.301478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2557dd-b806-43db-b966-b681700d007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:57.302180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2557dd-b806-43db-b966-b681700d007d admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:57.302460 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2557dd-b806-43db-b966-b681700d007d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:57.302730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2557dd-b806-43db-b966-b681700d007d admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:57.303439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2557dd-b806-43db-b966-b681700d007d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:57.305398 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2557dd-b806-43db-b966-b681700d007d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:57.331525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1236/2462] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:33:57 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:33:57.335565 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60289af-aab4-42eb-acfb-22dc6952ce27 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:57.349351 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60289af-aab4-42eb-acfb-22dc6952ce27 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:57.355030 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beac867-51bb-4bd4-ad92-6e877aee3d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:57.355713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beac867-51bb-4bd4-ad92-6e877aee3d19 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:57.355996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beac867-51bb-4bd4-ad92-6e877aee3d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:57.356273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beac867-51bb-4bd4-ad92-6e877aee3d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:57.357049 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beac867-51bb-4bd4-ad92-6e877aee3d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:57.358675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beac867-51bb-4bd4-ad92-6e877aee3d19 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:57.372084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1227/2463] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:33:57.377193 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2557dd-b806-43db-b966-b681700d007d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:57.392299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2557dd-b806-43db-b966-b681700d007d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:57.397527 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfd4d8-8fa3-4020-b6c7-3eb7ae082678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:57.398201 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfd4d8-8fa3-4020-b6c7-3eb7ae082678 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:57.398486 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfd4d8-8fa3-4020-b6c7-3eb7ae082678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:57.398791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfd4d8-8fa3-4020-b6c7-3eb7ae082678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:57.399504 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfd4d8-8fa3-4020-b6c7-3eb7ae082678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:57.401153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfd4d8-8fa3-4020-b6c7-3eb7ae082678 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:57.416117 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1237/2464] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:33:57.417509 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beac867-51bb-4bd4-ad92-6e877aee3d19 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:57.430218 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beac867-51bb-4bd4-ad92-6e877aee3d19 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:57.435968 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92465a-b405-4065-8fd5-fd43bbb9f53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:57.436905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92465a-b405-4065-8fd5-fd43bbb9f53a admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:57.437186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92465a-b405-4065-8fd5-fd43bbb9f53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:57.437631 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92465a-b405-4065-8fd5-fd43bbb9f53a admin admin] PATH_INFO: `/v3/projects/af8612da0aef4f0fab969065116bd1f1/users/9da87f9bca1e4dda917761531f69b145/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:57.459486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92465a-b405-4065-8fd5-fd43bbb9f53a admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8612da0aef4f0fab969065116bd1f1, user_id=9da87f9bca1e4dda917761531f69b145, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:57.463437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92465a-b405-4065-8fd5-fd43bbb9f53a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:57.479911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1228/2465] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:33:57 2022] PUT /identity/v3/projects/af8612da0aef4f0fab969065116bd1f1/users/9da87f9bca1e4dda917761531f69b145/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:33:57.491637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e3a50-cbac-41fc-af85-b20439575918 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:57.492186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e3a50-cbac-41fc-af85-b20439575918 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:57.492186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e3a50-cbac-41fc-af85-b20439575918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:57.521641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-222e3a50-cbac-41fc-af85-b20439575918 None None] MFA Rules not processed for user `9da87f9bca1e4dda917761531f69b145`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:57.522907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-222e3a50-cbac-41fc-af85-b20439575918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:57.564282 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:57.597539 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1238/2466] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:33:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:33:57.608740 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92465a-b405-4065-8fd5-fd43bbb9f53a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:57.610626 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6e92465a-b405-4065-8fd5-fd43bbb9f53a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:57.693041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92465a-b405-4065-8fd5-fd43bbb9f53a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:57.699280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4c3e8-c313-4d84-996a-77dff25f9ca8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:57.699941 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4c3e8-c313-4d84-996a-77dff25f9ca8 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:57.700279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4c3e8-c313-4d84-996a-77dff25f9ca8 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:57.700656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4c3e8-c313-4d84-996a-77dff25f9ca8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:57.709710 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4c3e8-c313-4d84-996a-77dff25f9ca8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:57.711335 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4c3e8-c313-4d84-996a-77dff25f9ca8 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:57.721184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1229/2467] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:33:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:33:57.961299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e3a50-cbac-41fc-af85-b20439575918 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:58.024369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e3a50-cbac-41fc-af85-b20439575918 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:58.029751 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e405414-363c-40b8-83a8-c114a8ff51c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:58.030656 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e405414-363c-40b8-83a8-c114a8ff51c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:58.030900 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e405414-363c-40b8-83a8-c114a8ff51c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:58.031333 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e405414-363c-40b8-83a8-c114a8ff51c3 admin admin] PATH_INFO: `/v3/users/9da87f9bca1e4dda917761531f69b145` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:58.032699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e405414-363c-40b8-83a8-c114a8ff51c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9da87f9bca1e4dda917761531f69b145)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:58.034637 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e405414-363c-40b8-83a8-c114a8ff51c3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:58.085328 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1e405414-363c-40b8-83a8-c114a8ff51c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9da87f9bca1e4dda917761531f69b145'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:58.094744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1e405414-363c-40b8-83a8-c114a8ff51c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9da87f9bca1e4dda917761531f69b145'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:58.102365 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1e405414-363c-40b8-83a8-c114a8ff51c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9da87f9bca1e4dda917761531f69b145'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:58.103024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1e405414-363c-40b8-83a8-c114a8ff51c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9da87f9bca1e4dda917761531f69b145'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:58.115955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1e405414-363c-40b8-83a8-c114a8ff51c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9da87f9bca1e4dda917761531f69b145'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:58.122815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1239/2468] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:33:57 2022] DELETE /identity/v3/users/9da87f9bca1e4dda917761531f69b145 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:33:58.127277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd101de8-f150-430e-813b-392091133618 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:58.127494 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd101de8-f150-430e-813b-392091133618 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:58.127772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd101de8-f150-430e-813b-392091133618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:58.148029 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-bd101de8-f150-430e-813b-392091133618 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:58.149300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bd101de8-f150-430e-813b-392091133618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:58.211651 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1230/2469] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:33:58.221983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e405414-363c-40b8-83a8-c114a8ff51c3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:58.223521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1e405414-363c-40b8-83a8-c114a8ff51c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:58.293688 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e405414-363c-40b8-83a8-c114a8ff51c3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:58.297888 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba25c3b-350d-4568-9b2f-48414f5c3e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:58.299493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba25c3b-350d-4568-9b2f-48414f5c3e62 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:58.299493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba25c3b-350d-4568-9b2f-48414f5c3e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:58.299493 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba25c3b-350d-4568-9b2f-48414f5c3e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:58.309295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba25c3b-350d-4568-9b2f-48414f5c3e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:58.310745 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba25c3b-350d-4568-9b2f-48414f5c3e62 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:58.314903 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:58.322643 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1240/2470] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:33:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:33:58.619138 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd101de8-f150-430e-813b-392091133618 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:58.620662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bd101de8-f150-430e-813b-392091133618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:58.642736 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd101de8-f150-430e-813b-392091133618 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:58.658443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4077037-a309-4999-ba7f-14cf2945a24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:58.659519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4077037-a309-4999-ba7f-14cf2945a24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:58.659863 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4077037-a309-4999-ba7f-14cf2945a24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:58.660304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4077037-a309-4999-ba7f-14cf2945a24f admin admin] PATH_INFO: `/v3/projects/af8612da0aef4f0fab969065116bd1f1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:58.661645 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4077037-a309-4999-ba7f-14cf2945a24f admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8612da0aef4f0fab969065116bd1f1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:58.663580 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4077037-a309-4999-ba7f-14cf2945a24f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:58.726259 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:58.737890 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b4077037-a309-4999-ba7f-14cf2945a24f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8612da0aef4f0fab969065116bd1f1', 'request_id': 'req-b4077037-a309-4999-ba7f-14cf2945a24f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:58.750200 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b4077037-a309-4999-ba7f-14cf2945a24f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8612da0aef4f0fab969065116bd1f1', 'request_id': 'req-b4077037-a309-4999-ba7f-14cf2945a24f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:58.758034 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b4077037-a309-4999-ba7f-14cf2945a24f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8612da0aef4f0fab969065116bd1f1', 'request_id': 'req-b4077037-a309-4999-ba7f-14cf2945a24f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:58.774224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b4077037-a309-4999-ba7f-14cf2945a24f admin admin] The token cache is being invalidate because project af8612da0aef4f0fab969065116bd1f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:33:58.774527 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b4077037-a309-4999-ba7f-14cf2945a24f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:58.775182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b4077037-a309-4999-ba7f-14cf2945a24f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:33:58.777048 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1231/2471] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:33:58 2022] DELETE /identity/v3/projects/af8612da0aef4f0fab969065116bd1f1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:33:58.781822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc491-756e-4fe1-bb9d-6d54660609d2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:58.782357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc491-756e-4fe1-bb9d-6d54660609d2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:58.782357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc491-756e-4fe1-bb9d-6d54660609d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:58.801056 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bd4fc491-756e-4fe1-bb9d-6d54660609d2 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:58.802491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bd4fc491-756e-4fe1-bb9d-6d54660609d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:58.888346 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1241/2472] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:33:58.896494 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25013375-e550-47cd-9540-e9d9fe74acd3 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:58.896852 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25013375-e550-47cd-9540-e9d9fe74acd3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:58.897134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25013375-e550-47cd-9540-e9d9fe74acd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:58.915480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-25013375-e550-47cd-9540-e9d9fe74acd3 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:58.916717 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-25013375-e550-47cd-9540-e9d9fe74acd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:58.925246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1232/2473] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:33:58.929361 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fc491-756e-4fe1-bb9d-6d54660609d2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:58.939087 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fc491-756e-4fe1-bb9d-6d54660609d2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:58.943990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f7d73-f2f8-4b3a-b5cd-19d6e270f09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:58.944665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f7d73-f2f8-4b3a-b5cd-19d6e270f09c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:58.944961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f7d73-f2f8-4b3a-b5cd-19d6e270f09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:58.945213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f7d73-f2f8-4b3a-b5cd-19d6e270f09c admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:58.945946 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f7d73-f2f8-4b3a-b5cd-19d6e270f09c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:33:58.946245 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f7d73-f2f8-4b3a-b5cd-19d6e270f09c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:58.947847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f7d73-f2f8-4b3a-b5cd-19d6e270f09c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:58.959740 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1242/2474] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:33:58.964636 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25013375-e550-47cd-9540-e9d9fe74acd3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:58.974733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25013375-e550-47cd-9540-e9d9fe74acd3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:58.979728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aa8fa-d420-40b3-9f41-8227caa88f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:58.980390 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aa8fa-d420-40b3-9f41-8227caa88f0c admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:58.980690 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aa8fa-d420-40b3-9f41-8227caa88f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:58.980968 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aa8fa-d420-40b3-9f41-8227caa88f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:58.981674 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aa8fa-d420-40b3-9f41-8227caa88f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:58.983635 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aa8fa-d420-40b3-9f41-8227caa88f0c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:59.013752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1233/2475] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:33:58 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:33:59.015656 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f7d73-f2f8-4b3a-b5cd-19d6e270f09c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:59.026176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f7d73-f2f8-4b3a-b5cd-19d6e270f09c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:59.091134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cab417-1cf5-4f6e-881d-aeb6b71ea810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:59.091824 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cab417-1cf5-4f6e-881d-aeb6b71ea810 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:59.092102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cab417-1cf5-4f6e-881d-aeb6b71ea810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:59.092374 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cab417-1cf5-4f6e-881d-aeb6b71ea810 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:59.093110 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cab417-1cf5-4f6e-881d-aeb6b71ea810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:59.096055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cab417-1cf5-4f6e-881d-aeb6b71ea810 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:59.119646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1243/2476] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:33:59 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:33:59.123794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aa8fa-d420-40b3-9f41-8227caa88f0c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:59.134355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aa8fa-d420-40b3-9f41-8227caa88f0c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:59.139334 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e4325-6300-4935-8c51-d18ce84516d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:59.140291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e4325-6300-4935-8c51-d18ce84516d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:59.140291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e4325-6300-4935-8c51-d18ce84516d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:59.140511 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e4325-6300-4935-8c51-d18ce84516d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:59.141353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e4325-6300-4935-8c51-d18ce84516d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:59.142949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e4325-6300-4935-8c51-d18ce84516d8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:59.154198 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1234/2477] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:33:59.159404 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cab417-1cf5-4f6e-881d-aeb6b71ea810 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:59.171063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cab417-1cf5-4f6e-881d-aeb6b71ea810 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:59.177227 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd23048-9281-4dd4-894c-21b227297ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:59.178166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd23048-9281-4dd4-894c-21b227297ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:59.178738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd23048-9281-4dd4-894c-21b227297ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:59.179023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd23048-9281-4dd4-894c-21b227297ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:59.179932 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd23048-9281-4dd4-894c-21b227297ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:59.181613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd23048-9281-4dd4-894c-21b227297ad0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:59.196885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1244/2478] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:33:59.198609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e4325-6300-4935-8c51-d18ce84516d8 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:59.209201 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e4325-6300-4935-8c51-d18ce84516d8 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:59.214394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aee05f-8839-4a79-9557-146bd926d0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:59.215331 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aee05f-8839-4a79-9557-146bd926d0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:59.215756 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aee05f-8839-4a79-9557-146bd926d0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:59.216033 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aee05f-8839-4a79-9557-146bd926d0bc admin admin] PATH_INFO: `/v3/projects/80959d012bf64dfc897518cc3a6e7675/users/79cc607f89c348ebbcaa8205a4f20d48/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:59.232144 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aee05f-8839-4a79-9557-146bd926d0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=80959d012bf64dfc897518cc3a6e7675, user_id=79cc607f89c348ebbcaa8205a4f20d48, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:59.235687 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aee05f-8839-4a79-9557-146bd926d0bc admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:59.257240 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1235/2479] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:33:59 2022] PUT /identity/v3/projects/80959d012bf64dfc897518cc3a6e7675/users/79cc607f89c348ebbcaa8205a4f20d48/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:33:59.267953 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed6230-a991-4b48-a2a0-e07b1af174e8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:59.268243 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed6230-a991-4b48-a2a0-e07b1af174e8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:59.268709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed6230-a991-4b48-a2a0-e07b1af174e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:59.296168 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e0ed6230-a991-4b48-a2a0-e07b1af174e8 None None] MFA Rules not processed for user `79cc607f89c348ebbcaa8205a4f20d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:59.297947 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e0ed6230-a991-4b48-a2a0-e07b1af174e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:59.358882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:59.374255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1245/2480] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:33:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:33:59.378616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aee05f-8839-4a79-9557-146bd926d0bc admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:59.445632 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aee05f-8839-4a79-9557-146bd926d0bc admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:59.450443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621eba9-1440-49e9-9f1b-05e7978a172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:59.451106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621eba9-1440-49e9-9f1b-05e7978a172d admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:59.451386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621eba9-1440-49e9-9f1b-05e7978a172d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:59.451694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621eba9-1440-49e9-9f1b-05e7978a172d admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:59.452417 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621eba9-1440-49e9-9f1b-05e7978a172d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:59.454938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621eba9-1440-49e9-9f1b-05e7978a172d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:59.483858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1236/2481] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:33:59 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:33:59.488029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed6230-a991-4b48-a2a0-e07b1af174e8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:59.500072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed6230-a991-4b48-a2a0-e07b1af174e8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:59.561308 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec8a30-44d5-4116-ad14-ad379edc7930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:59.561958 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec8a30-44d5-4116-ad14-ad379edc7930 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:59.562380 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec8a30-44d5-4116-ad14-ad379edc7930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:59.562655 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec8a30-44d5-4116-ad14-ad379edc7930 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:59.563344 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec8a30-44d5-4116-ad14-ad379edc7930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:59.565319 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec8a30-44d5-4116-ad14-ad379edc7930 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:59.590461 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1246/2482] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:33:59 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:33:59.594996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621eba9-1440-49e9-9f1b-05e7978a172d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:59.608978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621eba9-1440-49e9-9f1b-05e7978a172d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:59.616069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a72d05-7f79-4ff4-a020-c53fd50d296d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:59.617477 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a72d05-7f79-4ff4-a020-c53fd50d296d admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:59.619798 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a72d05-7f79-4ff4-a020-c53fd50d296d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:59.619798 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a72d05-7f79-4ff4-a020-c53fd50d296d admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:59.619798 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a72d05-7f79-4ff4-a020-c53fd50d296d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:59.621137 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a72d05-7f79-4ff4-a020-c53fd50d296d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:59.666643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1237/2483] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:33:59.670981 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec8a30-44d5-4116-ad14-ad379edc7930 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:59.686537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec8a30-44d5-4116-ad14-ad379edc7930 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:59.693965 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc24a6-1ca8-45c4-aed3-682573c5e98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:59.695621 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc24a6-1ca8-45c4-aed3-682573c5e98a admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:59.696153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc24a6-1ca8-45c4-aed3-682573c5e98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:59.696500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc24a6-1ca8-45c4-aed3-682573c5e98a admin admin] PATH_INFO: `/v3/projects/c44abe75b0154bfd90a5cc3838940140/users/420365d798de46ee97f6dc616d795892/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:59.720770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc24a6-1ca8-45c4-aed3-682573c5e98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44abe75b0154bfd90a5cc3838940140, user_id=420365d798de46ee97f6dc616d795892, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:59.723704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc24a6-1ca8-45c4-aed3-682573c5e98a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:59.744029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1247/2484] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:33:59 2022] PUT /identity/v3/projects/c44abe75b0154bfd90a5cc3838940140/users/420365d798de46ee97f6dc616d795892/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:33:59.748110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a72d05-7f79-4ff4-a020-c53fd50d296d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:59.759943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a72d05-7f79-4ff4-a020-c53fd50d296d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:59.809124 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:33:59.838115 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde55551-c62d-418a-9115-e6ab468efca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:59.838728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde55551-c62d-418a-9115-e6ab468efca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:59.839006 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde55551-c62d-418a-9115-e6ab468efca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:59.839276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde55551-c62d-418a-9115-e6ab468efca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:59.840000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde55551-c62d-418a-9115-e6ab468efca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:59.841638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde55551-c62d-418a-9115-e6ab468efca8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:59.867297 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1238/2485] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:33:59.871323 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc24a6-1ca8-45c4-aed3-682573c5e98a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:59.882862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc24a6-1ca8-45c4-aed3-682573c5e98a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:59.901186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae483c-8a39-4220-8cf3-1726ce700ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:33:59.902478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae483c-8a39-4220-8cf3-1726ce700ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:59.902942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae483c-8a39-4220-8cf3-1726ce700ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:59.903217 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae483c-8a39-4220-8cf3-1726ce700ad9 admin admin] PATH_INFO: `/v3/projects/c44abe75b0154bfd90a5cc3838940140/users/420365d798de46ee97f6dc616d795892/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:59.905791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae483c-8a39-4220-8cf3-1726ce700ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44abe75b0154bfd90a5cc3838940140, user_id=420365d798de46ee97f6dc616d795892, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:33:59.908736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae483c-8a39-4220-8cf3-1726ce700ad9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:33:59.916353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde55551-c62d-418a-9115-e6ab468efca8 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:33:59.919213 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fde55551-c62d-418a-9115-e6ab468efca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:33:59.928829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1248/2486] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:33:59 2022] PUT /identity/v3/projects/c44abe75b0154bfd90a5cc3838940140/users/420365d798de46ee97f6dc616d795892/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:33:59.936251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9838af3-b739-4706-8975-d6ff7cb8ed46 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:33:59.936753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9838af3-b739-4706-8975-d6ff7cb8ed46 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:33:59.937180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9838af3-b739-4706-8975-d6ff7cb8ed46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:33:59.942938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde55551-c62d-418a-9115-e6ab468efca8 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:33:59.966968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d9838af3-b739-4706-8975-d6ff7cb8ed46 None None] MFA Rules not processed for user `420365d798de46ee97f6dc616d795892`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:33:59.968177 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d9838af3-b739-4706-8975-d6ff7cb8ed46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:00.008169 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdafb1-3775-495b-b49f-f76b419ad259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:00.009096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdafb1-3775-495b-b49f-f76b419ad259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:00.009374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdafb1-3775-495b-b49f-f76b419ad259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:00.009645 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdafb1-3775-495b-b49f-f76b419ad259 admin admin] PATH_INFO: `/v3/users/d8e90b4b09dd453f9685fb034227a136` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:00.010975 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abdafb1-3775-495b-b49f-f76b419ad259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e90b4b09dd453f9685fb034227a136)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:00.012975 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abdafb1-3775-495b-b49f-f76b419ad259 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:00.036492 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1249/2487] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:33:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:34:00.049257 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9838af3-b739-4706-8975-d6ff7cb8ed46 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:00.050654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d9838af3-b739-4706-8975-d6ff7cb8ed46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:00.062026 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1abdafb1-3775-495b-b49f-f76b419ad259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e90b4b09dd453f9685fb034227a136'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:00.071327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1abdafb1-3775-495b-b49f-f76b419ad259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e90b4b09dd453f9685fb034227a136'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:00.084432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1abdafb1-3775-495b-b49f-f76b419ad259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e90b4b09dd453f9685fb034227a136'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:00.085208 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1abdafb1-3775-495b-b49f-f76b419ad259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e90b4b09dd453f9685fb034227a136'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:00.088450 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:00.092997 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1abdafb1-3775-495b-b49f-f76b419ad259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e90b4b09dd453f9685fb034227a136'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:00.099360 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1239/2488] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:33:59 2022] DELETE /identity/v3/users/d8e90b4b09dd453f9685fb034227a136 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:34:00.115059 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9838af3-b739-4706-8975-d6ff7cb8ed46 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:00.165153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d47665-6fbd-4a05-8809-77fb100ade9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:00.165808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d47665-6fbd-4a05-8809-77fb100ade9a service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:00.166089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d47665-6fbd-4a05-8809-77fb100ade9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:00.166414 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d47665-6fbd-4a05-8809-77fb100ade9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:00.168330 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-09d47665-6fbd-4a05-8809-77fb100ade9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:00.231107 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d47665-6fbd-4a05-8809-77fb100ade9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:00.232577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d47665-6fbd-4a05-8809-77fb100ade9a service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:00.242605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1250/2489] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:34:00.287487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdafb1-3775-495b-b49f-f76b419ad259 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:00.289000 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1abdafb1-3775-495b-b49f-f76b419ad259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:00.323449 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d47665-6fbd-4a05-8809-77fb100ade9a service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:00.325224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-09d47665-6fbd-4a05-8809-77fb100ade9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:00.336345 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d47665-6fbd-4a05-8809-77fb100ade9a service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:00.340712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d2640-d464-4c98-8739-b6fe321b27c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:00.341354 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d2640-d464-4c98-8739-b6fe321b27c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:00.341627 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d2640-d464-4c98-8739-b6fe321b27c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:00.341887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d2640-d464-4c98-8739-b6fe321b27c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:00.343785 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bb1d2640-d464-4c98-8739-b6fe321b27c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:00.352035 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:00.366763 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdafb1-3775-495b-b49f-f76b419ad259 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:00.371764 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d653ba-4441-4ae8-ba84-249220e4b79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:00.372666 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d653ba-4441-4ae8-ba84-249220e4b79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:00.372944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d653ba-4441-4ae8-ba84-249220e4b79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:00.373215 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d653ba-4441-4ae8-ba84-249220e4b79a admin admin] PATH_INFO: `/v3/projects/4ddbdc81b7564c5aa540ef560e066042` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:00.374373 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d653ba-4441-4ae8-ba84-249220e4b79a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ddbdc81b7564c5aa540ef560e066042)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:00.376487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d653ba-4441-4ae8-ba84-249220e4b79a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:00.422300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d2640-d464-4c98-8739-b6fe321b27c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:00.423828 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d2640-d464-4c98-8739-b6fe321b27c0 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:00.430575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-99d653ba-4441-4ae8-ba84-249220e4b79a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ddbdc81b7564c5aa540ef560e066042', 'request_id': 'req-99d653ba-4441-4ae8-ba84-249220e4b79a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:00.433187 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1251/2490] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:34:00.438360 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-99d653ba-4441-4ae8-ba84-249220e4b79a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ddbdc81b7564c5aa540ef560e066042', 'request_id': 'req-99d653ba-4441-4ae8-ba84-249220e4b79a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:00.444408 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-99d653ba-4441-4ae8-ba84-249220e4b79a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ddbdc81b7564c5aa540ef560e066042', 'request_id': 'req-99d653ba-4441-4ae8-ba84-249220e4b79a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:00.457067 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-99d653ba-4441-4ae8-ba84-249220e4b79a admin admin] The token cache is being invalidate because project 4ddbdc81b7564c5aa540ef560e066042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:34:00.457348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-99d653ba-4441-4ae8-ba84-249220e4b79a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:00.458108 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-99d653ba-4441-4ae8-ba84-249220e4b79a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:00.459885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1240/2491] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:34:00 2022] DELETE /identity/v3/projects/4ddbdc81b7564c5aa540ef560e066042 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:00.465114 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57282d6-bbb6-418d-b5ea-ee02be7df384 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:00.465420 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57282d6-bbb6-418d-b5ea-ee02be7df384 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:00.465662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57282d6-bbb6-418d-b5ea-ee02be7df384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:00.484825 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d57282d6-bbb6-418d-b5ea-ee02be7df384 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:00.486070 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d57282d6-bbb6-418d-b5ea-ee02be7df384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:00.521414 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:00.563457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1252/2492] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:00.565333 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6a21c-6b34-4331-9dbf-8bfad41ac82d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:00.565648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6a21c-6b34-4331-9dbf-8bfad41ac82d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:00.565952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6a21c-6b34-4331-9dbf-8bfad41ac82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:00.586648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-54c6a21c-6b34-4331-9dbf-8bfad41ac82d None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:00.588202 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-54c6a21c-6b34-4331-9dbf-8bfad41ac82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:00.597119 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1241/2493] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:00.601391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57282d6-bbb6-418d-b5ea-ee02be7df384 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:00.611601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57282d6-bbb6-418d-b5ea-ee02be7df384 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:00.616449 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb41f79-2414-45e0-a0ce-349ce11c16f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:00.617203 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb41f79-2414-45e0-a0ce-349ce11c16f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:00.617479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb41f79-2414-45e0-a0ce-349ce11c16f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:00.617750 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb41f79-2414-45e0-a0ce-349ce11c16f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:00.618510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb41f79-2414-45e0-a0ce-349ce11c16f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:34:00.618812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb41f79-2414-45e0-a0ce-349ce11c16f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:00.620449 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb41f79-2414-45e0-a0ce-349ce11c16f4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:00.632762 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1253/2494] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:34:00.637287 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6a21c-6b34-4331-9dbf-8bfad41ac82d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:00.647018 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6a21c-6b34-4331-9dbf-8bfad41ac82d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:00.652069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b939e48-20a7-4e71-9c8b-10a8cd87a525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:00.652738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b939e48-20a7-4e71-9c8b-10a8cd87a525 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:00.653012 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b939e48-20a7-4e71-9c8b-10a8cd87a525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:00.653281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b939e48-20a7-4e71-9c8b-10a8cd87a525 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:00.653968 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b939e48-20a7-4e71-9c8b-10a8cd87a525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:00.655877 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b939e48-20a7-4e71-9c8b-10a8cd87a525 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:00.686718 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1242/2495] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:34:00 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:34:00.687949 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb41f79-2414-45e0-a0ce-349ce11c16f4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:00.698449 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb41f79-2414-45e0-a0ce-349ce11c16f4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:00.764072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb17e73-2ea1-4652-b7fc-b55b2b00e2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:00.764833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb17e73-2ea1-4652-b7fc-b55b2b00e2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:00.765120 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb17e73-2ea1-4652-b7fc-b55b2b00e2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:00.765638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb17e73-2ea1-4652-b7fc-b55b2b00e2c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:00.766159 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb17e73-2ea1-4652-b7fc-b55b2b00e2c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:00.768103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb17e73-2ea1-4652-b7fc-b55b2b00e2c9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:00.792961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1254/2496] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:34:00 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:00.794918 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b939e48-20a7-4e71-9c8b-10a8cd87a525 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:00.806239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b939e48-20a7-4e71-9c8b-10a8cd87a525 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:00.811724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e1dc1-3812-45c5-8ea8-636affe25596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:00.812378 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e1dc1-3812-45c5-8ea8-636affe25596 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:00.812713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e1dc1-3812-45c5-8ea8-636affe25596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:00.812986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e1dc1-3812-45c5-8ea8-636affe25596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:00.813709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e1dc1-3812-45c5-8ea8-636affe25596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:00.815312 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e1dc1-3812-45c5-8ea8-636affe25596 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:00.827709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1243/2497] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:00.832000 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb17e73-2ea1-4652-b7fc-b55b2b00e2c9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:00.842625 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb17e73-2ea1-4652-b7fc-b55b2b00e2c9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:00.847958 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90376a7e-e999-4e1b-9d62-1faf3c1ddca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:00.848670 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90376a7e-e999-4e1b-9d62-1faf3c1ddca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:00.848950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90376a7e-e999-4e1b-9d62-1faf3c1ddca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:00.849219 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90376a7e-e999-4e1b-9d62-1faf3c1ddca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:00.849970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90376a7e-e999-4e1b-9d62-1faf3c1ddca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:00.851599 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90376a7e-e999-4e1b-9d62-1faf3c1ddca5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:00.862542 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1255/2498] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:00.866750 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e1dc1-3812-45c5-8ea8-636affe25596 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:00.877331 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e1dc1-3812-45c5-8ea8-636affe25596 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:00.882144 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fdb09-2256-46ff-8f5e-c0ab4e3ac522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:00.883014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fdb09-2256-46ff-8f5e-c0ab4e3ac522 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:00.883299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fdb09-2256-46ff-8f5e-c0ab4e3ac522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:00.883571 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fdb09-2256-46ff-8f5e-c0ab4e3ac522 admin admin] PATH_INFO: `/v3/projects/df05ebed40db4e4790bfeac6cc49fde7/users/910c24ed7bdb41f6b444e58576063fda/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:00.898839 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fdb09-2256-46ff-8f5e-c0ab4e3ac522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df05ebed40db4e4790bfeac6cc49fde7, user_id=910c24ed7bdb41f6b444e58576063fda, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:00.901532 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fdb09-2256-46ff-8f5e-c0ab4e3ac522 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:00.916209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1244/2499] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:00 2022] PUT /identity/v3/projects/df05ebed40db4e4790bfeac6cc49fde7/users/910c24ed7bdb41f6b444e58576063fda/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:00.927306 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18629ff-7fa8-428e-a143-6126097a9075 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:00.927792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18629ff-7fa8-428e-a143-6126097a9075 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:00.927908 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18629ff-7fa8-428e-a143-6126097a9075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:00.955239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f18629ff-7fa8-428e-a143-6126097a9075 None None] MFA Rules not processed for user `910c24ed7bdb41f6b444e58576063fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:00.957147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f18629ff-7fa8-428e-a143-6126097a9075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:01.032634 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1256/2500] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:01.037243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fdb09-2256-46ff-8f5e-c0ab4e3ac522 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:01.103100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fdb09-2256-46ff-8f5e-c0ab4e3ac522 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:01.107995 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a986b-2a0c-4a9e-86a5-1230be10049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:01.108679 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a986b-2a0c-4a9e-86a5-1230be10049c admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:01.108955 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a986b-2a0c-4a9e-86a5-1230be10049c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:01.109289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a986b-2a0c-4a9e-86a5-1230be10049c admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:01.110099 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a986b-2a0c-4a9e-86a5-1230be10049c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:01.111995 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a986b-2a0c-4a9e-86a5-1230be10049c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:01.141177 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1245/2501] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:34:01 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:34:01.145727 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18629ff-7fa8-428e-a143-6126097a9075 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:01.156803 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18629ff-7fa8-428e-a143-6126097a9075 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:01.194658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:01.225586 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28b3f9-dfed-41d9-92e0-83f206bce4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:01.226272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28b3f9-dfed-41d9-92e0-83f206bce4bf admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:01.226544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28b3f9-dfed-41d9-92e0-83f206bce4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:01.226816 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28b3f9-dfed-41d9-92e0-83f206bce4bf admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:01.227505 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28b3f9-dfed-41d9-92e0-83f206bce4bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:01.229485 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28b3f9-dfed-41d9-92e0-83f206bce4bf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:01.252613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1257/2502] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:34:01 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:01.256691 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a986b-2a0c-4a9e-86a5-1230be10049c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:01.262417 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:01.268815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a986b-2a0c-4a9e-86a5-1230be10049c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:01.274728 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09168a-17a2-4902-8b29-0a69127baa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:01.275394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09168a-17a2-4902-8b29-0a69127baa93 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:01.275672 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09168a-17a2-4902-8b29-0a69127baa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:01.275944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09168a-17a2-4902-8b29-0a69127baa93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:01.276707 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09168a-17a2-4902-8b29-0a69127baa93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:01.278314 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09168a-17a2-4902-8b29-0a69127baa93 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:01.289129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1246/2503] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:01.293418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28b3f9-dfed-41d9-92e0-83f206bce4bf admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:01.304382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28b3f9-dfed-41d9-92e0-83f206bce4bf admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:01.309926 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bcac7-e615-4df8-ab01-df888e1b2ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:01.310815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bcac7-e615-4df8-ab01-df888e1b2ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:01.311092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bcac7-e615-4df8-ab01-df888e1b2ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:01.311358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bcac7-e615-4df8-ab01-df888e1b2ba8 admin admin] PATH_INFO: `/v3/projects/bdd4cceb844146eab8362d7029a38259/users/3da5708d56d54965aa99b443b1fa61d4/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:01.328315 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bcac7-e615-4df8-ab01-df888e1b2ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd4cceb844146eab8362d7029a38259, user_id=3da5708d56d54965aa99b443b1fa61d4, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:01.331022 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bcac7-e615-4df8-ab01-df888e1b2ba8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:01.346611 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1258/2504] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:01 2022] PUT /identity/v3/projects/bdd4cceb844146eab8362d7029a38259/users/3da5708d56d54965aa99b443b1fa61d4/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:01.350242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09168a-17a2-4902-8b29-0a69127baa93 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:01.360839 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09168a-17a2-4902-8b29-0a69127baa93 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:01.419199 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72faf5a-f696-43af-8191-9996d8867e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:01.419886 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72faf5a-f696-43af-8191-9996d8867e18 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:01.420121 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72faf5a-f696-43af-8191-9996d8867e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:01.420418 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72faf5a-f696-43af-8191-9996d8867e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:01.421191 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72faf5a-f696-43af-8191-9996d8867e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:01.422874 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72faf5a-f696-43af-8191-9996d8867e18 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:01.432486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1247/2505] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:01.436801 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bcac7-e615-4df8-ab01-df888e1b2ba8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:01.448017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bcac7-e615-4df8-ab01-df888e1b2ba8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:01.453202 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695419de-f184-4f31-9d47-818bc49f55ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:01.454219 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695419de-f184-4f31-9d47-818bc49f55ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:01.454508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695419de-f184-4f31-9d47-818bc49f55ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:01.454723 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695419de-f184-4f31-9d47-818bc49f55ba admin admin] PATH_INFO: `/v3/projects/bdd4cceb844146eab8362d7029a38259/users/3da5708d56d54965aa99b443b1fa61d4/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:01.457023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695419de-f184-4f31-9d47-818bc49f55ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd4cceb844146eab8362d7029a38259, user_id=3da5708d56d54965aa99b443b1fa61d4, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:01.459672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695419de-f184-4f31-9d47-818bc49f55ba admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:01.471243 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1259/2506] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:01 2022] PUT /identity/v3/projects/bdd4cceb844146eab8362d7029a38259/users/3da5708d56d54965aa99b443b1fa61d4/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:01.481581 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10645145-41cb-42b2-844b-a4d3cea6ad0d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:01.481976 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10645145-41cb-42b2-844b-a4d3cea6ad0d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:01.482256 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10645145-41cb-42b2-844b-a4d3cea6ad0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:01.509836 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-10645145-41cb-42b2-844b-a4d3cea6ad0d None None] MFA Rules not processed for user `3da5708d56d54965aa99b443b1fa61d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:01.511024 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-10645145-41cb-42b2-844b-a4d3cea6ad0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:01.581210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1248/2507] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:34:01.593576 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695419de-f184-4f31-9d47-818bc49f55ba admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:01.595254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-695419de-f184-4f31-9d47-818bc49f55ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:01.654153 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695419de-f184-4f31-9d47-818bc49f55ba admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:01.658465 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0f001-162e-4541-bcea-8e2bddfaf5c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:01.659143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0f001-162e-4541-bcea-8e2bddfaf5c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:01.659425 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0f001-162e-4541-bcea-8e2bddfaf5c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:01.659696 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0f001-162e-4541-bcea-8e2bddfaf5c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:01.720242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0f001-162e-4541-bcea-8e2bddfaf5c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:01.721746 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0f001-162e-4541-bcea-8e2bddfaf5c8 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:01.732095 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1260/2508] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:03.103818 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10645145-41cb-42b2-844b-a4d3cea6ad0d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:03.114045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10645145-41cb-42b2-844b-a4d3cea6ad0d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:03.118814 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451d1e6-8679-4c52-bbb9-8ee74e42381b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:03.119498 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451d1e6-8679-4c52-bbb9-8ee74e42381b service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:03.119829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451d1e6-8679-4c52-bbb9-8ee74e42381b service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:03.120100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451d1e6-8679-4c52-bbb9-8ee74e42381b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:03.129736 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451d1e6-8679-4c52-bbb9-8ee74e42381b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:03.131156 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451d1e6-8679-4c52-bbb9-8ee74e42381b service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:03.141006 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1249/2509] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:06.947434 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0f001-162e-4541-bcea-8e2bddfaf5c8 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:06.990731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:07.015257 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0f001-162e-4541-bcea-8e2bddfaf5c8 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:07.021073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe48f01-f472-4b96-bea6-2e0eb6ddaef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:07.021998 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe48f01-f472-4b96-bea6-2e0eb6ddaef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:07.022305 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe48f01-f472-4b96-bea6-2e0eb6ddaef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:07.022579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe48f01-f472-4b96-bea6-2e0eb6ddaef9 admin admin] PATH_INFO: `/v3/users/910c24ed7bdb41f6b444e58576063fda` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:07.023887 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe48f01-f472-4b96-bea6-2e0eb6ddaef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=910c24ed7bdb41f6b444e58576063fda)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:07.026040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe48f01-f472-4b96-bea6-2e0eb6ddaef9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:07.075692 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-efe48f01-f472-4b96-bea6-2e0eb6ddaef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '910c24ed7bdb41f6b444e58576063fda'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:07.083852 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-efe48f01-f472-4b96-bea6-2e0eb6ddaef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '910c24ed7bdb41f6b444e58576063fda'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:07.091221 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-efe48f01-f472-4b96-bea6-2e0eb6ddaef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '910c24ed7bdb41f6b444e58576063fda'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:07.091920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-efe48f01-f472-4b96-bea6-2e0eb6ddaef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '910c24ed7bdb41f6b444e58576063fda'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:07.104420 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-efe48f01-f472-4b96-bea6-2e0eb6ddaef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '910c24ed7bdb41f6b444e58576063fda'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:07.110563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1261/2510] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:34:06 2022] DELETE /identity/v3/users/910c24ed7bdb41f6b444e58576063fda => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:07.115348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16443e-ca8c-47db-aeda-011c5c0549a4 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:07.115841 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16443e-ca8c-47db-aeda-011c5c0549a4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:07.115935 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16443e-ca8c-47db-aeda-011c5c0549a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:07.133758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5e16443e-ca8c-47db-aeda-011c5c0549a4 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:07.134953 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5e16443e-ca8c-47db-aeda-011c5c0549a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:07.194639 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:07.203854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1250/2511] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:34:07.214096 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe48f01-f472-4b96-bea6-2e0eb6ddaef9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:07.215657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-efe48f01-f472-4b96-bea6-2e0eb6ddaef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:07.273801 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe48f01-f472-4b96-bea6-2e0eb6ddaef9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:07.278044 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f345a-3f9b-4515-8682-326701ca9b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:07.278748 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f345a-3f9b-4515-8682-326701ca9b99 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:07.279029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f345a-3f9b-4515-8682-326701ca9b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:07.279297 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f345a-3f9b-4515-8682-326701ca9b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:07.289009 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f345a-3f9b-4515-8682-326701ca9b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:07.290479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f345a-3f9b-4515-8682-326701ca9b99 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:07.300169 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1262/2512] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:07.590238 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16443e-ca8c-47db-aeda-011c5c0549a4 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:07.591968 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5e16443e-ca8c-47db-aeda-011c5c0549a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:07.610506 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16443e-ca8c-47db-aeda-011c5c0549a4 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:07.616953 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1da79-60f4-44e5-8589-d9cad660bb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:07.617735 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1da79-60f4-44e5-8589-d9cad660bb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:07.618036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1da79-60f4-44e5-8589-d9cad660bb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:07.618248 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1da79-60f4-44e5-8589-d9cad660bb7e admin admin] PATH_INFO: `/v3/projects/df05ebed40db4e4790bfeac6cc49fde7` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:07.619589 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1da79-60f4-44e5-8589-d9cad660bb7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=df05ebed40db4e4790bfeac6cc49fde7)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:07.621606 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1da79-60f4-44e5-8589-d9cad660bb7e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:07.670731 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-24a1da79-60f4-44e5-8589-d9cad660bb7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df05ebed40db4e4790bfeac6cc49fde7', 'request_id': 'req-24a1da79-60f4-44e5-8589-d9cad660bb7e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:07.685393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-24a1da79-60f4-44e5-8589-d9cad660bb7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df05ebed40db4e4790bfeac6cc49fde7', 'request_id': 'req-24a1da79-60f4-44e5-8589-d9cad660bb7e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:07.694638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-24a1da79-60f4-44e5-8589-d9cad660bb7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df05ebed40db4e4790bfeac6cc49fde7', 'request_id': 'req-24a1da79-60f4-44e5-8589-d9cad660bb7e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:07.710937 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-24a1da79-60f4-44e5-8589-d9cad660bb7e admin admin] The token cache is being invalidate because project df05ebed40db4e4790bfeac6cc49fde7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:34:07.711335 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-24a1da79-60f4-44e5-8589-d9cad660bb7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:07.712264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-24a1da79-60f4-44e5-8589-d9cad660bb7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:07.714824 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1251/2513] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:34:07 2022] DELETE /identity/v3/projects/df05ebed40db4e4790bfeac6cc49fde7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:07.719002 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f345a-3f9b-4515-8682-326701ca9b99 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:07.729178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f345a-3f9b-4515-8682-326701ca9b99 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:07.791009 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056d11b-4398-482b-a9f0-47aa0da622a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:07.791946 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056d11b-4398-482b-a9f0-47aa0da622a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:07.792226 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056d11b-4398-482b-a9f0-47aa0da622a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:07.792498 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056d11b-4398-482b-a9f0-47aa0da622a1 admin admin] PATH_INFO: `/v3/users/3da5708d56d54965aa99b443b1fa61d4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:07.793739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056d11b-4398-482b-a9f0-47aa0da622a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da5708d56d54965aa99b443b1fa61d4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:07.795671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056d11b-4398-482b-a9f0-47aa0da622a1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:07.797288 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:07.851695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4056d11b-4398-482b-a9f0-47aa0da622a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da5708d56d54965aa99b443b1fa61d4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:07.860880 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4056d11b-4398-482b-a9f0-47aa0da622a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da5708d56d54965aa99b443b1fa61d4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:07.868106 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4056d11b-4398-482b-a9f0-47aa0da622a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da5708d56d54965aa99b443b1fa61d4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:07.868766 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4056d11b-4398-482b-a9f0-47aa0da622a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da5708d56d54965aa99b443b1fa61d4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:07.887407 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4056d11b-4398-482b-a9f0-47aa0da622a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da5708d56d54965aa99b443b1fa61d4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:07.893843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1263/2514] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:34:07 2022] DELETE /identity/v3/users/3da5708d56d54965aa99b443b1fa61d4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:08.171219 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1da79-60f4-44e5-8589-d9cad660bb7e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:08.173590 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-24a1da79-60f4-44e5-8589-d9cad660bb7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:08.187506 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1da79-60f4-44e5-8589-d9cad660bb7e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:08.247287 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986259f5-1a28-44ce-9f36-2dd0936f2ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:08.248170 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986259f5-1a28-44ce-9f36-2dd0936f2ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:08.248453 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986259f5-1a28-44ce-9f36-2dd0936f2ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:08.248754 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986259f5-1a28-44ce-9f36-2dd0936f2ff3 admin admin] PATH_INFO: `/v3/projects/bdd4cceb844146eab8362d7029a38259` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:08.250002 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986259f5-1a28-44ce-9f36-2dd0936f2ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd4cceb844146eab8362d7029a38259)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:08.251937 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986259f5-1a28-44ce-9f36-2dd0936f2ff3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:08.305127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-986259f5-1a28-44ce-9f36-2dd0936f2ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd4cceb844146eab8362d7029a38259', 'request_id': 'req-986259f5-1a28-44ce-9f36-2dd0936f2ff3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:08.315396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-986259f5-1a28-44ce-9f36-2dd0936f2ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd4cceb844146eab8362d7029a38259', 'request_id': 'req-986259f5-1a28-44ce-9f36-2dd0936f2ff3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:08.322189 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-986259f5-1a28-44ce-9f36-2dd0936f2ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd4cceb844146eab8362d7029a38259', 'request_id': 'req-986259f5-1a28-44ce-9f36-2dd0936f2ff3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:08.334690 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-986259f5-1a28-44ce-9f36-2dd0936f2ff3 admin admin] The token cache is being invalidate because project bdd4cceb844146eab8362d7029a38259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:34:08.334690 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-986259f5-1a28-44ce-9f36-2dd0936f2ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:08.335440 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-986259f5-1a28-44ce-9f36-2dd0936f2ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:08.337170 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1252/2515] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:34:08 2022] DELETE /identity/v3/projects/bdd4cceb844146eab8362d7029a38259 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:08.343494 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820f058-6ea4-470e-8f2f-ddb1b4fff78d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:08.344115 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820f058-6ea4-470e-8f2f-ddb1b4fff78d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:08.344115 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820f058-6ea4-470e-8f2f-ddb1b4fff78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:08.364497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4820f058-6ea4-470e-8f2f-ddb1b4fff78d None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:08.365814 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4820f058-6ea4-470e-8f2f-ddb1b4fff78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:08.429392 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1264/2516] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:08.437498 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d761be6-93b2-4db1-9dee-7c84ecc2dd74 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:08.437836 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d761be6-93b2-4db1-9dee-7c84ecc2dd74 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:08.438175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d761be6-93b2-4db1-9dee-7c84ecc2dd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:08.459790 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-1d761be6-93b2-4db1-9dee-7c84ecc2dd74 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:08.461134 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1d761be6-93b2-4db1-9dee-7c84ecc2dd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:08.471285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1253/2517] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:08.478108 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820f058-6ea4-470e-8f2f-ddb1b4fff78d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:08.488179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820f058-6ea4-470e-8f2f-ddb1b4fff78d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:08.492990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6fa57-ecef-4304-9c0e-265f59dd5d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:08.493646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6fa57-ecef-4304-9c0e-265f59dd5d76 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:08.493930 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6fa57-ecef-4304-9c0e-265f59dd5d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:08.494203 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6fa57-ecef-4304-9c0e-265f59dd5d76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:08.494976 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6fa57-ecef-4304-9c0e-265f59dd5d76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:34:08.495280 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6fa57-ecef-4304-9c0e-265f59dd5d76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:08.496953 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6fa57-ecef-4304-9c0e-265f59dd5d76 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:08.509042 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1265/2518] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:34:08.513406 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d761be6-93b2-4db1-9dee-7c84ecc2dd74 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:08.522956 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d761be6-93b2-4db1-9dee-7c84ecc2dd74 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:08.528282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b16e4-5294-4344-8323-506908c56eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:08.528963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b16e4-5294-4344-8323-506908c56eee admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:08.529238 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b16e4-5294-4344-8323-506908c56eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:08.529500 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b16e4-5294-4344-8323-506908c56eee admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:08.530178 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b16e4-5294-4344-8323-506908c56eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:08.532136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b16e4-5294-4344-8323-506908c56eee admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:08.535544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:08.560764 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1254/2519] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:34:08 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:08.564988 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6fa57-ecef-4304-9c0e-265f59dd5d76 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:08.575596 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6fa57-ecef-4304-9c0e-265f59dd5d76 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:08.636654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a74be2-ab1b-4a9b-bc04-4a85d8b721d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:08.637359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a74be2-ab1b-4a9b-bc04-4a85d8b721d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:08.637662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a74be2-ab1b-4a9b-bc04-4a85d8b721d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:08.637936 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a74be2-ab1b-4a9b-bc04-4a85d8b721d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:08.638645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a74be2-ab1b-4a9b-bc04-4a85d8b721d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:08.641594 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a74be2-ab1b-4a9b-bc04-4a85d8b721d0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:08.653498 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:08.678767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b16e4-5294-4344-8323-506908c56eee admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:08.678972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1266/2520] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:34:08 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:08.698320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b16e4-5294-4344-8323-506908c56eee admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:08.713150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecc8c1-3d5f-47ea-82cd-9db92abb4bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:08.713988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecc8c1-3d5f-47ea-82cd-9db92abb4bea admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:08.714268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecc8c1-3d5f-47ea-82cd-9db92abb4bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:08.714536 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecc8c1-3d5f-47ea-82cd-9db92abb4bea admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:08.715267 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecc8c1-3d5f-47ea-82cd-9db92abb4bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:08.716944 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecc8c1-3d5f-47ea-82cd-9db92abb4bea admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:08.732287 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1255/2521] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:08.733501 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a74be2-ab1b-4a9b-bc04-4a85d8b721d0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:08.744723 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a74be2-ab1b-4a9b-bc04-4a85d8b721d0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:08.749426 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cb02e-0d46-4dfc-a8db-2011dfcca363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:08.750113 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cb02e-0d46-4dfc-a8db-2011dfcca363 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:08.750456 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cb02e-0d46-4dfc-a8db-2011dfcca363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:08.750732 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cb02e-0d46-4dfc-a8db-2011dfcca363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:08.751601 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cb02e-0d46-4dfc-a8db-2011dfcca363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:08.753261 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cb02e-0d46-4dfc-a8db-2011dfcca363 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:08.764559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1267/2522] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:08.768275 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecc8c1-3d5f-47ea-82cd-9db92abb4bea admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:08.780924 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecc8c1-3d5f-47ea-82cd-9db92abb4bea admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:08.787278 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d15882-3e7e-4b88-ae59-609f98840151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:08.790012 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d15882-3e7e-4b88-ae59-609f98840151 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:08.790311 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d15882-3e7e-4b88-ae59-609f98840151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:08.790591 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d15882-3e7e-4b88-ae59-609f98840151 admin admin] PATH_INFO: `/v3/projects/136088839d7f4b8fa106ef386ce7a526/users/7e1f7cd8f5694abeaeffda561f0d9915/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:08.814196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d15882-3e7e-4b88-ae59-609f98840151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=136088839d7f4b8fa106ef386ce7a526, user_id=7e1f7cd8f5694abeaeffda561f0d9915, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:08.816982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d15882-3e7e-4b88-ae59-609f98840151 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:08.836568 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1256/2523] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:08 2022] PUT /identity/v3/projects/136088839d7f4b8fa106ef386ce7a526/users/7e1f7cd8f5694abeaeffda561f0d9915/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:08.844549 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c054aca-66c9-4fbe-be44-5beb61a1c9d6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:08.844839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c054aca-66c9-4fbe-be44-5beb61a1c9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:08.845116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c054aca-66c9-4fbe-be44-5beb61a1c9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:08.873415 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0c054aca-66c9-4fbe-be44-5beb61a1c9d6 None None] MFA Rules not processed for user `7e1f7cd8f5694abeaeffda561f0d9915`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:08.874808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0c054aca-66c9-4fbe-be44-5beb61a1c9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:08.943249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1268/2524] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:08.947905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d15882-3e7e-4b88-ae59-609f98840151 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:09.010837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d15882-3e7e-4b88-ae59-609f98840151 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:09.016118 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc04ce-f2df-4143-96dd-700bf60a3439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:09.016832 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc04ce-f2df-4143-96dd-700bf60a3439 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:09.017094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc04ce-f2df-4143-96dd-700bf60a3439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:09.017365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc04ce-f2df-4143-96dd-700bf60a3439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:09.018081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc04ce-f2df-4143-96dd-700bf60a3439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:09.020001 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc04ce-f2df-4143-96dd-700bf60a3439 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:09.047907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1257/2525] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:34:08 2022] POST /identity/v3/projects => generated 399 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:34:09.052474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c054aca-66c9-4fbe-be44-5beb61a1c9d6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:09.063433 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c054aca-66c9-4fbe-be44-5beb61a1c9d6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:09.123994 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd388d-c0c0-4d03-80f6-7f91d76eb0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:09.124765 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd388d-c0c0-4d03-80f6-7f91d76eb0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:09.125127 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd388d-c0c0-4d03-80f6-7f91d76eb0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:09.125507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd388d-c0c0-4d03-80f6-7f91d76eb0e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:09.126306 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd388d-c0c0-4d03-80f6-7f91d76eb0e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:09.128969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd388d-c0c0-4d03-80f6-7f91d76eb0e7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:09.151374 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1269/2526] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:34:09 2022] POST /identity/v3/users => generated 306 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:09.155506 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc04ce-f2df-4143-96dd-700bf60a3439 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:09.167311 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc04ce-f2df-4143-96dd-700bf60a3439 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:09.172897 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61c2c0-046d-4751-adc8-aa19aeb65239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:09.173558 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61c2c0-046d-4751-adc8-aa19aeb65239 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:09.173833 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61c2c0-046d-4751-adc8-aa19aeb65239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:09.174098 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61c2c0-046d-4751-adc8-aa19aeb65239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:09.174822 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61c2c0-046d-4751-adc8-aa19aeb65239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:09.176422 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61c2c0-046d-4751-adc8-aa19aeb65239 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:09.187867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1258/2527] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:09.192877 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd388d-c0c0-4d03-80f6-7f91d76eb0e7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:09.206728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd388d-c0c0-4d03-80f6-7f91d76eb0e7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:09.212943 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a165740-a908-4191-a33b-fe452a4ec6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:09.213830 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165740-a908-4191-a33b-fe452a4ec6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:09.214105 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165740-a908-4191-a33b-fe452a4ec6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:09.214371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165740-a908-4191-a33b-fe452a4ec6fe admin admin] PATH_INFO: `/v3/projects/41db62060ba6450a945c5fa8d5b77002/users/4a612783bd0b4cc8851384664581d1e5/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:09.229752 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a165740-a908-4191-a33b-fe452a4ec6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=41db62060ba6450a945c5fa8d5b77002, user_id=4a612783bd0b4cc8851384664581d1e5, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:09.232391 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a165740-a908-4191-a33b-fe452a4ec6fe admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:09.248362 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1270/2528] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:09 2022] PUT /identity/v3/projects/41db62060ba6450a945c5fa8d5b77002/users/4a612783bd0b4cc8851384664581d1e5/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:34:09.252430 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61c2c0-046d-4751-adc8-aa19aeb65239 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:09.262747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61c2c0-046d-4751-adc8-aa19aeb65239 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:09.319940 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb251be-a919-4624-86b2-e95aed18cc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:09.320630 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb251be-a919-4624-86b2-e95aed18cc78 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:09.320903 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb251be-a919-4624-86b2-e95aed18cc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:09.321172 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb251be-a919-4624-86b2-e95aed18cc78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:09.321893 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb251be-a919-4624-86b2-e95aed18cc78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:09.323492 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb251be-a919-4624-86b2-e95aed18cc78 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:09.333444 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1259/2529] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:09.339644 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a165740-a908-4191-a33b-fe452a4ec6fe admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:09.351677 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a165740-a908-4191-a33b-fe452a4ec6fe admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:09.356833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb349c16-0db9-4641-bfb3-63233b8f0fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:09.357756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb349c16-0db9-4641-bfb3-63233b8f0fac admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:09.358030 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb349c16-0db9-4641-bfb3-63233b8f0fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:09.358300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb349c16-0db9-4641-bfb3-63233b8f0fac admin admin] PATH_INFO: `/v3/projects/41db62060ba6450a945c5fa8d5b77002/users/4a612783bd0b4cc8851384664581d1e5/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:09.360421 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb349c16-0db9-4641-bfb3-63233b8f0fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=41db62060ba6450a945c5fa8d5b77002, user_id=4a612783bd0b4cc8851384664581d1e5, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:09.363258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb349c16-0db9-4641-bfb3-63233b8f0fac admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:09.374571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1271/2530] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:09 2022] PUT /identity/v3/projects/41db62060ba6450a945c5fa8d5b77002/users/4a612783bd0b4cc8851384664581d1e5/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:09.384674 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eec69a-ed71-485a-b3b6-56c032d91dfe None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:09.384980 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eec69a-ed71-485a-b3b6-56c032d91dfe None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:09.385255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eec69a-ed71-485a-b3b6-56c032d91dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:09.412677 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-28eec69a-ed71-485a-b3b6-56c032d91dfe None None] MFA Rules not processed for user `4a612783bd0b4cc8851384664581d1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:09.413923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-28eec69a-ed71-485a-b3b6-56c032d91dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:09.422767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:09.486794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1260/2531] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:09 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:09.500978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb349c16-0db9-4641-bfb3-63233b8f0fac admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:09.502848 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fb349c16-0db9-4641-bfb3-63233b8f0fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:09.535486 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:09.563648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb349c16-0db9-4641-bfb3-63233b8f0fac admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:09.567344 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08a917-6811-4776-9628-a39f205cf9f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:09.567983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08a917-6811-4776-9628-a39f205cf9f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:09.568259 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08a917-6811-4776-9628-a39f205cf9f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:09.568538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08a917-6811-4776-9628-a39f205cf9f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:09.577534 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08a917-6811-4776-9628-a39f205cf9f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:09.578961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08a917-6811-4776-9628-a39f205cf9f2 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:09.588882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1272/2532] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:09 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:09.665416 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eec69a-ed71-485a-b3b6-56c032d91dfe None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:09.675470 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eec69a-ed71-485a-b3b6-56c032d91dfe None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:09.679379 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1c748-7fad-4986-a3f7-8ce7f12a427c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:09.680038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1c748-7fad-4986-a3f7-8ce7f12a427c service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:09.680318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1c748-7fad-4986-a3f7-8ce7f12a427c service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:09.680624 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1c748-7fad-4986-a3f7-8ce7f12a427c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:09.739304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1c748-7fad-4986-a3f7-8ce7f12a427c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:09.740786 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1c748-7fad-4986-a3f7-8ce7f12a427c service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:09.750068 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1261/2533] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:13.852587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08a917-6811-4776-9628-a39f205cf9f2 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:13.919557 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08a917-6811-4776-9628-a39f205cf9f2 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:13.924858 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e8be6-7c85-40af-9cd3-557e8cc9e4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:13.925723 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e8be6-7c85-40af-9cd3-557e8cc9e4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:13.925997 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e8be6-7c85-40af-9cd3-557e8cc9e4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:13.926266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e8be6-7c85-40af-9cd3-557e8cc9e4e1 admin admin] PATH_INFO: `/v3/users/7e1f7cd8f5694abeaeffda561f0d9915` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:13.927508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e8be6-7c85-40af-9cd3-557e8cc9e4e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1f7cd8f5694abeaeffda561f0d9915)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:13.929398 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e8be6-7c85-40af-9cd3-557e8cc9e4e1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:13.989674 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e08e8be6-7c85-40af-9cd3-557e8cc9e4e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1f7cd8f5694abeaeffda561f0d9915'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:14.000294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e08e8be6-7c85-40af-9cd3-557e8cc9e4e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1f7cd8f5694abeaeffda561f0d9915'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:14.011587 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e08e8be6-7c85-40af-9cd3-557e8cc9e4e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1f7cd8f5694abeaeffda561f0d9915'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:14.012698 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e08e8be6-7c85-40af-9cd3-557e8cc9e4e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1f7cd8f5694abeaeffda561f0d9915'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:14.032759 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e08e8be6-7c85-40af-9cd3-557e8cc9e4e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1f7cd8f5694abeaeffda561f0d9915'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:14.039552 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1273/2534] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:34:13 2022] DELETE /identity/v3/users/7e1f7cd8f5694abeaeffda561f0d9915 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:14.043875 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311309cf-cac6-4bc0-9f32-71f19fb5a02c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:14.044395 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311309cf-cac6-4bc0-9f32-71f19fb5a02c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:14.044395 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311309cf-cac6-4bc0-9f32-71f19fb5a02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:14.061880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-311309cf-cac6-4bc0-9f32-71f19fb5a02c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:14.063131 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-311309cf-cac6-4bc0-9f32-71f19fb5a02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:14.126711 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1262/2535] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:14.136655 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e8be6-7c85-40af-9cd3-557e8cc9e4e1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:14.138064 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e08e8be6-7c85-40af-9cd3-557e8cc9e4e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:14.201294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:14.205268 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e8be6-7c85-40af-9cd3-557e8cc9e4e1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:14.209706 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff35e0b-9c6d-4d61-bd69-1b3ff088708b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:14.210417 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff35e0b-9c6d-4d61-bd69-1b3ff088708b service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:14.210963 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff35e0b-9c6d-4d61-bd69-1b3ff088708b service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:14.211349 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff35e0b-9c6d-4d61-bd69-1b3ff088708b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:14.221717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff35e0b-9c6d-4d61-bd69-1b3ff088708b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:14.223158 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff35e0b-9c6d-4d61-bd69-1b3ff088708b service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:14.232565 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1274/2536] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:14.508649 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311309cf-cac6-4bc0-9f32-71f19fb5a02c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:14.510320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-311309cf-cac6-4bc0-9f32-71f19fb5a02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:14.528171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311309cf-cac6-4bc0-9f32-71f19fb5a02c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:14.534574 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c5230-205a-4b46-af55-38c8b495e06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:14.535528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c5230-205a-4b46-af55-38c8b495e06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:14.535709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c5230-205a-4b46-af55-38c8b495e06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:14.535983 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c5230-205a-4b46-af55-38c8b495e06e admin admin] PATH_INFO: `/v3/projects/136088839d7f4b8fa106ef386ce7a526` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:14.537190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c5230-205a-4b46-af55-38c8b495e06e admin admin] RBAC: Authorizing `identity:delete_project(project_id=136088839d7f4b8fa106ef386ce7a526)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:14.539123 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c5230-205a-4b46-af55-38c8b495e06e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:14.580854 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:14.589304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f95c5230-205a-4b46-af55-38c8b495e06e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '136088839d7f4b8fa106ef386ce7a526', 'request_id': 'req-f95c5230-205a-4b46-af55-38c8b495e06e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:14.598105 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f95c5230-205a-4b46-af55-38c8b495e06e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '136088839d7f4b8fa106ef386ce7a526', 'request_id': 'req-f95c5230-205a-4b46-af55-38c8b495e06e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:14.604319 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f95c5230-205a-4b46-af55-38c8b495e06e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '136088839d7f4b8fa106ef386ce7a526', 'request_id': 'req-f95c5230-205a-4b46-af55-38c8b495e06e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:14.615938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f95c5230-205a-4b46-af55-38c8b495e06e admin admin] The token cache is being invalidate because project 136088839d7f4b8fa106ef386ce7a526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:34:14.616228 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f95c5230-205a-4b46-af55-38c8b495e06e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:14.616932 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f95c5230-205a-4b46-af55-38c8b495e06e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:14.618479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1263/2537] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:34:14 2022] DELETE /identity/v3/projects/136088839d7f4b8fa106ef386ce7a526 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:14.622605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff35e0b-9c6d-4d61-bd69-1b3ff088708b service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:14.632944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff35e0b-9c6d-4d61-bd69-1b3ff088708b service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:14.694957 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83d57a-f27a-4660-a718-8538aff03bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:14.695760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d57a-f27a-4660-a718-8538aff03bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:14.696035 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d57a-f27a-4660-a718-8538aff03bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:14.696297 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d57a-f27a-4660-a718-8538aff03bef admin admin] PATH_INFO: `/v3/users/4a612783bd0b4cc8851384664581d1e5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:14.697523 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83d57a-f27a-4660-a718-8538aff03bef admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a612783bd0b4cc8851384664581d1e5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:14.699597 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83d57a-f27a-4660-a718-8538aff03bef admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:14.751224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fc83d57a-f27a-4660-a718-8538aff03bef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a612783bd0b4cc8851384664581d1e5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:14.758974 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fc83d57a-f27a-4660-a718-8538aff03bef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a612783bd0b4cc8851384664581d1e5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:14.766508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fc83d57a-f27a-4660-a718-8538aff03bef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a612783bd0b4cc8851384664581d1e5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:14.767136 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fc83d57a-f27a-4660-a718-8538aff03bef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a612783bd0b4cc8851384664581d1e5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:14.779423 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fc83d57a-f27a-4660-a718-8538aff03bef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a612783bd0b4cc8851384664581d1e5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:14.785632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1275/2538] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:34:14 2022] DELETE /identity/v3/users/4a612783bd0b4cc8851384664581d1e5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:15.060703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c5230-205a-4b46-af55-38c8b495e06e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:15.062378 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f95c5230-205a-4b46-af55-38c8b495e06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:15.079151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c5230-205a-4b46-af55-38c8b495e06e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:15.138301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10760d4e-7336-4933-ab35-2e17d0d4c01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:15.139167 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10760d4e-7336-4933-ab35-2e17d0d4c01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:15.139427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10760d4e-7336-4933-ab35-2e17d0d4c01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:15.139960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10760d4e-7336-4933-ab35-2e17d0d4c01f admin admin] PATH_INFO: `/v3/projects/41db62060ba6450a945c5fa8d5b77002` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:15.141206 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10760d4e-7336-4933-ab35-2e17d0d4c01f admin admin] RBAC: Authorizing `identity:delete_project(project_id=41db62060ba6450a945c5fa8d5b77002)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:15.143155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10760d4e-7336-4933-ab35-2e17d0d4c01f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:15.190986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-10760d4e-7336-4933-ab35-2e17d0d4c01f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41db62060ba6450a945c5fa8d5b77002', 'request_id': 'req-10760d4e-7336-4933-ab35-2e17d0d4c01f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:15.199441 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-10760d4e-7336-4933-ab35-2e17d0d4c01f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41db62060ba6450a945c5fa8d5b77002', 'request_id': 'req-10760d4e-7336-4933-ab35-2e17d0d4c01f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:15.205895 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-10760d4e-7336-4933-ab35-2e17d0d4c01f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41db62060ba6450a945c5fa8d5b77002', 'request_id': 'req-10760d4e-7336-4933-ab35-2e17d0d4c01f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:15.218084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-10760d4e-7336-4933-ab35-2e17d0d4c01f admin admin] The token cache is being invalidate because project 41db62060ba6450a945c5fa8d5b77002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:34:15.218375 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-10760d4e-7336-4933-ab35-2e17d0d4c01f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:15.219062 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-10760d4e-7336-4933-ab35-2e17d0d4c01f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:15.220821 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1264/2539] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:34:15 2022] DELETE /identity/v3/projects/41db62060ba6450a945c5fa8d5b77002 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:15.225556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2144c0-1ec8-4252-8267-f713b9f96720 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:15.226049 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2144c0-1ec8-4252-8267-f713b9f96720 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:15.226148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2144c0-1ec8-4252-8267-f713b9f96720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:15.245689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9f2144c0-1ec8-4252-8267-f713b9f96720 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:15.246900 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9f2144c0-1ec8-4252-8267-f713b9f96720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:15.310312 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1276/2540] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:15.318342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3120c-c692-41fd-ad84-1b0d8ae69b02 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:15.318537 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3120c-c692-41fd-ad84-1b0d8ae69b02 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:15.318713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3120c-c692-41fd-ad84-1b0d8ae69b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:15.339286 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-88c3120c-c692-41fd-ad84-1b0d8ae69b02 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:15.340687 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-88c3120c-c692-41fd-ad84-1b0d8ae69b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:15.349743 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1265/2541] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:34:15.354114 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2144c0-1ec8-4252-8267-f713b9f96720 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:15.364239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2144c0-1ec8-4252-8267-f713b9f96720 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:15.368983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd23cfe-0e04-411a-814b-d7ca26f7a521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:15.369634 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd23cfe-0e04-411a-814b-d7ca26f7a521 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:15.369911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd23cfe-0e04-411a-814b-d7ca26f7a521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:15.370184 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd23cfe-0e04-411a-814b-d7ca26f7a521 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:15.370912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd23cfe-0e04-411a-814b-d7ca26f7a521 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:34:15.371211 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd23cfe-0e04-411a-814b-d7ca26f7a521 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:15.372866 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd23cfe-0e04-411a-814b-d7ca26f7a521 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:15.379954 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:15.386686 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1277/2542] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:34:15.389867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3120c-c692-41fd-ad84-1b0d8ae69b02 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:15.399382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3120c-c692-41fd-ad84-1b0d8ae69b02 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:15.404459 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94842600-6ce8-4830-90ab-8d495f1f0f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:15.405208 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94842600-6ce8-4830-90ab-8d495f1f0f01 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:15.405485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94842600-6ce8-4830-90ab-8d495f1f0f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:15.405753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94842600-6ce8-4830-90ab-8d495f1f0f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:15.406425 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94842600-6ce8-4830-90ab-8d495f1f0f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:15.408315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94842600-6ce8-4830-90ab-8d495f1f0f01 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:15.435602 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1266/2543] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:34:15 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:15.440147 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd23cfe-0e04-411a-814b-d7ca26f7a521 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:15.450641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd23cfe-0e04-411a-814b-d7ca26f7a521 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:15.511307 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51785a87-d2a5-4dc4-863b-027ac6ce9fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:15.511891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785a87-d2a5-4dc4-863b-027ac6ce9fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:15.512176 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785a87-d2a5-4dc4-863b-027ac6ce9fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:15.512448 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785a87-d2a5-4dc4-863b-027ac6ce9fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:15.513173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51785a87-d2a5-4dc4-863b-027ac6ce9fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:15.515252 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51785a87-d2a5-4dc4-863b-027ac6ce9fa9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:15.536768 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1278/2544] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:34:15 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:15.541257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94842600-6ce8-4830-90ab-8d495f1f0f01 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:15.551793 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94842600-6ce8-4830-90ab-8d495f1f0f01 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:15.556899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da06bf-c2e2-45fa-8022-81dbe4942be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:15.557551 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da06bf-c2e2-45fa-8022-81dbe4942be7 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:15.557831 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da06bf-c2e2-45fa-8022-81dbe4942be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:15.558106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da06bf-c2e2-45fa-8022-81dbe4942be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:15.558827 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da06bf-c2e2-45fa-8022-81dbe4942be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:15.560424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da06bf-c2e2-45fa-8022-81dbe4942be7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:15.570988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1267/2545] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:15.575046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51785a87-d2a5-4dc4-863b-027ac6ce9fa9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:15.585522 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51785a87-d2a5-4dc4-863b-027ac6ce9fa9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:15.590802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397e11b-cc14-4bb6-87e7-d35753d3a0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:15.591457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397e11b-cc14-4bb6-87e7-d35753d3a0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:15.591735 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397e11b-cc14-4bb6-87e7-d35753d3a0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:15.592010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397e11b-cc14-4bb6-87e7-d35753d3a0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:15.592998 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397e11b-cc14-4bb6-87e7-d35753d3a0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:15.594622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397e11b-cc14-4bb6-87e7-d35753d3a0c1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:15.604859 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1279/2546] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:15.609148 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da06bf-c2e2-45fa-8022-81dbe4942be7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:15.619036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da06bf-c2e2-45fa-8022-81dbe4942be7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:15.624015 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddd553-5671-4484-891b-153660d4957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:15.624923 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddd553-5671-4484-891b-153660d4957b admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:15.625196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddd553-5671-4484-891b-153660d4957b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:15.625481 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddd553-5671-4484-891b-153660d4957b admin admin] PATH_INFO: `/v3/projects/152b2d7e9e094a58b225db717028a1db/users/8261e4d29cdc4d81ae5d98316eec770d/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:15.640478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddd553-5671-4484-891b-153660d4957b admin admin] RBAC: Authorizing `identity:create_grant(project_id=152b2d7e9e094a58b225db717028a1db, user_id=8261e4d29cdc4d81ae5d98316eec770d, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:15.643130 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddd553-5671-4484-891b-153660d4957b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:15.645385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:15.659749 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1268/2547] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:15 2022] PUT /identity/v3/projects/152b2d7e9e094a58b225db717028a1db/users/8261e4d29cdc4d81ae5d98316eec770d/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:15.671162 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08466fcb-c3ab-46ad-90b7-3ada9e7d3e43 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:15.671602 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08466fcb-c3ab-46ad-90b7-3ada9e7d3e43 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:15.671884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08466fcb-c3ab-46ad-90b7-3ada9e7d3e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:15.700053 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-08466fcb-c3ab-46ad-90b7-3ada9e7d3e43 None None] MFA Rules not processed for user `8261e4d29cdc4d81ae5d98316eec770d`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:15.701292 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-08466fcb-c3ab-46ad-90b7-3ada9e7d3e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:15.775193 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1280/2548] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:15.781858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddd553-5671-4484-891b-153660d4957b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:15.783833 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-89ddd553-5671-4484-891b-153660d4957b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:15.848280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddd553-5671-4484-891b-153660d4957b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:15.852785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ab613-113e-4308-9504-ee204f8adb7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:15.853442 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ab613-113e-4308-9504-ee204f8adb7c service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:15.853721 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ab613-113e-4308-9504-ee204f8adb7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:15.853990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ab613-113e-4308-9504-ee204f8adb7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:15.863461 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ab613-113e-4308-9504-ee204f8adb7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:15.864999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ab613-113e-4308-9504-ee204f8adb7c service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:15.875826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1269/2549] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:25.765945 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:25.870790 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:26.356541 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233744a2-55a7-4a74-84d3-b7f103de7dd4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:26.356830 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233744a2-55a7-4a74-84d3-b7f103de7dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:26.357125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233744a2-55a7-4a74-84d3-b7f103de7dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:26.376079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-233744a2-55a7-4a74-84d3-b7f103de7dd4 None None] MFA Rules not processed for user `e23aea853cce44698b19d6bc087093c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:26.377342 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-233744a2-55a7-4a74-84d3-b7f103de7dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:26.435165 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1281/2550] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 03:34:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:26.485463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ab613-113e-4308-9504-ee204f8adb7c service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:26.487094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-be1ab613-113e-4308-9504-ee204f8adb7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:26.563946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ab613-113e-4308-9504-ee204f8adb7c service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:26.569175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db9576-c2a4-4c8e-b706-13554f2068e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc4cbd87dd249868cfb704535774126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:26.569933 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db9576-c2a4-4c8e-b706-13554f2068e5 service swift] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:26.570212 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db9576-c2a4-4c8e-b706-13554f2068e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:26.570482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db9576-c2a4-4c8e-b706-13554f2068e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:26.579292 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db9576-c2a4-4c8e-b706-13554f2068e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:26.580958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db9576-c2a4-4c8e-b706-13554f2068e5 service swift] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:26.589098 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1270/2551] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 03:34:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 03:34:27.432992 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233744a2-55a7-4a74-84d3-b7f103de7dd4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:27.530998 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233744a2-55a7-4a74-84d3-b7f103de7dd4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:27.536458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ffd0b-97a0-4d73-b175-0dcfd25772ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:27.537555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ffd0b-97a0-4d73-b175-0dcfd25772ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:27.537831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ffd0b-97a0-4d73-b175-0dcfd25772ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:27.538103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ffd0b-97a0-4d73-b175-0dcfd25772ee admin admin] PATH_INFO: `/v3/users/8261e4d29cdc4d81ae5d98316eec770d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:27.539301 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ffd0b-97a0-4d73-b175-0dcfd25772ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=8261e4d29cdc4d81ae5d98316eec770d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:27.541323 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ffd0b-97a0-4d73-b175-0dcfd25772ee admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:27.612206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2e0ffd0b-97a0-4d73-b175-0dcfd25772ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8261e4d29cdc4d81ae5d98316eec770d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:27.621281 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2e0ffd0b-97a0-4d73-b175-0dcfd25772ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8261e4d29cdc4d81ae5d98316eec770d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:27.630886 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2e0ffd0b-97a0-4d73-b175-0dcfd25772ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8261e4d29cdc4d81ae5d98316eec770d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:27.631711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2e0ffd0b-97a0-4d73-b175-0dcfd25772ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8261e4d29cdc4d81ae5d98316eec770d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:27.644978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2e0ffd0b-97a0-4d73-b175-0dcfd25772ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8261e4d29cdc4d81ae5d98316eec770d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:27.651942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1282/2552] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:34:27 2022] DELETE /identity/v3/users/8261e4d29cdc4d81ae5d98316eec770d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:27.656491 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442e54-d9c7-4c29-9c65-d72197b726b5 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:27.657640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442e54-d9c7-4c29-9c65-d72197b726b5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:27.657930 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442e54-d9c7-4c29-9c65-d72197b726b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:27.677591 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-8d442e54-d9c7-4c29-9c65-d72197b726b5 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:27.679091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8d442e54-d9c7-4c29-9c65-d72197b726b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:27.785518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1271/2553] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:27.796708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ffd0b-97a0-4d73-b175-0dcfd25772ee admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:27.798142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2e0ffd0b-97a0-4d73-b175-0dcfd25772ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:27.829068 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:27.868535 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ffd0b-97a0-4d73-b175-0dcfd25772ee admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:27.872480 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d4b9c-12cb-4db9-b085-409210569cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:27.873202 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d4b9c-12cb-4db9-b085-409210569cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:27.873484 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d4b9c-12cb-4db9-b085-409210569cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:27.874074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d4b9c-12cb-4db9-b085-409210569cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:27.886616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d4b9c-12cb-4db9-b085-409210569cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:27.886616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d4b9c-12cb-4db9-b085-409210569cc0 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:27.909735 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1283/2554] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:34:27.934943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d442e54-d9c7-4c29-9c65-d72197b726b5 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:27.936645 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8d442e54-d9c7-4c29-9c65-d72197b726b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:28.064999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d442e54-d9c7-4c29-9c65-d72197b726b5 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:28.073330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348661c4-1fa6-4c40-b177-5083d1c93548 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:28.074304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348661c4-1fa6-4c40-b177-5083d1c93548 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:28.074811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348661c4-1fa6-4c40-b177-5083d1c93548 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:28.075314 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348661c4-1fa6-4c40-b177-5083d1c93548 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:28.080237 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-348661c4-1fa6-4c40-b177-5083d1c93548 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:28.095451 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348661c4-1fa6-4c40-b177-5083d1c93548 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:28.097214 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348661c4-1fa6-4c40-b177-5083d1c93548 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:28.116701 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1272/2555] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:34:28.274144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d4b9c-12cb-4db9-b085-409210569cc0 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:28.275730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-410d4b9c-12cb-4db9-b085-409210569cc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:28.305829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d4b9c-12cb-4db9-b085-409210569cc0 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:28.310851 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800828e-5788-4b1a-a364-21de0b55d05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:28.312579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800828e-5788-4b1a-a364-21de0b55d05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:28.312892 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800828e-5788-4b1a-a364-21de0b55d05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:28.313166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800828e-5788-4b1a-a364-21de0b55d05d admin admin] PATH_INFO: `/v3/projects/152b2d7e9e094a58b225db717028a1db` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:28.314452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800828e-5788-4b1a-a364-21de0b55d05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=152b2d7e9e094a58b225db717028a1db)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:28.316413 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800828e-5788-4b1a-a364-21de0b55d05d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:28.380992 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4800828e-5788-4b1a-a364-21de0b55d05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '152b2d7e9e094a58b225db717028a1db', 'request_id': 'req-4800828e-5788-4b1a-a364-21de0b55d05d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:28.390190 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4800828e-5788-4b1a-a364-21de0b55d05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '152b2d7e9e094a58b225db717028a1db', 'request_id': 'req-4800828e-5788-4b1a-a364-21de0b55d05d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:28.406506 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4800828e-5788-4b1a-a364-21de0b55d05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '152b2d7e9e094a58b225db717028a1db', 'request_id': 'req-4800828e-5788-4b1a-a364-21de0b55d05d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:28.423549 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4800828e-5788-4b1a-a364-21de0b55d05d admin admin] The token cache is being invalidate because project 152b2d7e9e094a58b225db717028a1db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:34:28.423841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4800828e-5788-4b1a-a364-21de0b55d05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:28.424512 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4800828e-5788-4b1a-a364-21de0b55d05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:28.426466 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1284/2556] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:34:28 2022] DELETE /identity/v3/projects/152b2d7e9e094a58b225db717028a1db => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:34:28.432296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a295a0-d977-40b2-9fd0-8981789308d5 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:28.432609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a295a0-d977-40b2-9fd0-8981789308d5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:28.432890 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a295a0-d977-40b2-9fd0-8981789308d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:28.454413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a3a295a0-d977-40b2-9fd0-8981789308d5 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:28.455852 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a3a295a0-d977-40b2-9fd0-8981789308d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:28.487732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:28.587733 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac2601-8e4b-4180-94f5-31813ef17caa None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:28.588306 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac2601-8e4b-4180-94f5-31813ef17caa None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:28.588306 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac2601-8e4b-4180-94f5-31813ef17caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:28.594298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1273/2557] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:28.614975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-25ac2601-8e4b-4180-94f5-31813ef17caa None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:28.616203 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-25ac2601-8e4b-4180-94f5-31813ef17caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:28.640348 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1285/2558] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:28.644799 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a295a0-d977-40b2-9fd0-8981789308d5 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:28.656880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a295a0-d977-40b2-9fd0-8981789308d5 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:28.662116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef117e-be6b-4f69-b401-a24b7d56a5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:28.662862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef117e-be6b-4f69-b401-a24b7d56a5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:28.663230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef117e-be6b-4f69-b401-a24b7d56a5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:28.663581 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef117e-be6b-4f69-b401-a24b7d56a5a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:28.664581 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef117e-be6b-4f69-b401-a24b7d56a5a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:34:28.665054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef117e-be6b-4f69-b401-a24b7d56a5a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:28.666968 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef117e-be6b-4f69-b401-a24b7d56a5a8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:28.686093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac2601-8e4b-4180-94f5-31813ef17caa None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:28.692736 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1274/2559] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:34:28.696970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac2601-8e4b-4180-94f5-31813ef17caa None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:28.709376 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997ec55-e2a9-4d36-8f8d-a4fee3c6dfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:28.710139 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997ec55-e2a9-4d36-8f8d-a4fee3c6dfc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:28.710491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997ec55-e2a9-4d36-8f8d-a4fee3c6dfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:28.710833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997ec55-e2a9-4d36-8f8d-a4fee3c6dfc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:28.712223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997ec55-e2a9-4d36-8f8d-a4fee3c6dfc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:28.715850 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997ec55-e2a9-4d36-8f8d-a4fee3c6dfc9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:28.764041 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1286/2560] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:34:28 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:28.765504 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef117e-be6b-4f69-b401-a24b7d56a5a8 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:28.784178 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef117e-be6b-4f69-b401-a24b7d56a5a8 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:28.867311 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020ee48-148c-4029-9b4a-ee28e9a16894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:28.867985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020ee48-148c-4029-9b4a-ee28e9a16894 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:28.868269 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020ee48-148c-4029-9b4a-ee28e9a16894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:28.868551 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020ee48-148c-4029-9b4a-ee28e9a16894 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:28.869253 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020ee48-148c-4029-9b4a-ee28e9a16894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:28.871398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020ee48-148c-4029-9b4a-ee28e9a16894 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:28.903697 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997ec55-e2a9-4d36-8f8d-a4fee3c6dfc9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:28.908900 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1275/2561] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:34:28 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:28.915848 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997ec55-e2a9-4d36-8f8d-a4fee3c6dfc9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:28.922373 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17142ce-0fc7-4615-ad63-64049c014575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:28.923546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17142ce-0fc7-4615-ad63-64049c014575 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:28.923832 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17142ce-0fc7-4615-ad63-64049c014575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:28.924107 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17142ce-0fc7-4615-ad63-64049c014575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:28.925050 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17142ce-0fc7-4615-ad63-64049c014575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:28.926772 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17142ce-0fc7-4615-ad63-64049c014575 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:28.953106 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020ee48-148c-4029-9b4a-ee28e9a16894 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:28.959768 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1287/2562] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:28.964957 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020ee48-148c-4029-9b4a-ee28e9a16894 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:28.975154 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67493d9-497a-4b76-964c-eab764f8367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:28.975848 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67493d9-497a-4b76-964c-eab764f8367b admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:28.976133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67493d9-497a-4b76-964c-eab764f8367b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:28.976407 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67493d9-497a-4b76-964c-eab764f8367b admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:28.977175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67493d9-497a-4b76-964c-eab764f8367b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:28.978889 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67493d9-497a-4b76-964c-eab764f8367b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:28.993372 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1276/2563] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:28.997827 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17142ce-0fc7-4615-ad63-64049c014575 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:29.009349 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17142ce-0fc7-4615-ad63-64049c014575 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:29.019213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960fc98-00d0-423f-8b8a-730b8778496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:29.020779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960fc98-00d0-423f-8b8a-730b8778496f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:29.021388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960fc98-00d0-423f-8b8a-730b8778496f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:29.021388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960fc98-00d0-423f-8b8a-730b8778496f admin admin] PATH_INFO: `/v3/projects/1637cec94d774507be72107d1e07d9a3/users/b8e2c5f1eed3482da9965e70317bf9e6/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:29.062898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960fc98-00d0-423f-8b8a-730b8778496f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1637cec94d774507be72107d1e07d9a3, user_id=b8e2c5f1eed3482da9965e70317bf9e6, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:29.065991 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960fc98-00d0-423f-8b8a-730b8778496f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:29.100546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1288/2564] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:28 2022] PUT /identity/v3/projects/1637cec94d774507be72107d1e07d9a3/users/b8e2c5f1eed3482da9965e70317bf9e6/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:29.116242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c10157-9d20-4e82-9604-d60c41d21dc0 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:29.116582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c10157-9d20-4e82-9604-d60c41d21dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:29.116976 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c10157-9d20-4e82-9604-d60c41d21dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:29.151007 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-28c10157-9d20-4e82-9604-d60c41d21dc0 None None] MFA Rules not processed for user `b8e2c5f1eed3482da9965e70317bf9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:29.156249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-28c10157-9d20-4e82-9604-d60c41d21dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:29.240240 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1277/2565] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:29.254349 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960fc98-00d0-423f-8b8a-730b8778496f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:29.256135 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4960fc98-00d0-423f-8b8a-730b8778496f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:29.320066 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:29.332098 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960fc98-00d0-423f-8b8a-730b8778496f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:29.335984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cadc6-efe6-4ebe-8369-c7d0ed755e42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:29.336664 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cadc6-efe6-4ebe-8369-c7d0ed755e42 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:29.337247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cadc6-efe6-4ebe-8369-c7d0ed755e42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:29.337527 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cadc6-efe6-4ebe-8369-c7d0ed755e42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:29.350352 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cadc6-efe6-4ebe-8369-c7d0ed755e42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:29.351823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cadc6-efe6-4ebe-8369-c7d0ed755e42 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:29.363590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1289/2566] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:30.321580 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c10157-9d20-4e82-9604-d60c41d21dc0 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:30.323131 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-28c10157-9d20-4e82-9604-d60c41d21dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:30.344464 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:30.477564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c10157-9d20-4e82-9604-d60c41d21dc0 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:30.482971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0c988-67ed-4f77-9640-955ad6f65425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:30.483941 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0c988-67ed-4f77-9640-955ad6f65425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:30.484219 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0c988-67ed-4f77-9640-955ad6f65425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:30.484487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0c988-67ed-4f77-9640-955ad6f65425 admin admin] PATH_INFO: `/v3/users/79cc607f89c348ebbcaa8205a4f20d48` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:30.488704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0c988-67ed-4f77-9640-955ad6f65425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79cc607f89c348ebbcaa8205a4f20d48)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:30.491226 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0c988-67ed-4f77-9640-955ad6f65425 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:30.567022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-23a0c988-67ed-4f77-9640-955ad6f65425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79cc607f89c348ebbcaa8205a4f20d48'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:30.580717 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-23a0c988-67ed-4f77-9640-955ad6f65425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79cc607f89c348ebbcaa8205a4f20d48'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:30.604554 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-23a0c988-67ed-4f77-9640-955ad6f65425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79cc607f89c348ebbcaa8205a4f20d48'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:30.605283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-23a0c988-67ed-4f77-9640-955ad6f65425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79cc607f89c348ebbcaa8205a4f20d48'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:30.616557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-23a0c988-67ed-4f77-9640-955ad6f65425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79cc607f89c348ebbcaa8205a4f20d48'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:30.627329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1278/2567] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:34:30 2022] DELETE /identity/v3/users/79cc607f89c348ebbcaa8205a4f20d48 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:34:30.631388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341fe63-1659-49a6-9832-cc0bd8cde787 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:30.631883 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341fe63-1659-49a6-9832-cc0bd8cde787 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:30.631989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341fe63-1659-49a6-9832-cc0bd8cde787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:30.660081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5341fe63-1659-49a6-9832-cc0bd8cde787 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:30.661511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5341fe63-1659-49a6-9832-cc0bd8cde787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:30.758083 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1290/2568] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:30.770345 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0c988-67ed-4f77-9640-955ad6f65425 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:30.771946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-23a0c988-67ed-4f77-9640-955ad6f65425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:30.925859 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0c988-67ed-4f77-9640-955ad6f65425 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:30.929964 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6475b70-6524-446a-b6a9-439542968493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:30.932361 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6475b70-6524-446a-b6a9-439542968493 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:30.932716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6475b70-6524-446a-b6a9-439542968493 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:30.932996 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6475b70-6524-446a-b6a9-439542968493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:30.956566 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6475b70-6524-446a-b6a9-439542968493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:30.956566 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6475b70-6524-446a-b6a9-439542968493 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:30.972712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1279/2569] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:31.423753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341fe63-1659-49a6-9832-cc0bd8cde787 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:31.431070 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5341fe63-1659-49a6-9832-cc0bd8cde787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:31.482755 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341fe63-1659-49a6-9832-cc0bd8cde787 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:31.499966 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:31.500947 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:31.501132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:31.501429 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0 admin admin] PATH_INFO: `/v3/projects/80959d012bf64dfc897518cc3a6e7675` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:31.506853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80959d012bf64dfc897518cc3a6e7675)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:31.508873 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:31.608804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80959d012bf64dfc897518cc3a6e7675', 'request_id': 'req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:31.625759 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80959d012bf64dfc897518cc3a6e7675', 'request_id': 'req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:31.642549 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80959d012bf64dfc897518cc3a6e7675', 'request_id': 'req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:31.666653 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0 admin admin] The token cache is being invalidate because project 80959d012bf64dfc897518cc3a6e7675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:34:31.667046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:31.667985 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:31.670294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1291/2570] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:34:31 2022] DELETE /identity/v3/projects/80959d012bf64dfc897518cc3a6e7675 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:31.674040 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6475b70-6524-446a-b6a9-439542968493 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:31.686645 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6475b70-6524-446a-b6a9-439542968493 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:31.737755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:31.799486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afcedf-6303-4cca-b4b5-5d7590c8e372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:31.800475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afcedf-6303-4cca-b4b5-5d7590c8e372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:31.800799 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afcedf-6303-4cca-b4b5-5d7590c8e372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:31.801073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afcedf-6303-4cca-b4b5-5d7590c8e372 admin admin] PATH_INFO: `/v3/users/420365d798de46ee97f6dc616d795892` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:31.802290 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afcedf-6303-4cca-b4b5-5d7590c8e372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=420365d798de46ee97f6dc616d795892)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:31.805096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afcedf-6303-4cca-b4b5-5d7590c8e372 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:31.866209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-58afcedf-6303-4cca-b4b5-5d7590c8e372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '420365d798de46ee97f6dc616d795892'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:31.878603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-58afcedf-6303-4cca-b4b5-5d7590c8e372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '420365d798de46ee97f6dc616d795892'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:31.895534 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-58afcedf-6303-4cca-b4b5-5d7590c8e372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '420365d798de46ee97f6dc616d795892'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:31.896275 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-58afcedf-6303-4cca-b4b5-5d7590c8e372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '420365d798de46ee97f6dc616d795892'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:31.904387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-58afcedf-6303-4cca-b4b5-5d7590c8e372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '420365d798de46ee97f6dc616d795892'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:31.913166 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1280/2571] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:34:31 2022] DELETE /identity/v3/users/420365d798de46ee97f6dc616d795892 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:34:32.270850 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:32.273024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:32.292064 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4fa1b-9ffc-46d8-85c4-46330bb699a0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:32.378854 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caba4dd-56d7-42e3-beab-bce3eb89255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:32.380230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caba4dd-56d7-42e3-beab-bce3eb89255a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:32.380613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caba4dd-56d7-42e3-beab-bce3eb89255a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:32.380960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caba4dd-56d7-42e3-beab-bce3eb89255a admin admin] PATH_INFO: `/v3/projects/c44abe75b0154bfd90a5cc3838940140` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:32.382234 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caba4dd-56d7-42e3-beab-bce3eb89255a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c44abe75b0154bfd90a5cc3838940140)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:32.385084 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caba4dd-56d7-42e3-beab-bce3eb89255a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:32.403346 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:32.454482 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7caba4dd-56d7-42e3-beab-bce3eb89255a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44abe75b0154bfd90a5cc3838940140', 'request_id': 'req-7caba4dd-56d7-42e3-beab-bce3eb89255a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:32.465943 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7caba4dd-56d7-42e3-beab-bce3eb89255a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44abe75b0154bfd90a5cc3838940140', 'request_id': 'req-7caba4dd-56d7-42e3-beab-bce3eb89255a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:32.477903 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7caba4dd-56d7-42e3-beab-bce3eb89255a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44abe75b0154bfd90a5cc3838940140', 'request_id': 'req-7caba4dd-56d7-42e3-beab-bce3eb89255a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:32.492463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7caba4dd-56d7-42e3-beab-bce3eb89255a admin admin] The token cache is being invalidate because project c44abe75b0154bfd90a5cc3838940140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:34:32.492829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7caba4dd-56d7-42e3-beab-bce3eb89255a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:32.497117 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7caba4dd-56d7-42e3-beab-bce3eb89255a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:32.500571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1292/2572] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:34:32 2022] DELETE /identity/v3/projects/c44abe75b0154bfd90a5cc3838940140 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:32.506719 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b7f52-ed4e-4812-ad3e-48d8b272c9b9 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:32.507221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b7f52-ed4e-4812-ad3e-48d8b272c9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:32.507499 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b7f52-ed4e-4812-ad3e-48d8b272c9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:32.527298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-8d0b7f52-ed4e-4812-ad3e-48d8b272c9b9 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:32.528431 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8d0b7f52-ed4e-4812-ad3e-48d8b272c9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:32.600629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1281/2573] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:34:32.609400 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972578e1-0d19-49ec-82da-f2416adae79f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:32.609657 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972578e1-0d19-49ec-82da-f2416adae79f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:32.609936 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972578e1-0d19-49ec-82da-f2416adae79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:32.631013 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-972578e1-0d19-49ec-82da-f2416adae79f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:32.632228 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-972578e1-0d19-49ec-82da-f2416adae79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:32.641764 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1293/2574] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:32.646216 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b7f52-ed4e-4812-ad3e-48d8b272c9b9 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:32.656552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b7f52-ed4e-4812-ad3e-48d8b272c9b9 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:32.663588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad13f4-1854-4d3d-86d5-ea60b9a482fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:32.664254 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad13f4-1854-4d3d-86d5-ea60b9a482fc admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:32.664550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad13f4-1854-4d3d-86d5-ea60b9a482fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:32.664825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad13f4-1854-4d3d-86d5-ea60b9a482fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:32.665563 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad13f4-1854-4d3d-86d5-ea60b9a482fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:34:32.665867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad13f4-1854-4d3d-86d5-ea60b9a482fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:32.667481 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad13f4-1854-4d3d-86d5-ea60b9a482fc admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:32.685488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1282/2575] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:34:32.687891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972578e1-0d19-49ec-82da-f2416adae79f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:32.703866 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972578e1-0d19-49ec-82da-f2416adae79f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:32.709177 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79131e58-5633-4775-99e8-756c27acfbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:32.709860 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79131e58-5633-4775-99e8-756c27acfbdc admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:32.710143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79131e58-5633-4775-99e8-756c27acfbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:32.710418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79131e58-5633-4775-99e8-756c27acfbdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:32.711130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79131e58-5633-4775-99e8-756c27acfbdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:32.713380 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79131e58-5633-4775-99e8-756c27acfbdc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:32.743114 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1294/2576] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:34:32 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:34:32.747280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad13f4-1854-4d3d-86d5-ea60b9a482fc admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:32.759127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad13f4-1854-4d3d-86d5-ea60b9a482fc admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:32.838573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:32.873148 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79131e58-5633-4775-99e8-756c27acfbdc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:32.875215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-79131e58-5633-4775-99e8-756c27acfbdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:32.884397 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11444a93-8df5-4ff1-a959-f4fda61ee4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:32.885417 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11444a93-8df5-4ff1-a959-f4fda61ee4bf admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:32.887558 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11444a93-8df5-4ff1-a959-f4fda61ee4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:32.888051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11444a93-8df5-4ff1-a959-f4fda61ee4bf admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:32.889873 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11444a93-8df5-4ff1-a959-f4fda61ee4bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:32.895189 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79131e58-5633-4775-99e8-756c27acfbdc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:32.896004 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11444a93-8df5-4ff1-a959-f4fda61ee4bf admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:32.910719 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387a3ee-fb4c-48e2-87bf-52e657a4d582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:32.911895 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387a3ee-fb4c-48e2-87bf-52e657a4d582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:32.912401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387a3ee-fb4c-48e2-87bf-52e657a4d582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:32.912920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387a3ee-fb4c-48e2-87bf-52e657a4d582 admin admin] PATH_INFO: `/v3/users/b8e2c5f1eed3482da9965e70317bf9e6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:32.915159 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387a3ee-fb4c-48e2-87bf-52e657a4d582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e2c5f1eed3482da9965e70317bf9e6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:32.917207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387a3ee-fb4c-48e2-87bf-52e657a4d582 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:32.943666 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1283/2577] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:34:32 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:32.947537 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11444a93-8df5-4ff1-a959-f4fda61ee4bf admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:32.961406 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11444a93-8df5-4ff1-a959-f4fda61ee4bf admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:32.967731 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09a2f2-a6a5-4aee-8ff0-e7c20674998a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:32.968724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09a2f2-a6a5-4aee-8ff0-e7c20674998a admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:32.969086 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09a2f2-a6a5-4aee-8ff0-e7c20674998a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:32.969490 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09a2f2-a6a5-4aee-8ff0-e7c20674998a admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:32.970210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09a2f2-a6a5-4aee-8ff0-e7c20674998a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:32.971979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09a2f2-a6a5-4aee-8ff0-e7c20674998a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:32.991042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1284/2578] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:32.991417 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09a2f2-a6a5-4aee-8ff0-e7c20674998a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:33.002206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a387a3ee-fb4c-48e2-87bf-52e657a4d582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e2c5f1eed3482da9965e70317bf9e6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:33.002566 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09a2f2-a6a5-4aee-8ff0-e7c20674998a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:33.012661 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e945083-724c-4af1-a57a-b96393059dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:33.013248 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a387a3ee-fb4c-48e2-87bf-52e657a4d582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e2c5f1eed3482da9965e70317bf9e6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:33.013437 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e945083-724c-4af1-a57a-b96393059dad admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:33.013990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e945083-724c-4af1-a57a-b96393059dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:33.014468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e945083-724c-4af1-a57a-b96393059dad admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:33.015230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e945083-724c-4af1-a57a-b96393059dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:33.016954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e945083-724c-4af1-a57a-b96393059dad admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:33.024346 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a387a3ee-fb4c-48e2-87bf-52e657a4d582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e2c5f1eed3482da9965e70317bf9e6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:33.025371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a387a3ee-fb4c-48e2-87bf-52e657a4d582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e2c5f1eed3482da9965e70317bf9e6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:33.034727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1285/2579] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:33.036263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e945083-724c-4af1-a57a-b96393059dad admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:33.038168 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4e945083-724c-4af1-a57a-b96393059dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:33.050168 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a387a3ee-fb4c-48e2-87bf-52e657a4d582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e2c5f1eed3482da9965e70317bf9e6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:33.055863 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e945083-724c-4af1-a57a-b96393059dad admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:33.061874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1295/2580] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:34:32 2022] DELETE /identity/v3/users/b8e2c5f1eed3482da9965e70317bf9e6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:33.065143 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b3cff-3226-4df0-98ef-8b79fe865a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:33.066523 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb74a11-c64a-4a2b-a44c-2643ff189017 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:33.066808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb74a11-c64a-4a2b-a44c-2643ff189017 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:33.067207 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b3cff-3226-4df0-98ef-8b79fe865a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:33.067484 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b3cff-3226-4df0-98ef-8b79fe865a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:33.067752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b3cff-3226-4df0-98ef-8b79fe865a0a admin admin] PATH_INFO: `/v3/projects/5306fde8b1c94811a048549032113eae/users/2f4e4dde6b4644969582511a704e9f5b/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:33.068743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb74a11-c64a-4a2b-a44c-2643ff189017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:33.091496 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b3cff-3226-4df0-98ef-8b79fe865a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5306fde8b1c94811a048549032113eae, user_id=2f4e4dde6b4644969582511a704e9f5b, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:33.098974 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6eb74a11-c64a-4a2b-a44c-2643ff189017 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:33.099507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6eb74a11-c64a-4a2b-a44c-2643ff189017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:33.100203 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b3cff-3226-4df0-98ef-8b79fe865a0a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:33.125003 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1286/2581] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:33 2022] PUT /identity/v3/projects/5306fde8b1c94811a048549032113eae/users/2f4e4dde6b4644969582511a704e9f5b/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:34:33.137345 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b3e44-bb5e-43c2-89bf-f1e0948aa70b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:33.138343 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b3e44-bb5e-43c2-89bf-f1e0948aa70b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:33.138842 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b3e44-bb5e-43c2-89bf-f1e0948aa70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:33.159944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:33.173173 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a47b3e44-bb5e-43c2-89bf-f1e0948aa70b None None] MFA Rules not processed for user `2f4e4dde6b4644969582511a704e9f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:33.174398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a47b3e44-bb5e-43c2-89bf-f1e0948aa70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:33.206257 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1296/2582] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:33.216396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb74a11-c64a-4a2b-a44c-2643ff189017 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:33.218023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6eb74a11-c64a-4a2b-a44c-2643ff189017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:33.286442 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1287/2583] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:33.287390 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b3e44-bb5e-43c2-89bf-f1e0948aa70b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:33.296721 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb74a11-c64a-4a2b-a44c-2643ff189017 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:33.366046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f18e3-0339-45ba-8f81-d489161f0111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:33.367103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f18e3-0339-45ba-8f81-d489161f0111 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:33.368218 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f18e3-0339-45ba-8f81-d489161f0111 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:33.369003 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f18e3-0339-45ba-8f81-d489161f0111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:33.386378 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b3e44-bb5e-43c2-89bf-f1e0948aa70b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:33.391595 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84915d-00a2-40e5-ad5a-4aae441e3f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:33.392537 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84915d-00a2-40e5-ad5a-4aae441e3f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:33.392845 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84915d-00a2-40e5-ad5a-4aae441e3f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:33.393120 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84915d-00a2-40e5-ad5a-4aae441e3f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:33.393818 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84915d-00a2-40e5-ad5a-4aae441e3f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:33.395759 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84915d-00a2-40e5-ad5a-4aae441e3f19 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:33.422825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:33.441941 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1288/2584] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:34:33 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:33.443355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84915d-00a2-40e5-ad5a-4aae441e3f19 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:33.456290 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f18e3-0339-45ba-8f81-d489161f0111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:33.459650 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f18e3-0339-45ba-8f81-d489161f0111 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:33.470772 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1297/2585] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:34:33.542921 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84915d-00a2-40e5-ad5a-4aae441e3f19 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:33.548382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643bbe6-e287-49b8-ae78-64eab07c4be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:33.549125 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643bbe6-e287-49b8-ae78-64eab07c4be3 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:33.549395 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643bbe6-e287-49b8-ae78-64eab07c4be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:33.549668 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643bbe6-e287-49b8-ae78-64eab07c4be3 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:33.550549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643bbe6-e287-49b8-ae78-64eab07c4be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:33.552685 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643bbe6-e287-49b8-ae78-64eab07c4be3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:33.587489 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1289/2586] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:34:33 2022] POST /identity/v3/users => generated 299 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:33.590813 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f18e3-0339-45ba-8f81-d489161f0111 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:33.600676 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f18e3-0339-45ba-8f81-d489161f0111 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:33.607584 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27e706-caac-426d-8777-3cd353c56253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:33.608826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27e706-caac-426d-8777-3cd353c56253 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:33.609315 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27e706-caac-426d-8777-3cd353c56253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:33.609860 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27e706-caac-426d-8777-3cd353c56253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:33.610876 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27e706-caac-426d-8777-3cd353c56253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:33.613617 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27e706-caac-426d-8777-3cd353c56253 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:33.631913 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1298/2587] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:33.632379 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643bbe6-e287-49b8-ae78-64eab07c4be3 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:33.648142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643bbe6-e287-49b8-ae78-64eab07c4be3 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:33.657155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee64bf-aaf4-417b-a265-12e726ada44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:33.658049 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee64bf-aaf4-417b-a265-12e726ada44f admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:33.658333 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee64bf-aaf4-417b-a265-12e726ada44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:33.658616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee64bf-aaf4-417b-a265-12e726ada44f admin admin] PATH_INFO: `/v3/projects/e70e2436e8ab4a9d8bd55eab3719aab3/users/828ebc52d3454dea94ca985d9021a2aa/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:33.675399 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee64bf-aaf4-417b-a265-12e726ada44f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70e2436e8ab4a9d8bd55eab3719aab3, user_id=828ebc52d3454dea94ca985d9021a2aa, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:33.679403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee64bf-aaf4-417b-a265-12e726ada44f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:33.698579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1290/2588] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:33 2022] PUT /identity/v3/projects/e70e2436e8ab4a9d8bd55eab3719aab3/users/828ebc52d3454dea94ca985d9021a2aa/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:33.703880 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27e706-caac-426d-8777-3cd353c56253 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:33.717421 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27e706-caac-426d-8777-3cd353c56253 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:33.781434 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:33.807101 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee64bf-aaf4-417b-a265-12e726ada44f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:33.809840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-07ee64bf-aaf4-417b-a265-12e726ada44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:33.812411 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e9e10-9b8b-4e01-bf00-5f20ed0197dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:33.813324 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e9e10-9b8b-4e01-bf00-5f20ed0197dd admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:33.813845 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e9e10-9b8b-4e01-bf00-5f20ed0197dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:33.814279 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e9e10-9b8b-4e01-bf00-5f20ed0197dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:33.815188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e9e10-9b8b-4e01-bf00-5f20ed0197dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:33.817368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e9e10-9b8b-4e01-bf00-5f20ed0197dd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:33.827148 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee64bf-aaf4-417b-a265-12e726ada44f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:33.840566 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1299/2589] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:33.840812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04f5c8-ef2c-4cbd-bf18-1ccf29d8247a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:33.840812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04f5c8-ef2c-4cbd-bf18-1ccf29d8247a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:33.840812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04f5c8-ef2c-4cbd-bf18-1ccf29d8247a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:33.840812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04f5c8-ef2c-4cbd-bf18-1ccf29d8247a admin admin] PATH_INFO: `/v3/projects/1637cec94d774507be72107d1e07d9a3` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:33.842468 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e9e10-9b8b-4e01-bf00-5f20ed0197dd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:33.842759 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04f5c8-ef2c-4cbd-bf18-1ccf29d8247a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1637cec94d774507be72107d1e07d9a3)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:33.845019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04f5c8-ef2c-4cbd-bf18-1ccf29d8247a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:33.856329 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e9e10-9b8b-4e01-bf00-5f20ed0197dd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:33.862640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337f9bc-ec05-46d6-9f13-f0b10363aa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:33.863278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337f9bc-ec05-46d6-9f13-f0b10363aa74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:33.863564 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337f9bc-ec05-46d6-9f13-f0b10363aa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:33.863832 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337f9bc-ec05-46d6-9f13-f0b10363aa74 admin admin] PATH_INFO: `/v3/projects/e70e2436e8ab4a9d8bd55eab3719aab3/users/828ebc52d3454dea94ca985d9021a2aa/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:33.866254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337f9bc-ec05-46d6-9f13-f0b10363aa74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70e2436e8ab4a9d8bd55eab3719aab3, user_id=828ebc52d3454dea94ca985d9021a2aa, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:33.869353 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337f9bc-ec05-46d6-9f13-f0b10363aa74 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:33.895222 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1300/2590] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:33 2022] PUT /identity/v3/projects/e70e2436e8ab4a9d8bd55eab3719aab3/users/828ebc52d3454dea94ca985d9021a2aa/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:33.896771 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbd1a5-a246-4660-a54d-d7315c611bda None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:33.897048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbd1a5-a246-4660-a54d-d7315c611bda None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:33.897323 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbd1a5-a246-4660-a54d-d7315c611bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:33.920936 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ee04f5c8-ef2c-4cbd-bf18-1ccf29d8247a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1637cec94d774507be72107d1e07d9a3', 'request_id': 'req-ee04f5c8-ef2c-4cbd-bf18-1ccf29d8247a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:33.932725 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b7bbd1a5-a246-4660-a54d-d7315c611bda None None] MFA Rules not processed for user `828ebc52d3454dea94ca985d9021a2aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:33.934599 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b7bbd1a5-a246-4660-a54d-d7315c611bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:33.939533 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ee04f5c8-ef2c-4cbd-bf18-1ccf29d8247a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1637cec94d774507be72107d1e07d9a3', 'request_id': 'req-ee04f5c8-ef2c-4cbd-bf18-1ccf29d8247a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:33.951560 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ee04f5c8-ef2c-4cbd-bf18-1ccf29d8247a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1637cec94d774507be72107d1e07d9a3', 'request_id': 'req-ee04f5c8-ef2c-4cbd-bf18-1ccf29d8247a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:33.970189 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ee04f5c8-ef2c-4cbd-bf18-1ccf29d8247a admin admin] The token cache is being invalidate because project 1637cec94d774507be72107d1e07d9a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:34:33.970189 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ee04f5c8-ef2c-4cbd-bf18-1ccf29d8247a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:33.970189 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ee04f5c8-ef2c-4cbd-bf18-1ccf29d8247a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:33.972185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1291/2591] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:34:33 2022] DELETE /identity/v3/projects/1637cec94d774507be72107d1e07d9a3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:34:33.977031 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b766c-7b2c-44b8-98c2-523f87a0c7ea None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:33.977609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b766c-7b2c-44b8-98c2-523f87a0c7ea None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:33.978103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b766c-7b2c-44b8-98c2-523f87a0c7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:34.007980 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5e0b766c-7b2c-44b8-98c2-523f87a0c7ea None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:34.009244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5e0b766c-7b2c-44b8-98c2-523f87a0c7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:34.029722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1301/2592] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:34.046205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbd1a5-a246-4660-a54d-d7315c611bda None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:34.047878 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b7bbd1a5-a246-4660-a54d-d7315c611bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:34.109334 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:34.144591 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbd1a5-a246-4660-a54d-d7315c611bda None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:34.148917 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1292/2593] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:34:34.153541 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c46a6-a852-4ba6-b5a3-7c23d376f106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:34.154711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c46a6-a852-4ba6-b5a3-7c23d376f106 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:34.155036 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c46a6-a852-4ba6-b5a3-7c23d376f106 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:34.156898 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ee420-c036-4580-aa9a-6bdeb47f1435 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:34.157185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ee420-c036-4580-aa9a-6bdeb47f1435 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:34.157460 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ee420-c036-4580-aa9a-6bdeb47f1435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:34.158936 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c46a6-a852-4ba6-b5a3-7c23d376f106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:34.162129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5e7c46a6-a852-4ba6-b5a3-7c23d376f106 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:34.200548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5d6ee420-c036-4580-aa9a-6bdeb47f1435 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:34.202368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5d6ee420-c036-4580-aa9a-6bdeb47f1435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:34.214832 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1293/2594] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:34.218844 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ee420-c036-4580-aa9a-6bdeb47f1435 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:34.238190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ee420-c036-4580-aa9a-6bdeb47f1435 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:34.243649 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d24b1-96b1-4420-845c-621fa792c166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:34.244332 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d24b1-96b1-4420-845c-621fa792c166 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:34.245330 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d24b1-96b1-4420-845c-621fa792c166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:34.245607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d24b1-96b1-4420-845c-621fa792c166 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:34.246351 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d24b1-96b1-4420-845c-621fa792c166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:34:34.246656 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d24b1-96b1-4420-845c-621fa792c166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:34.248927 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d24b1-96b1-4420-845c-621fa792c166 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:34.262431 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1294/2595] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:34:34.263123 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c46a6-a852-4ba6-b5a3-7c23d376f106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:34.264766 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c46a6-a852-4ba6-b5a3-7c23d376f106 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:34.267813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d24b1-96b1-4420-845c-621fa792c166 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:34.277474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1302/2596] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:34.278507 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d24b1-96b1-4420-845c-621fa792c166 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:34.284022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73f4e1-2c21-4ed7-9c63-f60909aa705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:34.284811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73f4e1-2c21-4ed7-9c63-f60909aa705c admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:34.285094 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73f4e1-2c21-4ed7-9c63-f60909aa705c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:34.285371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73f4e1-2c21-4ed7-9c63-f60909aa705c admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:34.286059 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73f4e1-2c21-4ed7-9c63-f60909aa705c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:34.287992 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73f4e1-2c21-4ed7-9c63-f60909aa705c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:34.320456 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1295/2597] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:34:34 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:34:34.324510 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c46a6-a852-4ba6-b5a3-7c23d376f106 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:34.334906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:34.344118 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c46a6-a852-4ba6-b5a3-7c23d376f106 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:34.421081 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c7877-6743-4b1d-a78c-6cdb8b06b787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:34.425288 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c7877-6743-4b1d-a78c-6cdb8b06b787 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:34.425576 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c7877-6743-4b1d-a78c-6cdb8b06b787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:34.425928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c7877-6743-4b1d-a78c-6cdb8b06b787 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:34.427494 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c7877-6743-4b1d-a78c-6cdb8b06b787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:34.429829 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c7877-6743-4b1d-a78c-6cdb8b06b787 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:34.458063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1303/2598] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:34:34 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:34.462329 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73f4e1-2c21-4ed7-9c63-f60909aa705c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:34.475496 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73f4e1-2c21-4ed7-9c63-f60909aa705c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:34.481293 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097b08f-0c2a-47dd-8acc-738d5edd899d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:34.481979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097b08f-0c2a-47dd-8acc-738d5edd899d admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:34.482516 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097b08f-0c2a-47dd-8acc-738d5edd899d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:34.482807 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097b08f-0c2a-47dd-8acc-738d5edd899d admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:34.483826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097b08f-0c2a-47dd-8acc-738d5edd899d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:34.486181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097b08f-0c2a-47dd-8acc-738d5edd899d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:34.498397 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1296/2599] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:34.502414 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c7877-6743-4b1d-a78c-6cdb8b06b787 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:34.512958 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c7877-6743-4b1d-a78c-6cdb8b06b787 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:34.523424 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f72a7-bbd9-437b-bdc9-6c73310d9baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:34.524104 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f72a7-bbd9-437b-bdc9-6c73310d9baf admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:34.524379 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f72a7-bbd9-437b-bdc9-6c73310d9baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:34.524693 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f72a7-bbd9-437b-bdc9-6c73310d9baf admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:34.525433 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f72a7-bbd9-437b-bdc9-6c73310d9baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:34.527488 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f72a7-bbd9-437b-bdc9-6c73310d9baf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:34.548604 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1304/2600] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:34.552700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097b08f-0c2a-47dd-8acc-738d5edd899d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:34.584832 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097b08f-0c2a-47dd-8acc-738d5edd899d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:34.592613 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1bdbf-3d3c-4b30-b61b-52049c6fc0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:34.594173 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1bdbf-3d3c-4b30-b61b-52049c6fc0c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:34.594627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1bdbf-3d3c-4b30-b61b-52049c6fc0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:34.595110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1bdbf-3d3c-4b30-b61b-52049c6fc0c1 admin admin] PATH_INFO: `/v3/projects/0adc76934ff048bb9c5d59ea7943793d/users/ae0ac7018f1e4f1785892ba205763a40/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:34.621403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1bdbf-3d3c-4b30-b61b-52049c6fc0c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0adc76934ff048bb9c5d59ea7943793d, user_id=ae0ac7018f1e4f1785892ba205763a40, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:34.626699 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1bdbf-3d3c-4b30-b61b-52049c6fc0c1 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:34.662860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1297/2601] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:34 2022] PUT /identity/v3/projects/0adc76934ff048bb9c5d59ea7943793d/users/ae0ac7018f1e4f1785892ba205763a40/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:34.665894 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf318d-61ac-4857-b6a9-de68743bcb71 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:34.666458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf318d-61ac-4857-b6a9-de68743bcb71 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:34.666916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf318d-61ac-4857-b6a9-de68743bcb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:34.744656 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-01bf318d-61ac-4857-b6a9-de68743bcb71 None None] MFA Rules not processed for user `ae0ac7018f1e4f1785892ba205763a40`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:34.744656 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-01bf318d-61ac-4857-b6a9-de68743bcb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:34.938912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1305/2602] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:34.944324 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1bdbf-3d3c-4b30-b61b-52049c6fc0c1 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:35.024751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1bdbf-3d3c-4b30-b61b-52049c6fc0c1 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:35.029662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af596d-4641-482a-89f2-06fb5f443c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:35.030347 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af596d-4641-482a-89f2-06fb5f443c12 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:35.030627 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af596d-4641-482a-89f2-06fb5f443c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:35.030900 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af596d-4641-482a-89f2-06fb5f443c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:35.031591 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af596d-4641-482a-89f2-06fb5f443c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:35.033553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af596d-4641-482a-89f2-06fb5f443c12 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:35.068734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1298/2603] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:34:34 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:35.068970 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf318d-61ac-4857-b6a9-de68743bcb71 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:35.080247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf318d-61ac-4857-b6a9-de68743bcb71 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:35.159748 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3954c0-6c06-4e1a-b2d8-ca64d1a717fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:35.160813 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3954c0-6c06-4e1a-b2d8-ca64d1a717fd admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:35.161157 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3954c0-6c06-4e1a-b2d8-ca64d1a717fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:35.161501 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3954c0-6c06-4e1a-b2d8-ca64d1a717fd admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:35.162326 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3954c0-6c06-4e1a-b2d8-ca64d1a717fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:35.164389 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3954c0-6c06-4e1a-b2d8-ca64d1a717fd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:35.190117 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1306/2604] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:34:35 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:35.191202 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af596d-4641-482a-89f2-06fb5f443c12 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:35.205716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af596d-4641-482a-89f2-06fb5f443c12 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:35.210548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb2d59-2433-484e-9fc4-296f48627424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:35.211373 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb2d59-2433-484e-9fc4-296f48627424 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:35.212062 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb2d59-2433-484e-9fc4-296f48627424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:35.212334 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb2d59-2433-484e-9fc4-296f48627424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:35.213101 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb2d59-2433-484e-9fc4-296f48627424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:35.214698 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb2d59-2433-484e-9fc4-296f48627424 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:35.233288 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1299/2605] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:35.234542 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3954c0-6c06-4e1a-b2d8-ca64d1a717fd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:35.240037 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:35.249166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3954c0-6c06-4e1a-b2d8-ca64d1a717fd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:35.253730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db334105-742d-4e1a-9371-314b51616fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:35.254399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db334105-742d-4e1a-9371-314b51616fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:35.254950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db334105-742d-4e1a-9371-314b51616fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:35.254950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db334105-742d-4e1a-9371-314b51616fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:35.255656 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db334105-742d-4e1a-9371-314b51616fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:35.257286 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db334105-742d-4e1a-9371-314b51616fa2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:35.268724 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1307/2606] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:35.273079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb2d59-2433-484e-9fc4-296f48627424 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:35.287256 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb2d59-2433-484e-9fc4-296f48627424 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:35.292217 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d1f82-4f46-4913-946f-7f02d23b0025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:35.293154 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d1f82-4f46-4913-946f-7f02d23b0025 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:35.293432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d1f82-4f46-4913-946f-7f02d23b0025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:35.293704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d1f82-4f46-4913-946f-7f02d23b0025 admin admin] PATH_INFO: `/v3/projects/e472d6998216411abac162ad1e5972a4/users/4dae960ff6cb4f9b87ef1182ad1df32e/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:35.314531 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d1f82-4f46-4913-946f-7f02d23b0025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e472d6998216411abac162ad1e5972a4, user_id=4dae960ff6cb4f9b87ef1182ad1df32e, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:35.317403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d1f82-4f46-4913-946f-7f02d23b0025 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:35.341778 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1300/2607] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:35 2022] PUT /identity/v3/projects/e472d6998216411abac162ad1e5972a4/users/4dae960ff6cb4f9b87ef1182ad1df32e/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:35.353199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17562080-772c-481b-914e-b25748928fb4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:35.353912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17562080-772c-481b-914e-b25748928fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:35.353912 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17562080-772c-481b-914e-b25748928fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:35.386398 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-17562080-772c-481b-914e-b25748928fb4 None None] MFA Rules not processed for user `4dae960ff6cb4f9b87ef1182ad1df32e`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:35.387771 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-17562080-772c-481b-914e-b25748928fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:35.490171 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1308/2608] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:35.501857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d1f82-4f46-4913-946f-7f02d23b0025 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:35.532773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:35.591121 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d1f82-4f46-4913-946f-7f02d23b0025 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:35.597384 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98891dab-64ea-4854-b9d6-9e656b51caa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:35.598174 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98891dab-64ea-4854-b9d6-9e656b51caa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:35.598522 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98891dab-64ea-4854-b9d6-9e656b51caa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:35.599016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98891dab-64ea-4854-b9d6-9e656b51caa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:35.599787 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98891dab-64ea-4854-b9d6-9e656b51caa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:35.601791 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98891dab-64ea-4854-b9d6-9e656b51caa3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:35.635273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1301/2609] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:34:35 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:35.644424 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17562080-772c-481b-914e-b25748928fb4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:35.656042 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17562080-772c-481b-914e-b25748928fb4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:35.726441 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b47e5-b261-4962-bd4d-926be7d2db8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:35.727142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b47e5-b261-4962-bd4d-926be7d2db8c admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:35.727568 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b47e5-b261-4962-bd4d-926be7d2db8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:35.727844 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b47e5-b261-4962-bd4d-926be7d2db8c admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:35.728606 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b47e5-b261-4962-bd4d-926be7d2db8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:35.730670 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b47e5-b261-4962-bd4d-926be7d2db8c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:35.755963 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1309/2610] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:34:35 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:34:35.760236 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98891dab-64ea-4854-b9d6-9e656b51caa3 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:35.771895 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98891dab-64ea-4854-b9d6-9e656b51caa3 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:35.776825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31a92-3295-4c72-8a5d-21ec29c9bba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:35.777513 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31a92-3295-4c72-8a5d-21ec29c9bba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:35.777795 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31a92-3295-4c72-8a5d-21ec29c9bba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:35.778068 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31a92-3295-4c72-8a5d-21ec29c9bba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:35.779133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d31a92-3295-4c72-8a5d-21ec29c9bba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:35.780827 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d31a92-3295-4c72-8a5d-21ec29c9bba8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:35.794291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1302/2611] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:35.798956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b47e5-b261-4962-bd4d-926be7d2db8c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:35.811209 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b47e5-b261-4962-bd4d-926be7d2db8c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:35.816791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a9293-1439-45d3-b509-fc75a37a3359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:35.817919 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a9293-1439-45d3-b509-fc75a37a3359 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:35.818302 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a9293-1439-45d3-b509-fc75a37a3359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:35.818634 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a9293-1439-45d3-b509-fc75a37a3359 admin admin] PATH_INFO: `/v3/projects/f018eabb57294d258d982b1fe83e7736/users/09026528bd5b4e50b239670c1cdfe44d/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:35.839593 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a9293-1439-45d3-b509-fc75a37a3359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f018eabb57294d258d982b1fe83e7736, user_id=09026528bd5b4e50b239670c1cdfe44d, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:35.843025 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a9293-1439-45d3-b509-fc75a37a3359 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:35.889154 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1310/2612] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:35 2022] PUT /identity/v3/projects/f018eabb57294d258d982b1fe83e7736/users/09026528bd5b4e50b239670c1cdfe44d/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:35.893681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31a92-3295-4c72-8a5d-21ec29c9bba8 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:35.905698 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31a92-3295-4c72-8a5d-21ec29c9bba8 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:35.974863 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb90a3-93d1-4de2-a63a-867181728c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:35.975638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb90a3-93d1-4de2-a63a-867181728c27 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:35.975849 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb90a3-93d1-4de2-a63a-867181728c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:35.976097 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb90a3-93d1-4de2-a63a-867181728c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:35.976975 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb90a3-93d1-4de2-a63a-867181728c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:35.978460 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb90a3-93d1-4de2-a63a-867181728c27 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:35.989990 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1303/2613] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:35.994254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a9293-1439-45d3-b509-fc75a37a3359 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:36.005951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a9293-1439-45d3-b509-fc75a37a3359 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:36.011126 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cedf8-5867-4256-94d9-733b39f42e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:36.012272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cedf8-5867-4256-94d9-733b39f42e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:36.012646 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cedf8-5867-4256-94d9-733b39f42e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:36.013193 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cedf8-5867-4256-94d9-733b39f42e1e admin admin] PATH_INFO: `/v3/projects/f018eabb57294d258d982b1fe83e7736/users/09026528bd5b4e50b239670c1cdfe44d/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:36.015722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cedf8-5867-4256-94d9-733b39f42e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f018eabb57294d258d982b1fe83e7736, user_id=09026528bd5b4e50b239670c1cdfe44d, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:36.018477 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cedf8-5867-4256-94d9-733b39f42e1e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:36.030932 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1311/2614] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:35 2022] PUT /identity/v3/projects/f018eabb57294d258d982b1fe83e7736/users/09026528bd5b4e50b239670c1cdfe44d/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:36.040735 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f3c70-a9fa-4fca-b706-b84d6a775a7a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:36.041132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f3c70-a9fa-4fca-b706-b84d6a775a7a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:36.041417 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f3c70-a9fa-4fca-b706-b84d6a775a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:36.073951 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-b13f3c70-a9fa-4fca-b706-b84d6a775a7a None None] MFA Rules not processed for user `09026528bd5b4e50b239670c1cdfe44d`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:36.075487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b13f3c70-a9fa-4fca-b706-b84d6a775a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:36.207939 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1304/2615] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:36.220200 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cedf8-5867-4256-94d9-733b39f42e1e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:36.288841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:36.329202 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cedf8-5867-4256-94d9-733b39f42e1e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:36.335017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c9da5-316a-4eea-a8a5-051b25fd12de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:36.335770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c9da5-316a-4eea-a8a5-051b25fd12de service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:36.336188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c9da5-316a-4eea-a8a5-051b25fd12de service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:36.336916 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c9da5-316a-4eea-a8a5-051b25fd12de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:36.406558 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c9da5-316a-4eea-a8a5-051b25fd12de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:36.408413 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c9da5-316a-4eea-a8a5-051b25fd12de service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:36.418803 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1312/2616] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:37.427679 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f3c70-a9fa-4fca-b706-b84d6a775a7a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:37.429272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b13f3c70-a9fa-4fca-b706-b84d6a775a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:37.448422 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:37.489765 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f3c70-a9fa-4fca-b706-b84d6a775a7a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:37.493498 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29524fbc-8689-4e11-85ae-4c0a18f2ae04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:37.494147 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29524fbc-8689-4e11-85ae-4c0a18f2ae04 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:37.494424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29524fbc-8689-4e11-85ae-4c0a18f2ae04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:37.494695 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29524fbc-8689-4e11-85ae-4c0a18f2ae04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:37.496462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-29524fbc-8689-4e11-85ae-4c0a18f2ae04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:37.506112 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29524fbc-8689-4e11-85ae-4c0a18f2ae04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:37.507547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29524fbc-8689-4e11-85ae-4c0a18f2ae04 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:37.516888 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1305/2617] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:38.023563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c9da5-316a-4eea-a8a5-051b25fd12de service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:38.025116 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7b3c9da5-316a-4eea-a8a5-051b25fd12de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:38.037201 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c9da5-316a-4eea-a8a5-051b25fd12de service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:38.041076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c876484-36f5-41bf-9aac-514290561056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:38.041719 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c876484-36f5-41bf-9aac-514290561056 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:38.042003 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c876484-36f5-41bf-9aac-514290561056 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:38.042277 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c876484-36f5-41bf-9aac-514290561056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:38.103394 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c876484-36f5-41bf-9aac-514290561056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:38.104907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c876484-36f5-41bf-9aac-514290561056 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:38.114315 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1313/2618] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:38.658033 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29524fbc-8689-4e11-85ae-4c0a18f2ae04 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:38.669493 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29524fbc-8689-4e11-85ae-4c0a18f2ae04 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:38.673876 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e367a7e-4dc4-4545-8ab9-f0736ab2068d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:38.674520 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e367a7e-4dc4-4545-8ab9-f0736ab2068d service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:38.674815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e367a7e-4dc4-4545-8ab9-f0736ab2068d service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:38.675222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e367a7e-4dc4-4545-8ab9-f0736ab2068d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:38.689978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e367a7e-4dc4-4545-8ab9-f0736ab2068d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:38.691421 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e367a7e-4dc4-4545-8ab9-f0736ab2068d service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:38.703582 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1306/2619] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:38.774311 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c876484-36f5-41bf-9aac-514290561056 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:38.784080 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c876484-36f5-41bf-9aac-514290561056 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:38.788817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1ee07-9bc0-45e9-9abc-72a677821c91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:38.789667 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1ee07-9bc0-45e9-9abc-72a677821c91 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:38.789999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1ee07-9bc0-45e9-9abc-72a677821c91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:38.790269 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1ee07-9bc0-45e9-9abc-72a677821c91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:38.854041 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1ee07-9bc0-45e9-9abc-72a677821c91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:38.855481 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1ee07-9bc0-45e9-9abc-72a677821c91 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:38.865502 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1314/2620] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:41.013580 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e367a7e-4dc4-4545-8ab9-f0736ab2068d service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:41.024275 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e367a7e-4dc4-4545-8ab9-f0736ab2068d service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:41.030239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30899a69-6075-4ac2-8c9d-6b611c6ddef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:41.030902 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30899a69-6075-4ac2-8c9d-6b611c6ddef8 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:41.031186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30899a69-6075-4ac2-8c9d-6b611c6ddef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:41.031443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30899a69-6075-4ac2-8c9d-6b611c6ddef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:41.033796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-30899a69-6075-4ac2-8c9d-6b611c6ddef8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:41.044303 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30899a69-6075-4ac2-8c9d-6b611c6ddef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:41.045915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30899a69-6075-4ac2-8c9d-6b611c6ddef8 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:41.054443 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1307/2621] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:41.165982 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc5db5-2320-4e04-a6e6-6c1d379bedff None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:41.166553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc5db5-2320-4e04-a6e6-6c1d379bedff None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:41.166791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc5db5-2320-4e04-a6e6-6c1d379bedff None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:41.168464 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1315/2622] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 03:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:34:41.175281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d6c8d-0078-48a1-90ae-9f5fcc82a508 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:41.175624 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d6c8d-0078-48a1-90ae-9f5fcc82a508 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:41.175862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d6c8d-0078-48a1-90ae-9f5fcc82a508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:41.202360 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9e7d6c8d-0078-48a1-90ae-9f5fcc82a508 None None] MFA Rules not processed for user `0c43d9d0a6264b19a843077a4669ce70`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:41.203580 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9e7d6c8d-0078-48a1-90ae-9f5fcc82a508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:41.284947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1308/2623] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 03:34:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:41.296535 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc5db5-2320-4e04-a6e6-6c1d379bedff None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:41.298275 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-00cc5db5-2320-4e04-a6e6-6c1d379bedff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:41.326581 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:41.365711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc5db5-2320-4e04-a6e6-6c1d379bedff None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:41.369378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a7850-efa5-4f06-b0bc-ea3be087d2d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97fe9d04ccb445208f3783a8b55cd31e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:41.370028 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a7850-efa5-4f06-b0bc-ea3be087d2d6 service glance] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:41.370309 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a7850-efa5-4f06-b0bc-ea3be087d2d6 service glance] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:41.370581 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a7850-efa5-4f06-b0bc-ea3be087d2d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:41.382117 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a7850-efa5-4f06-b0bc-ea3be087d2d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:41.383692 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a7850-efa5-4f06-b0bc-ea3be087d2d6 service glance] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:41.396671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1316/2624] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:41.467014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65613f4-c496-4776-9a12-68adfb4e081c None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:41.467392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65613f4-c496-4776-9a12-68adfb4e081c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:41.467711 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65613f4-c496-4776-9a12-68adfb4e081c None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:41.469281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1309/2625] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 03:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:34:41.474463 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fc8c6-6cbd-412f-a2e0-ab3081f5879c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:41.474752 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fc8c6-6cbd-412f-a2e0-ab3081f5879c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:41.475056 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fc8c6-6cbd-412f-a2e0-ab3081f5879c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:41.498711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-796fc8c6-6cbd-412f-a2e0-ab3081f5879c None None] MFA Rules not processed for user `c2908efc19944583810abceb4c5d8d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:41.500011 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-796fc8c6-6cbd-412f-a2e0-ab3081f5879c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:41.507051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1317/2626] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 03:34:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:41.519976 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65613f4-c496-4776-9a12-68adfb4e081c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:41.533591 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65613f4-c496-4776-9a12-68adfb4e081c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:41.537284 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec1f50-9ad9-4e2c-8305-1d162174a223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:41.537979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec1f50-9ad9-4e2c-8305-1d162174a223 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:41.538305 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec1f50-9ad9-4e2c-8305-1d162174a223 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:41.538609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec1f50-9ad9-4e2c-8305-1d162174a223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:41.547118 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec1f50-9ad9-4e2c-8305-1d162174a223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:41.548716 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec1f50-9ad9-4e2c-8305-1d162174a223 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:41.557427 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1310/2627] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:41.652760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52766cd8-602a-4346-807e-8087fb892bae None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:41.652980 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52766cd8-602a-4346-807e-8087fb892bae None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:41.653258 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52766cd8-602a-4346-807e-8087fb892bae None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:41.655001 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1318/2628] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 03:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:34:41.662725 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589dd27-74f0-41b0-a8e2-633b0dfe61bf None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:41.663021 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589dd27-74f0-41b0-a8e2-633b0dfe61bf None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:41.663326 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589dd27-74f0-41b0-a8e2-633b0dfe61bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:41.685468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-7589dd27-74f0-41b0-a8e2-633b0dfe61bf None None] MFA Rules not processed for user `0c43d9d0a6264b19a843077a4669ce70`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:41.686910 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7589dd27-74f0-41b0-a8e2-633b0dfe61bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:41.698829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1311/2629] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 03:34:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:34:41.710329 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52766cd8-602a-4346-807e-8087fb892bae None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:41.713917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-52766cd8-602a-4346-807e-8087fb892bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:41.730072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52766cd8-602a-4346-807e-8087fb892bae None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:41.734221 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaba6e-4faf-4571-af2d-9432c3aa33b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:41.734959 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaba6e-4faf-4571-af2d-9432c3aa33b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:41.735304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaba6e-4faf-4571-af2d-9432c3aa33b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:41.735674 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaba6e-4faf-4571-af2d-9432c3aa33b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:41.747540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afaba6e-4faf-4571-af2d-9432c3aa33b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:41.749435 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afaba6e-4faf-4571-af2d-9432c3aa33b8 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:41.760885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1319/2630] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:41.829576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589dd27-74f0-41b0-a8e2-633b0dfe61bf None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:41.831469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7589dd27-74f0-41b0-a8e2-633b0dfe61bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:41.909347 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589dd27-74f0-41b0-a8e2-633b0dfe61bf None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:41.914423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adfdea-cbde-45ba-9a87-215cb5c839c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '361ad35021eb43cca46d9b66e6f24ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:41.915074 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adfdea-cbde-45ba-9a87-215cb5c839c3 service placement] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:41.915342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adfdea-cbde-45ba-9a87-215cb5c839c3 service placement] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:41.915616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adfdea-cbde-45ba-9a87-215cb5c839c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:41.917399 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e4adfdea-cbde-45ba-9a87-215cb5c839c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:41.926245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:41.930798 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adfdea-cbde-45ba-9a87-215cb5c839c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:41.932562 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adfdea-cbde-45ba-9a87-215cb5c839c3 service placement] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:41.942648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1312/2631] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:42.613558 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaba6e-4faf-4571-af2d-9432c3aa33b8 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:42.695189 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaba6e-4faf-4571-af2d-9432c3aa33b8 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:42.700119 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de174b2-8b5b-4b2d-8e64-5c9294c2b6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:42.701411 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de174b2-8b5b-4b2d-8e64-5c9294c2b6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:42.701411 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de174b2-8b5b-4b2d-8e64-5c9294c2b6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:42.701737 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de174b2-8b5b-4b2d-8e64-5c9294c2b6d7 admin admin] PATH_INFO: `/v3/users/ae0ac7018f1e4f1785892ba205763a40` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:42.702990 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de174b2-8b5b-4b2d-8e64-5c9294c2b6d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae0ac7018f1e4f1785892ba205763a40)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:42.704961 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de174b2-8b5b-4b2d-8e64-5c9294c2b6d7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:42.765107 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0de174b2-8b5b-4b2d-8e64-5c9294c2b6d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae0ac7018f1e4f1785892ba205763a40'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:42.776506 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0de174b2-8b5b-4b2d-8e64-5c9294c2b6d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae0ac7018f1e4f1785892ba205763a40'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:42.784789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0de174b2-8b5b-4b2d-8e64-5c9294c2b6d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae0ac7018f1e4f1785892ba205763a40'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:42.785478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0de174b2-8b5b-4b2d-8e64-5c9294c2b6d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae0ac7018f1e4f1785892ba205763a40'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:42.798040 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0de174b2-8b5b-4b2d-8e64-5c9294c2b6d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae0ac7018f1e4f1785892ba205763a40'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:42.805023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1320/2632] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:34:42 2022] DELETE /identity/v3/users/ae0ac7018f1e4f1785892ba205763a40 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:42.809770 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888d723-58e2-4f3c-aae4-2501a1e689c2 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:42.810752 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888d723-58e2-4f3c-aae4-2501a1e689c2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:42.811050 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888d723-58e2-4f3c-aae4-2501a1e689c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:42.830025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-0888d723-58e2-4f3c-aae4-2501a1e689c2 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:42.831414 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0888d723-58e2-4f3c-aae4-2501a1e689c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:42.900617 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1313/2633] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:42.909065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de174b2-8b5b-4b2d-8e64-5c9294c2b6d7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:42.910606 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0de174b2-8b5b-4b2d-8e64-5c9294c2b6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:42.938250 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:42.973158 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de174b2-8b5b-4b2d-8e64-5c9294c2b6d7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:42.977047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c5bcc-84ba-4f04-8abe-612ac6f0fcae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:42.977689 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c5bcc-84ba-4f04-8abe-612ac6f0fcae service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:42.977963 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c5bcc-84ba-4f04-8abe-612ac6f0fcae service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:42.978228 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c5bcc-84ba-4f04-8abe-612ac6f0fcae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:42.987860 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c5bcc-84ba-4f04-8abe-612ac6f0fcae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:42.989353 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c5bcc-84ba-4f04-8abe-612ac6f0fcae service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:42.998941 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1321/2634] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:43.277226 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888d723-58e2-4f3c-aae4-2501a1e689c2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:43.279078 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0888d723-58e2-4f3c-aae4-2501a1e689c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:43.293661 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888d723-58e2-4f3c-aae4-2501a1e689c2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:43.298519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e20140-4db0-4daf-b06d-bd5345e98a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:43.299485 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e20140-4db0-4daf-b06d-bd5345e98a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:43.299978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e20140-4db0-4daf-b06d-bd5345e98a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:43.300315 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e20140-4db0-4daf-b06d-bd5345e98a7c admin admin] PATH_INFO: `/v3/projects/0adc76934ff048bb9c5d59ea7943793d` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:43.302199 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e20140-4db0-4daf-b06d-bd5345e98a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0adc76934ff048bb9c5d59ea7943793d)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:43.304436 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e20140-4db0-4daf-b06d-bd5345e98a7c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:43.353959 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-59e20140-4db0-4daf-b06d-bd5345e98a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0adc76934ff048bb9c5d59ea7943793d', 'request_id': 'req-59e20140-4db0-4daf-b06d-bd5345e98a7c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:43.364057 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-59e20140-4db0-4daf-b06d-bd5345e98a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0adc76934ff048bb9c5d59ea7943793d', 'request_id': 'req-59e20140-4db0-4daf-b06d-bd5345e98a7c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:43.369602 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-59e20140-4db0-4daf-b06d-bd5345e98a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0adc76934ff048bb9c5d59ea7943793d', 'request_id': 'req-59e20140-4db0-4daf-b06d-bd5345e98a7c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:43.382403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-59e20140-4db0-4daf-b06d-bd5345e98a7c admin admin] The token cache is being invalidate because project 0adc76934ff048bb9c5d59ea7943793d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:34:43.382692 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-59e20140-4db0-4daf-b06d-bd5345e98a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:43.383406 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-59e20140-4db0-4daf-b06d-bd5345e98a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:43.385077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1314/2635] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:34:43 2022] DELETE /identity/v3/projects/0adc76934ff048bb9c5d59ea7943793d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:43.389159 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c5bcc-84ba-4f04-8abe-612ac6f0fcae service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:43.399279 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c5bcc-84ba-4f04-8abe-612ac6f0fcae service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:43.457380 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f36e9-106b-4046-bd76-bfe51940cffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:43.458256 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f36e9-106b-4046-bd76-bfe51940cffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:43.458540 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f36e9-106b-4046-bd76-bfe51940cffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:43.458860 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f36e9-106b-4046-bd76-bfe51940cffc admin admin] PATH_INFO: `/v3/users/4dae960ff6cb4f9b87ef1182ad1df32e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:43.460025 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f36e9-106b-4046-bd76-bfe51940cffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dae960ff6cb4f9b87ef1182ad1df32e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:43.462434 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f36e9-106b-4046-bd76-bfe51940cffc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:43.516102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-047f36e9-106b-4046-bd76-bfe51940cffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dae960ff6cb4f9b87ef1182ad1df32e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:43.527017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-047f36e9-106b-4046-bd76-bfe51940cffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dae960ff6cb4f9b87ef1182ad1df32e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:43.535615 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-047f36e9-106b-4046-bd76-bfe51940cffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dae960ff6cb4f9b87ef1182ad1df32e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:43.536456 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-047f36e9-106b-4046-bd76-bfe51940cffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dae960ff6cb4f9b87ef1182ad1df32e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:43.550747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-047f36e9-106b-4046-bd76-bfe51940cffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dae960ff6cb4f9b87ef1182ad1df32e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:43.557240 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1322/2636] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:34:43 2022] DELETE /identity/v3/users/4dae960ff6cb4f9b87ef1182ad1df32e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:43.800054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e20140-4db0-4daf-b06d-bd5345e98a7c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:43.801570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-59e20140-4db0-4daf-b06d-bd5345e98a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:43.814979 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e20140-4db0-4daf-b06d-bd5345e98a7c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:43.857626 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f36e9-106b-4046-bd76-bfe51940cffc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:43.859121 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-047f36e9-106b-4046-bd76-bfe51940cffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:43.886268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa00bf5-946b-440f-8321-e449149fc0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:43.887118 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa00bf5-946b-440f-8321-e449149fc0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:43.887453 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa00bf5-946b-440f-8321-e449149fc0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:43.887719 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa00bf5-946b-440f-8321-e449149fc0f3 admin admin] PATH_INFO: `/v3/users/2f4e4dde6b4644969582511a704e9f5b` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:43.889067 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa00bf5-946b-440f-8321-e449149fc0f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f4e4dde6b4644969582511a704e9f5b)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:43.890954 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa00bf5-946b-440f-8321-e449149fc0f3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:43.913191 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:43.923386 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:43.944079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f36e9-106b-4046-bd76-bfe51940cffc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:43.944868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-faa00bf5-946b-440f-8321-e449149fc0f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f4e4dde6b4644969582511a704e9f5b'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:43.951215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f348b2-811a-466d-9832-4cebde774a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:43.952306 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f348b2-811a-466d-9832-4cebde774a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:43.952719 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f348b2-811a-466d-9832-4cebde774a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:43.952987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f348b2-811a-466d-9832-4cebde774a92 admin admin] PATH_INFO: `/v3/projects/e472d6998216411abac162ad1e5972a4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:43.954767 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f348b2-811a-466d-9832-4cebde774a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e472d6998216411abac162ad1e5972a4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:43.954917 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-faa00bf5-946b-440f-8321-e449149fc0f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f4e4dde6b4644969582511a704e9f5b'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:43.956998 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f348b2-811a-466d-9832-4cebde774a92 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:43.969779 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-faa00bf5-946b-440f-8321-e449149fc0f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f4e4dde6b4644969582511a704e9f5b'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:43.970524 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-faa00bf5-946b-440f-8321-e449149fc0f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f4e4dde6b4644969582511a704e9f5b'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:43.977652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-faa00bf5-946b-440f-8321-e449149fc0f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f4e4dde6b4644969582511a704e9f5b'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:43.984722 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1315/2637] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:34:43 2022] DELETE /identity/v3/users/2f4e4dde6b4644969582511a704e9f5b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:43.989524 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6623b72-545b-4091-93b5-7df2744edee2 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:43.989872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6623b72-545b-4091-93b5-7df2744edee2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:43.990219 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6623b72-545b-4091-93b5-7df2744edee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:44.009481 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a3f348b2-811a-466d-9832-4cebde774a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e472d6998216411abac162ad1e5972a4', 'request_id': 'req-a3f348b2-811a-466d-9832-4cebde774a92'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.011377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a6623b72-545b-4091-93b5-7df2744edee2 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:44.012620 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a6623b72-545b-4091-93b5-7df2744edee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:44.019133 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a3f348b2-811a-466d-9832-4cebde774a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e472d6998216411abac162ad1e5972a4', 'request_id': 'req-a3f348b2-811a-466d-9832-4cebde774a92'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.025889 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a3f348b2-811a-466d-9832-4cebde774a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e472d6998216411abac162ad1e5972a4', 'request_id': 'req-a3f348b2-811a-466d-9832-4cebde774a92'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.037559 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a3f348b2-811a-466d-9832-4cebde774a92 admin admin] The token cache is being invalidate because project e472d6998216411abac162ad1e5972a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:34:44.037842 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a3f348b2-811a-466d-9832-4cebde774a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.038468 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a3f348b2-811a-466d-9832-4cebde774a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.040029 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1323/2638] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:34:43 2022] DELETE /identity/v3/projects/e472d6998216411abac162ad1e5972a4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:44.041428 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f2bf8-7e68-465d-bd3a-0a68b9ddb0dc None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:44.041707 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f2bf8-7e68-465d-bd3a-0a68b9ddb0dc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:44.041975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f2bf8-7e68-465d-bd3a-0a68b9ddb0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:44.060267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-301f2bf8-7e68-465d-bd3a-0a68b9ddb0dc None None] MFA Rules not processed for user `e23aea853cce44698b19d6bc087093c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:44.061591 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-301f2bf8-7e68-465d-bd3a-0a68b9ddb0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:44.076240 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1316/2639] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:44.079692 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6623b72-545b-4091-93b5-7df2744edee2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:44.079692 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a6623b72-545b-4091-93b5-7df2744edee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:44.090488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6623b72-545b-4091-93b5-7df2744edee2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:44.095132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b39759-ed66-4809-9554-1f077fe50e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:44.096003 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b39759-ed66-4809-9554-1f077fe50e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:44.096281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b39759-ed66-4809-9554-1f077fe50e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:44.096585 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b39759-ed66-4809-9554-1f077fe50e8c admin admin] PATH_INFO: `/v3/users/09026528bd5b4e50b239670c1cdfe44d` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:44.097794 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b39759-ed66-4809-9554-1f077fe50e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=09026528bd5b4e50b239670c1cdfe44d)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:44.099715 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b39759-ed66-4809-9554-1f077fe50e8c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:44.119272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1324/2640] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 03:34:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:44.119879 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f2bf8-7e68-465d-bd3a-0a68b9ddb0dc None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:44.121205 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-301f2bf8-7e68-465d-bd3a-0a68b9ddb0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:44.152976 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-98b39759-ed66-4809-9554-1f077fe50e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09026528bd5b4e50b239670c1cdfe44d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.161151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-98b39759-ed66-4809-9554-1f077fe50e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09026528bd5b4e50b239670c1cdfe44d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.173090 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-98b39759-ed66-4809-9554-1f077fe50e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09026528bd5b4e50b239670c1cdfe44d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.173724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-98b39759-ed66-4809-9554-1f077fe50e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09026528bd5b4e50b239670c1cdfe44d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.178284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f2bf8-7e68-465d-bd3a-0a68b9ddb0dc None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:44.180342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-98b39759-ed66-4809-9554-1f077fe50e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09026528bd5b4e50b239670c1cdfe44d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.182206 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0b029-2421-4401-9807-e0ec7d3b51d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:44.182922 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0b029-2421-4401-9807-e0ec7d3b51d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:44.183264 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0b029-2421-4401-9807-e0ec7d3b51d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:44.183598 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0b029-2421-4401-9807-e0ec7d3b51d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:44.185833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-37b0b029-2421-4401-9807-e0ec7d3b51d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:44.186452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1317/2641] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:34:44 2022] DELETE /identity/v3/users/09026528bd5b4e50b239670c1cdfe44d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:44.187304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b39759-ed66-4809-9554-1f077fe50e8c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:44.188581 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-98b39759-ed66-4809-9554-1f077fe50e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:44.200531 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0b029-2421-4401-9807-e0ec7d3b51d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:44.200800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:44.202300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0b029-2421-4401-9807-e0ec7d3b51d8 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:44.213801 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1325/2642] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:44.278851 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b39759-ed66-4809-9554-1f077fe50e8c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:44.284150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68081087-28bc-4e22-a8dc-05c1b9980527 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc4cbd87dd249868cfb704535774126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:44.285027 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68081087-28bc-4e22-a8dc-05c1b9980527 service swift] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:44.285312 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68081087-28bc-4e22-a8dc-05c1b9980527 service swift] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:44.285588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68081087-28bc-4e22-a8dc-05c1b9980527 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:44.287592 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-68081087-28bc-4e22-a8dc-05c1b9980527 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:44.368652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68081087-28bc-4e22-a8dc-05c1b9980527 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:44.370263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68081087-28bc-4e22-a8dc-05c1b9980527 service swift] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:44.383345 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1318/2643] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 03:34:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 03:34:44.526393 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0b029-2421-4401-9807-e0ec7d3b51d8 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:44.527950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-37b0b029-2421-4401-9807-e0ec7d3b51d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:44.544374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68081087-28bc-4e22-a8dc-05c1b9980527 service swift] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:44.546192 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-68081087-28bc-4e22-a8dc-05c1b9980527 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:44.572569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0b029-2421-4401-9807-e0ec7d3b51d8 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:44.614928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:44.672837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68081087-28bc-4e22-a8dc-05c1b9980527 service swift] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:44.679988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c44fbc-b397-4626-b925-d1111a73ebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:44.680901 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c44fbc-b397-4626-b925-d1111a73ebb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:44.681179 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c44fbc-b397-4626-b925-d1111a73ebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:44.681455 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c44fbc-b397-4626-b925-d1111a73ebb8 admin admin] PATH_INFO: `/v3/projects/5306fde8b1c94811a048549032113eae` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:44.682859 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c44fbc-b397-4626-b925-d1111a73ebb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5306fde8b1c94811a048549032113eae)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:44.685537 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c44fbc-b397-4626-b925-d1111a73ebb8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:44.723870 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367eab8-0c1d-4d2f-9a4e-3f2c7d9ccb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:44.729575 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367eab8-0c1d-4d2f-9a4e-3f2c7d9ccb45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:44.729875 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367eab8-0c1d-4d2f-9a4e-3f2c7d9ccb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:44.731642 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367eab8-0c1d-4d2f-9a4e-3f2c7d9ccb45 admin admin] PATH_INFO: `/v3/projects/f018eabb57294d258d982b1fe83e7736` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:44.737594 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367eab8-0c1d-4d2f-9a4e-3f2c7d9ccb45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f018eabb57294d258d982b1fe83e7736)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:44.748626 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367eab8-0c1d-4d2f-9a4e-3f2c7d9ccb45 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:44.801707 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-76c44fbc-b397-4626-b925-d1111a73ebb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5306fde8b1c94811a048549032113eae', 'request_id': 'req-76c44fbc-b397-4626-b925-d1111a73ebb8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.805882 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:44.818973 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-76c44fbc-b397-4626-b925-d1111a73ebb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5306fde8b1c94811a048549032113eae', 'request_id': 'req-76c44fbc-b397-4626-b925-d1111a73ebb8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.835712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-76c44fbc-b397-4626-b925-d1111a73ebb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5306fde8b1c94811a048549032113eae', 'request_id': 'req-76c44fbc-b397-4626-b925-d1111a73ebb8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.862512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-76c44fbc-b397-4626-b925-d1111a73ebb8 admin admin] The token cache is being invalidate because project 5306fde8b1c94811a048549032113eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:34:44.862512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-76c44fbc-b397-4626-b925-d1111a73ebb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.869271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-76c44fbc-b397-4626-b925-d1111a73ebb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.874341 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1319/2644] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:34:44 2022] DELETE /identity/v3/projects/5306fde8b1c94811a048549032113eae => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:44.878441 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c44fbc-b397-4626-b925-d1111a73ebb8 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:44.883869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-76c44fbc-b397-4626-b925-d1111a73ebb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:44.903720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a367eab8-0c1d-4d2f-9a4e-3f2c7d9ccb45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f018eabb57294d258d982b1fe83e7736', 'request_id': 'req-a367eab8-0c1d-4d2f-9a4e-3f2c7d9ccb45'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.918273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a367eab8-0c1d-4d2f-9a4e-3f2c7d9ccb45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f018eabb57294d258d982b1fe83e7736', 'request_id': 'req-a367eab8-0c1d-4d2f-9a4e-3f2c7d9ccb45'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.931937 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a367eab8-0c1d-4d2f-9a4e-3f2c7d9ccb45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f018eabb57294d258d982b1fe83e7736', 'request_id': 'req-a367eab8-0c1d-4d2f-9a4e-3f2c7d9ccb45'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.947756 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a367eab8-0c1d-4d2f-9a4e-3f2c7d9ccb45 admin admin] The token cache is being invalidate because project f018eabb57294d258d982b1fe83e7736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:34:44.948048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a367eab8-0c1d-4d2f-9a4e-3f2c7d9ccb45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.948743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a367eab8-0c1d-4d2f-9a4e-3f2c7d9ccb45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:44.950760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1326/2645] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:34:44 2022] DELETE /identity/v3/projects/f018eabb57294d258d982b1fe83e7736 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:44.957557 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5989d4-2073-493f-aaee-cccaea94613d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:44.957981 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5989d4-2073-493f-aaee-cccaea94613d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:44.958459 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5989d4-2073-493f-aaee-cccaea94613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:44.981249 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1c5989d4-2073-493f-aaee-cccaea94613d None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:44.982665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1c5989d4-2073-493f-aaee-cccaea94613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:44.996822 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c44fbc-b397-4626-b925-d1111a73ebb8 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:45.088624 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1327/2646] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:34:45.092308 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36e186-0106-4efc-a955-58fc1fed6402 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:45.092986 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36e186-0106-4efc-a955-58fc1fed6402 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:45.093517 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36e186-0106-4efc-a955-58fc1fed6402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:45.117328 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd02331-c79e-4564-93e2-18ca33626c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:45.118398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd02331-c79e-4564-93e2-18ca33626c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:45.118692 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd02331-c79e-4564-93e2-18ca33626c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:45.118980 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd02331-c79e-4564-93e2-18ca33626c87 admin admin] PATH_INFO: `/v3/users/828ebc52d3454dea94ca985d9021a2aa` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:45.120413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd02331-c79e-4564-93e2-18ca33626c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=828ebc52d3454dea94ca985d9021a2aa)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:45.122822 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd02331-c79e-4564-93e2-18ca33626c87 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:45.130818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1e36e186-0106-4efc-a955-58fc1fed6402 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:45.133287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1e36e186-0106-4efc-a955-58fc1fed6402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:45.161808 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1328/2647] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:45.164949 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36e186-0106-4efc-a955-58fc1fed6402 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:45.183985 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36e186-0106-4efc-a955-58fc1fed6402 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:45.199098 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2e79c-de00-4a78-8e71-6ec8c69d4816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:45.199926 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2e79c-de00-4a78-8e71-6ec8c69d4816 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:45.200847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2e79c-de00-4a78-8e71-6ec8c69d4816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:45.201257 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2e79c-de00-4a78-8e71-6ec8c69d4816 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:45.202179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2e79c-de00-4a78-8e71-6ec8c69d4816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:34:45.202628 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2e79c-de00-4a78-8e71-6ec8c69d4816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:45.207548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2e79c-de00-4a78-8e71-6ec8c69d4816 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:45.222370 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cbd02331-c79e-4564-93e2-18ca33626c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '828ebc52d3454dea94ca985d9021a2aa'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:45.242161 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cbd02331-c79e-4564-93e2-18ca33626c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '828ebc52d3454dea94ca985d9021a2aa'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:45.248929 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1329/2648] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 03:34:45.251580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2e79c-de00-4a78-8e71-6ec8c69d4816 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:45.279114 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2e79c-de00-4a78-8e71-6ec8c69d4816 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:45.285978 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecce82-f4d4-4558-a774-9f8441d09c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:45.287017 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cbd02331-c79e-4564-93e2-18ca33626c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '828ebc52d3454dea94ca985d9021a2aa'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:45.287158 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecce82-f4d4-4558-a774-9f8441d09c5a admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:45.287568 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecce82-f4d4-4558-a774-9f8441d09c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:45.287815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cbd02331-c79e-4564-93e2-18ca33626c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '828ebc52d3454dea94ca985d9021a2aa'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:45.287920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecce82-f4d4-4558-a774-9f8441d09c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:45.289218 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aecce82-f4d4-4558-a774-9f8441d09c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:45.292675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aecce82-f4d4-4558-a774-9f8441d09c5a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:45.304399 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cbd02331-c79e-4564-93e2-18ca33626c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '828ebc52d3454dea94ca985d9021a2aa'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:45.322857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1320/2649] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:34:44 2022] DELETE /identity/v3/users/828ebc52d3454dea94ca985d9021a2aa => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:34:45.340197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1330/2650] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:34:45 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:45.343616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd02331-c79e-4564-93e2-18ca33626c87 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:45.345312 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cbd02331-c79e-4564-93e2-18ca33626c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:45.361912 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:45.496618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd02331-c79e-4564-93e2-18ca33626c87 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:45.601583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaa0cb-11fe-49fa-96ae-1d9a338b1306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:45.602646 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaa0cb-11fe-49fa-96ae-1d9a338b1306 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:45.603150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaa0cb-11fe-49fa-96ae-1d9a338b1306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:45.603523 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaa0cb-11fe-49fa-96ae-1d9a338b1306 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:45.604504 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aaa0cb-11fe-49fa-96ae-1d9a338b1306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:45.606815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aaa0cb-11fe-49fa-96ae-1d9a338b1306 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:45.636893 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1321/2651] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:34:45 2022] POST /identity/v3/users => generated 287 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:34:45.641125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecce82-f4d4-4558-a774-9f8441d09c5a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:45.656419 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecce82-f4d4-4558-a774-9f8441d09c5a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:45.665514 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ed6b2-0581-43ff-abac-b7e1e0939c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:45.666304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ed6b2-0581-43ff-abac-b7e1e0939c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:45.666658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ed6b2-0581-43ff-abac-b7e1e0939c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:45.667003 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ed6b2-0581-43ff-abac-b7e1e0939c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:45.667823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ed6b2-0581-43ff-abac-b7e1e0939c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:45.669958 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ed6b2-0581-43ff-abac-b7e1e0939c8f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:45.682382 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:45.692580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1331/2652] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:34:45.695766 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaa0cb-11fe-49fa-96ae-1d9a338b1306 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:45.726548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaa0cb-11fe-49fa-96ae-1d9a338b1306 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:45.743327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b009888-361d-44ed-8081-ab2ab6187052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:45.744158 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b009888-361d-44ed-8081-ab2ab6187052 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:45.744442 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b009888-361d-44ed-8081-ab2ab6187052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:45.744934 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b009888-361d-44ed-8081-ab2ab6187052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:45.745548 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b009888-361d-44ed-8081-ab2ab6187052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:45.747316 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b009888-361d-44ed-8081-ab2ab6187052 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:45.756036 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ed6b2-0581-43ff-abac-b7e1e0939c8f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:45.758450 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ad9ed6b2-0581-43ff-abac-b7e1e0939c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:45.760497 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1322/2653] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:45.765929 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b009888-361d-44ed-8081-ab2ab6187052 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:45.773963 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ed6b2-0581-43ff-abac-b7e1e0939c8f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:45.780890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a658a-a151-4149-b1e4-5c9c655e9dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:45.782030 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a658a-a151-4149-b1e4-5c9c655e9dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:45.782537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a658a-a151-4149-b1e4-5c9c655e9dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:45.783057 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a658a-a151-4149-b1e4-5c9c655e9dd3 admin admin] PATH_INFO: `/v3/projects/e70e2436e8ab4a9d8bd55eab3719aab3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:45.784552 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a658a-a151-4149-b1e4-5c9c655e9dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e70e2436e8ab4a9d8bd55eab3719aab3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:45.786731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a658a-a151-4149-b1e4-5c9c655e9dd3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:45.803873 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b009888-361d-44ed-8081-ab2ab6187052 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:45.810291 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60012296-6817-498b-a35d-fc6ecdc1d272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:45.811711 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60012296-6817-498b-a35d-fc6ecdc1d272 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:45.812201 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60012296-6817-498b-a35d-fc6ecdc1d272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:45.812480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60012296-6817-498b-a35d-fc6ecdc1d272 admin admin] PATH_INFO: `/v3/projects/b6762d435aec49b4842bdb48546aeb82/users/f29fabca67d54b938af54462735fb54f/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:45.829712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60012296-6817-498b-a35d-fc6ecdc1d272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6762d435aec49b4842bdb48546aeb82, user_id=f29fabca67d54b938af54462735fb54f, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:45.832577 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60012296-6817-498b-a35d-fc6ecdc1d272 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:45.856276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1323/2654] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:45 2022] PUT /identity/v3/projects/b6762d435aec49b4842bdb48546aeb82/users/f29fabca67d54b938af54462735fb54f/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:45.878095 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6c2a658a-a151-4149-b1e4-5c9c655e9dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70e2436e8ab4a9d8bd55eab3719aab3', 'request_id': 'req-6c2a658a-a151-4149-b1e4-5c9c655e9dd3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:45.899782 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6c2a658a-a151-4149-b1e4-5c9c655e9dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70e2436e8ab4a9d8bd55eab3719aab3', 'request_id': 'req-6c2a658a-a151-4149-b1e4-5c9c655e9dd3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:45.910192 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6c2a658a-a151-4149-b1e4-5c9c655e9dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70e2436e8ab4a9d8bd55eab3719aab3', 'request_id': 'req-6c2a658a-a151-4149-b1e4-5c9c655e9dd3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:45.926908 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6c2a658a-a151-4149-b1e4-5c9c655e9dd3 admin admin] The token cache is being invalidate because project e70e2436e8ab4a9d8bd55eab3719aab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:34:45.927544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed937b11-5ae3-4537-b7e5-6d2777b23505 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:45.927833 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6c2a658a-a151-4149-b1e4-5c9c655e9dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:45.927945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed937b11-5ae3-4537-b7e5-6d2777b23505 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:45.928297 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed937b11-5ae3-4537-b7e5-6d2777b23505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:45.928593 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6c2a658a-a151-4149-b1e4-5c9c655e9dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:45.930469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1332/2655] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:34:45 2022] DELETE /identity/v3/projects/e70e2436e8ab4a9d8bd55eab3719aab3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:34:45.941839 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d2856-3b7d-4798-b9cb-e134f157d4df None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:45.942180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d2856-3b7d-4798-b9cb-e134f157d4df None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:45.942399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d2856-3b7d-4798-b9cb-e134f157d4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:45.962708 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-451d2856-3b7d-4798-b9cb-e134f157d4df None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:45.964469 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-451d2856-3b7d-4798-b9cb-e134f157d4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:45.964865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ed937b11-5ae3-4537-b7e5-6d2777b23505 None None] MFA Rules not processed for user `f29fabca67d54b938af54462735fb54f`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:45.966105 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ed937b11-5ae3-4537-b7e5-6d2777b23505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:46.055178 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:46.067557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1324/2656] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:46.067936 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1333/2657] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:46.075741 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed937b11-5ae3-4537-b7e5-6d2777b23505 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:46.077178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b0e8e-e94f-47ed-a813-6c4899bd38b6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:46.077338 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ed937b11-5ae3-4537-b7e5-6d2777b23505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:46.077769 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b0e8e-e94f-47ed-a813-6c4899bd38b6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:46.078119 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b0e8e-e94f-47ed-a813-6c4899bd38b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:46.101146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5a5b0e8e-e94f-47ed-a813-6c4899bd38b6 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:46.102358 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5a5b0e8e-e94f-47ed-a813-6c4899bd38b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:46.116255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1334/2658] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:34:46.117212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b0e8e-e94f-47ed-a813-6c4899bd38b6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:46.127166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b0e8e-e94f-47ed-a813-6c4899bd38b6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:46.132426 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12379cee-7c9f-4cf2-974d-cae94d941380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:46.136322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12379cee-7c9f-4cf2-974d-cae94d941380 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:46.136322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12379cee-7c9f-4cf2-974d-cae94d941380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:46.136322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12379cee-7c9f-4cf2-974d-cae94d941380 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:46.136322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12379cee-7c9f-4cf2-974d-cae94d941380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:34:46.136322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12379cee-7c9f-4cf2-974d-cae94d941380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:46.136924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12379cee-7c9f-4cf2-974d-cae94d941380 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:46.156449 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1335/2659] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:34:46.161372 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12379cee-7c9f-4cf2-974d-cae94d941380 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:46.171440 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed937b11-5ae3-4537-b7e5-6d2777b23505 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:46.175835 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4e1b0-858c-4c54-8770-9a318b62175c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:46.176450 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12379cee-7c9f-4cf2-974d-cae94d941380 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:46.177199 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4e1b0-858c-4c54-8770-9a318b62175c service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:46.177692 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4e1b0-858c-4c54-8770-9a318b62175c service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:46.178212 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4e1b0-858c-4c54-8770-9a318b62175c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:46.182067 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01f960-1c29-40be-9f22-2ea7d78e207a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:46.182730 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01f960-1c29-40be-9f22-2ea7d78e207a admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:46.183335 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01f960-1c29-40be-9f22-2ea7d78e207a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:46.183628 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01f960-1c29-40be-9f22-2ea7d78e207a admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:46.184347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01f960-1c29-40be-9f22-2ea7d78e207a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:46.188797 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01f960-1c29-40be-9f22-2ea7d78e207a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:46.189785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4e1b0-858c-4c54-8770-9a318b62175c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:46.191464 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4e1b0-858c-4c54-8770-9a318b62175c service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:46.203770 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1325/2660] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:46.233079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1336/2661] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:34:46 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:34:46.237231 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4e1b0-858c-4c54-8770-9a318b62175c service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:46.253494 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4e1b0-858c-4c54-8770-9a318b62175c service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:46.366294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49662f-e0dd-4933-82b8-7f110f841c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:46.367112 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49662f-e0dd-4933-82b8-7f110f841c91 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:46.367398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49662f-e0dd-4933-82b8-7f110f841c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:46.367674 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49662f-e0dd-4933-82b8-7f110f841c91 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:46.368553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49662f-e0dd-4933-82b8-7f110f841c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:46.370867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49662f-e0dd-4933-82b8-7f110f841c91 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:46.400211 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1326/2662] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:34:46 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:34:46.404616 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01f960-1c29-40be-9f22-2ea7d78e207a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:46.425403 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01f960-1c29-40be-9f22-2ea7d78e207a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:46.435021 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349555f-7624-45a8-b757-5ec481398e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:46.437017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349555f-7624-45a8-b757-5ec481398e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:46.437381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349555f-7624-45a8-b757-5ec481398e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:46.437784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349555f-7624-45a8-b757-5ec481398e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:46.439002 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349555f-7624-45a8-b757-5ec481398e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:46.441113 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349555f-7624-45a8-b757-5ec481398e38 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:46.456501 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1337/2663] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:46.458347 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49662f-e0dd-4933-82b8-7f110f841c91 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:46.473188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49662f-e0dd-4933-82b8-7f110f841c91 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:46.479084 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b0f5e-a17b-47ef-8abb-1362c54f247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:46.480278 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b0f5e-a17b-47ef-8abb-1362c54f247c admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:46.480751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b0f5e-a17b-47ef-8abb-1362c54f247c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:46.481174 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b0f5e-a17b-47ef-8abb-1362c54f247c admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:46.482789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b0f5e-a17b-47ef-8abb-1362c54f247c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:46.484649 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b0f5e-a17b-47ef-8abb-1362c54f247c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:46.501212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349555f-7624-45a8-b757-5ec481398e38 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:46.508327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1327/2664] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:46.517129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349555f-7624-45a8-b757-5ec481398e38 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:46.523700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686e5ef-f4e4-4a56-a2bf-a70aec82e162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:46.525239 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686e5ef-f4e4-4a56-a2bf-a70aec82e162 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:46.525720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686e5ef-f4e4-4a56-a2bf-a70aec82e162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:46.526823 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686e5ef-f4e4-4a56-a2bf-a70aec82e162 admin admin] PATH_INFO: `/v3/projects/57601cacadea41a4a7821cc90b604a6a/users/06823668819b44d699dc5f72c913d3e0/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:46.545907 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686e5ef-f4e4-4a56-a2bf-a70aec82e162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57601cacadea41a4a7821cc90b604a6a, user_id=06823668819b44d699dc5f72c913d3e0, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:46.548611 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686e5ef-f4e4-4a56-a2bf-a70aec82e162 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:46.566328 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1338/2665] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:46 2022] PUT /identity/v3/projects/57601cacadea41a4a7821cc90b604a6a/users/06823668819b44d699dc5f72c913d3e0/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:46.571827 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fc618-b990-4785-9a72-fedaed22a22c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:46.572117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fc618-b990-4785-9a72-fedaed22a22c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:46.572394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fc618-b990-4785-9a72-fedaed22a22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:46.595938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-317fc618-b990-4785-9a72-fedaed22a22c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:46.597296 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-317fc618-b990-4785-9a72-fedaed22a22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:46.698701 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1328/2666] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:46.708015 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686e5ef-f4e4-4a56-a2bf-a70aec82e162 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:46.710021 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7686e5ef-f4e4-4a56-a2bf-a70aec82e162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:46.736071 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:46.842718 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686e5ef-f4e4-4a56-a2bf-a70aec82e162 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:46.846947 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e8fad-9c16-4bca-9402-0f9c32c3515f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:46.847871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e8fad-9c16-4bca-9402-0f9c32c3515f service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:46.848251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e8fad-9c16-4bca-9402-0f9c32c3515f service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:46.848658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e8fad-9c16-4bca-9402-0f9c32c3515f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:46.861173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e8fad-9c16-4bca-9402-0f9c32c3515f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:46.862968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e8fad-9c16-4bca-9402-0f9c32c3515f service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:46.875233 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1339/2667] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:47.773828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb30ae-6c96-4918-a5dd-1c9ecd7d3884 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:47.774417 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb30ae-6c96-4918-a5dd-1c9ecd7d3884 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:47.774985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb30ae-6c96-4918-a5dd-1c9ecd7d3884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:47.845724 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-d3cb30ae-6c96-4918-a5dd-1c9ecd7d3884 None None] MFA Rules not processed for user `06823668819b44d699dc5f72c913d3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:47.847233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d3cb30ae-6c96-4918-a5dd-1c9ecd7d3884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:47.867940 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:47.973188 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1329/2668] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:47.980680 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e8fad-9c16-4bca-9402-0f9c32c3515f service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:48.122533 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e8fad-9c16-4bca-9402-0f9c32c3515f service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:48.127602 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81d9ba-314a-46a0-bbed-27f322068639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:48.128275 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81d9ba-314a-46a0-bbed-27f322068639 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:48.128578 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81d9ba-314a-46a0-bbed-27f322068639 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:48.128853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81d9ba-314a-46a0-bbed-27f322068639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:48.139306 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81d9ba-314a-46a0-bbed-27f322068639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:48.140910 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81d9ba-314a-46a0-bbed-27f322068639 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:48.151494 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1340/2669] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:49.681891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d33ba-53cb-490d-a905-2d1ff0966447 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:49.682432 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d33ba-53cb-490d-a905-2d1ff0966447 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:49.682513 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d33ba-53cb-490d-a905-2d1ff0966447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:49.726903 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-b46d33ba-53cb-490d-a905-2d1ff0966447 None None] MFA Rules not processed for user `06823668819b44d699dc5f72c913d3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:49.728216 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b46d33ba-53cb-490d-a905-2d1ff0966447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:49.749535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1330/2670] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:50.031126 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81d9ba-314a-46a0-bbed-27f322068639 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:50.033034 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6e81d9ba-314a-46a0-bbed-27f322068639 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:50.048579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81d9ba-314a-46a0-bbed-27f322068639 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:50.052921 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e2d51-0556-4fcb-a158-08831fdf1451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:50.053706 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e2d51-0556-4fcb-a158-08831fdf1451 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:50.054032 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e2d51-0556-4fcb-a158-08831fdf1451 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:50.054357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e2d51-0556-4fcb-a158-08831fdf1451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:50.056513 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b58e2d51-0556-4fcb-a158-08831fdf1451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:50.069735 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e2d51-0556-4fcb-a158-08831fdf1451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:50.071390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e2d51-0556-4fcb-a158-08831fdf1451 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:50.084220 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1341/2671] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:55.585549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d33ba-53cb-490d-a905-2d1ff0966447 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:55.587298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b46d33ba-53cb-490d-a905-2d1ff0966447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:55.692341 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d33ba-53cb-490d-a905-2d1ff0966447 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:55.697905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7e356-0dd0-4ae7-a5b2-a78c8e989ded service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:55.698568 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7e356-0dd0-4ae7-a5b2-a78c8e989ded service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:55.698851 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7e356-0dd0-4ae7-a5b2-a78c8e989ded service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:55.700668 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7e356-0dd0-4ae7-a5b2-a78c8e989ded service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:55.703029 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-63e7e356-0dd0-4ae7-a5b2-a78c8e989ded service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:55.716640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7e356-0dd0-4ae7-a5b2-a78c8e989ded service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:55.718304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7e356-0dd0-4ae7-a5b2-a78c8e989ded service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:55.729311 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1331/2672] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:34:56.715784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e2d51-0556-4fcb-a158-08831fdf1451 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:56.717588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b58e2d51-0556-4fcb-a158-08831fdf1451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:56.733233 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e2d51-0556-4fcb-a158-08831fdf1451 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:56.738474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b63f4-775d-4b5f-8502-edc60248b5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:56.739351 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b63f4-775d-4b5f-8502-edc60248b5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:56.739723 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b63f4-775d-4b5f-8502-edc60248b5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:56.739859 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b63f4-775d-4b5f-8502-edc60248b5aa admin admin] PATH_INFO: `/v3/users/f29fabca67d54b938af54462735fb54f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:56.741098 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b63f4-775d-4b5f-8502-edc60248b5aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f29fabca67d54b938af54462735fb54f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:56.742979 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b63f4-775d-4b5f-8502-edc60248b5aa admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:56.792554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-612b63f4-775d-4b5f-8502-edc60248b5aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f29fabca67d54b938af54462735fb54f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:56.802653 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-612b63f4-775d-4b5f-8502-edc60248b5aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f29fabca67d54b938af54462735fb54f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:56.810218 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-612b63f4-775d-4b5f-8502-edc60248b5aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f29fabca67d54b938af54462735fb54f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:56.810889 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-612b63f4-775d-4b5f-8502-edc60248b5aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f29fabca67d54b938af54462735fb54f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:56.823203 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-612b63f4-775d-4b5f-8502-edc60248b5aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f29fabca67d54b938af54462735fb54f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:56.829519 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1342/2673] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:34:56 2022] DELETE /identity/v3/users/f29fabca67d54b938af54462735fb54f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:56.834067 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f25d4-db05-48de-bb6f-b2ca0b0939c0 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:56.834580 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f25d4-db05-48de-bb6f-b2ca0b0939c0 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:56.834686 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f25d4-db05-48de-bb6f-b2ca0b0939c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:56.853228 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-0e3f25d4-db05-48de-bb6f-b2ca0b0939c0 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:56.854439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0e3f25d4-db05-48de-bb6f-b2ca0b0939c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:56.914129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1332/2674] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:56.924267 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b63f4-775d-4b5f-8502-edc60248b5aa admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:56.925995 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-612b63f4-775d-4b5f-8502-edc60248b5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:56.940380 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:56.987254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b63f4-775d-4b5f-8502-edc60248b5aa admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:56.991297 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db9e03-6622-4e4a-93e2-06a110cb0839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:56.991948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db9e03-6622-4e4a-93e2-06a110cb0839 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:56.992230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db9e03-6622-4e4a-93e2-06a110cb0839 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:56.992507 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db9e03-6622-4e4a-93e2-06a110cb0839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:57.003019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db9e03-6622-4e4a-93e2-06a110cb0839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:57.004500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db9e03-6622-4e4a-93e2-06a110cb0839 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:57.015141 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1343/2675] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:34:57.286652 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f25d4-db05-48de-bb6f-b2ca0b0939c0 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:57.288186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0e3f25d4-db05-48de-bb6f-b2ca0b0939c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:57.302913 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f25d4-db05-48de-bb6f-b2ca0b0939c0 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:57.307764 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59de20d-1536-4872-840c-8908d7b83281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:57.308668 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de20d-1536-4872-840c-8908d7b83281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:57.308943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de20d-1536-4872-840c-8908d7b83281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:57.309357 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de20d-1536-4872-840c-8908d7b83281 admin admin] PATH_INFO: `/v3/projects/b6762d435aec49b4842bdb48546aeb82` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:57.310839 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59de20d-1536-4872-840c-8908d7b83281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6762d435aec49b4842bdb48546aeb82)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:57.312884 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59de20d-1536-4872-840c-8908d7b83281 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:57.339533 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:57.365098 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f59de20d-1536-4872-840c-8908d7b83281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6762d435aec49b4842bdb48546aeb82', 'request_id': 'req-f59de20d-1536-4872-840c-8908d7b83281'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:57.374299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f59de20d-1536-4872-840c-8908d7b83281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6762d435aec49b4842bdb48546aeb82', 'request_id': 'req-f59de20d-1536-4872-840c-8908d7b83281'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:57.381814 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f59de20d-1536-4872-840c-8908d7b83281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6762d435aec49b4842bdb48546aeb82', 'request_id': 'req-f59de20d-1536-4872-840c-8908d7b83281'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:57.395901 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f59de20d-1536-4872-840c-8908d7b83281 admin admin] The token cache is being invalidate because project b6762d435aec49b4842bdb48546aeb82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:34:57.396194 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f59de20d-1536-4872-840c-8908d7b83281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:57.396867 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f59de20d-1536-4872-840c-8908d7b83281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:34:57.398675 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1333/2676] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:34:57 2022] DELETE /identity/v3/projects/b6762d435aec49b4842bdb48546aeb82 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:57.403796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b848c8-5ed6-41ff-a925-b6a9cc7cafa1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:57.404112 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b848c8-5ed6-41ff-a925-b6a9cc7cafa1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:57.404390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b848c8-5ed6-41ff-a925-b6a9cc7cafa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:57.421973 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f4b848c8-5ed6-41ff-a925-b6a9cc7cafa1 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:57.423248 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f4b848c8-5ed6-41ff-a925-b6a9cc7cafa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:57.486817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1344/2677] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:57.494963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd3f6d-231b-440b-8fc0-13a9ac4d09e8 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:57.495262 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd3f6d-231b-440b-8fc0-13a9ac4d09e8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:57.495537 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd3f6d-231b-440b-8fc0-13a9ac4d09e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:57.515545 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-dcfd3f6d-231b-440b-8fc0-13a9ac4d09e8 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:57.516773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-dcfd3f6d-231b-440b-8fc0-13a9ac4d09e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:57.524620 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1334/2678] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:57.529393 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b848c8-5ed6-41ff-a925-b6a9cc7cafa1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:57.538931 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b848c8-5ed6-41ff-a925-b6a9cc7cafa1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:57.543969 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926659f-9972-4096-82dc-bbe308ebcc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:57.545039 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926659f-9972-4096-82dc-bbe308ebcc21 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:57.545292 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926659f-9972-4096-82dc-bbe308ebcc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:57.545584 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926659f-9972-4096-82dc-bbe308ebcc21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:57.546320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926659f-9972-4096-82dc-bbe308ebcc21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:34:57.546624 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926659f-9972-4096-82dc-bbe308ebcc21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:57.548193 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926659f-9972-4096-82dc-bbe308ebcc21 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:57.561490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1345/2679] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:34:57.565770 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd3f6d-231b-440b-8fc0-13a9ac4d09e8 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:57.575697 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd3f6d-231b-440b-8fc0-13a9ac4d09e8 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:57.580699 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589833a-2691-4356-93db-c5c781be94ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:57.581352 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589833a-2691-4356-93db-c5c781be94ad admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:57.581634 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589833a-2691-4356-93db-c5c781be94ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:57.581907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589833a-2691-4356-93db-c5c781be94ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:57.582609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589833a-2691-4356-93db-c5c781be94ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:57.584505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589833a-2691-4356-93db-c5c781be94ad admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:57.612110 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1335/2680] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:34:57 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:34:57.616341 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926659f-9972-4096-82dc-bbe308ebcc21 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:57.628133 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926659f-9972-4096-82dc-bbe308ebcc21 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:57.690320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d56aa0-0c38-4d7d-93b1-1e10c6aafa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:57.691083 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d56aa0-0c38-4d7d-93b1-1e10c6aafa1a admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:57.691364 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d56aa0-0c38-4d7d-93b1-1e10c6aafa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:57.691636 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d56aa0-0c38-4d7d-93b1-1e10c6aafa1a admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:57.692347 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d56aa0-0c38-4d7d-93b1-1e10c6aafa1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:57.694295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d56aa0-0c38-4d7d-93b1-1e10c6aafa1a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:57.722126 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1346/2681] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:34:57 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:34:57.726397 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589833a-2691-4356-93db-c5c781be94ad admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:57.737704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589833a-2691-4356-93db-c5c781be94ad admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:57.742618 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a066b-4ea9-45ab-8a24-03d22ec57587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:57.743273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a066b-4ea9-45ab-8a24-03d22ec57587 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:57.743552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a066b-4ea9-45ab-8a24-03d22ec57587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:57.743822 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a066b-4ea9-45ab-8a24-03d22ec57587 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:57.744552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a066b-4ea9-45ab-8a24-03d22ec57587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:57.746156 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a066b-4ea9-45ab-8a24-03d22ec57587 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:57.757193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1336/2682] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:34:57.761847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d56aa0-0c38-4d7d-93b1-1e10c6aafa1a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:57.772933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d56aa0-0c38-4d7d-93b1-1e10c6aafa1a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:57.781063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09fae4-838a-41c4-81fe-ed7e29140d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:57.781705 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09fae4-838a-41c4-81fe-ed7e29140d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:57.782009 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09fae4-838a-41c4-81fe-ed7e29140d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:57.782275 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09fae4-838a-41c4-81fe-ed7e29140d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:57.783017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09fae4-838a-41c4-81fe-ed7e29140d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:57.784655 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09fae4-838a-41c4-81fe-ed7e29140d96 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:57.795926 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1347/2683] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:34:57.800066 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a066b-4ea9-45ab-8a24-03d22ec57587 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:57.810044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a066b-4ea9-45ab-8a24-03d22ec57587 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:57.814878 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80bf9b-afc9-438f-90f7-393baba5b429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:57.815757 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80bf9b-afc9-438f-90f7-393baba5b429 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:57.816028 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80bf9b-afc9-438f-90f7-393baba5b429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:57.816292 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80bf9b-afc9-438f-90f7-393baba5b429 admin admin] PATH_INFO: `/v3/projects/bc4dc40b42a545a88e4c1dfc24e04237/users/0ad58a62e6024e20a5fe2a520260cfd3/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:57.831386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80bf9b-afc9-438f-90f7-393baba5b429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4dc40b42a545a88e4c1dfc24e04237, user_id=0ad58a62e6024e20a5fe2a520260cfd3, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:57.834087 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80bf9b-afc9-438f-90f7-393baba5b429 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:57.849230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1337/2684] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:34:57 2022] PUT /identity/v3/projects/bc4dc40b42a545a88e4c1dfc24e04237/users/0ad58a62e6024e20a5fe2a520260cfd3/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:34:57.854257 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e962ab-8629-426f-b5e1-fa9991de6e5b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:57.854541 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e962ab-8629-426f-b5e1-fa9991de6e5b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:57.854816 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e962ab-8629-426f-b5e1-fa9991de6e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:57.873161 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-94e962ab-8629-426f-b5e1-fa9991de6e5b None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:34:57.874366 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-94e962ab-8629-426f-b5e1-fa9991de6e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:57.886924 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:34:57.936619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1348/2685] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:34:57.946237 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80bf9b-afc9-438f-90f7-393baba5b429 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:34:57.948183 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ec80bf9b-afc9-438f-90f7-393baba5b429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:34:58.008758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80bf9b-afc9-438f-90f7-393baba5b429 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:34:58.013080 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738ba6e-9725-4b61-aff8-918537ee7f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:34:58.013908 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738ba6e-9725-4b61-aff8-918537ee7f5c service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:34:58.014189 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738ba6e-9725-4b61-aff8-918537ee7f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:34:58.014463 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738ba6e-9725-4b61-aff8-918537ee7f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:34:58.023951 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738ba6e-9725-4b61-aff8-918537ee7f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:34:58.025424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738ba6e-9725-4b61-aff8-918537ee7f5c service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:34:58.035111 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1338/2686] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:34:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:35:00.108094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ab08b-13c3-437b-b3a9-85c2fb34fae5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:00.108595 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ab08b-13c3-437b-b3a9-85c2fb34fae5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:00.108595 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ab08b-13c3-437b-b3a9-85c2fb34fae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:00.127984 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-276ab08b-13c3-437b-b3a9-85c2fb34fae5 None None] MFA Rules not processed for user `e23aea853cce44698b19d6bc087093c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:35:00.129224 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-276ab08b-13c3-437b-b3a9-85c2fb34fae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:35:00.213331 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1349/2687] 10.222.0.26 () {58 vars in 967 bytes} [Tue Jul 12 03:35:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:35:00.214220 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738ba6e-9725-4b61-aff8-918537ee7f5c service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:35:00.222474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7738ba6e-9725-4b61-aff8-918537ee7f5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:35:00.284734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:35:00.316999 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738ba6e-9725-4b61-aff8-918537ee7f5c service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:35:00.326351 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940d791-0a64-495d-b716-570a43351411 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc4cbd87dd249868cfb704535774126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:35:00.327475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d791-0a64-495d-b716-570a43351411 service swift] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:00.328146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d791-0a64-495d-b716-570a43351411 service swift] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:00.328751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d791-0a64-495d-b716-570a43351411 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:00.340600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940d791-0a64-495d-b716-570a43351411 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:35:00.345403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940d791-0a64-495d-b716-570a43351411 service swift] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:35:00.359348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1339/2688] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 03:35:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 03:35:02.454151 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dda8c8-48bb-4d92-af7e-b105059b52fc None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:02.454638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dda8c8-48bb-4d92-af7e-b105059b52fc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:02.454638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dda8c8-48bb-4d92-af7e-b105059b52fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:02.522241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-05dda8c8-48bb-4d92-af7e-b105059b52fc None None] MFA Rules not processed for user `0ad58a62e6024e20a5fe2a520260cfd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:35:02.523943 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-05dda8c8-48bb-4d92-af7e-b105059b52fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:35:02.649975 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940d791-0a64-495d-b716-570a43351411 service swift] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:35:02.650975 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1350/2689] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:35:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:35:02.664569 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940d791-0a64-495d-b716-570a43351411 service swift] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:35:02.671139 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b52e83-e629-4e3d-9349-3ccb4b8ac053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:35:02.672077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b52e83-e629-4e3d-9349-3ccb4b8ac053 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:02.672605 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b52e83-e629-4e3d-9349-3ccb4b8ac053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:02.673047 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b52e83-e629-4e3d-9349-3ccb4b8ac053 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:02.674069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b52e83-e629-4e3d-9349-3ccb4b8ac053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:35:02.676606 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b52e83-e629-4e3d-9349-3ccb4b8ac053 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:35:02.722921 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1340/2690] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:35:02 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:35:02.729692 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dda8c8-48bb-4d92-af7e-b105059b52fc None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:35:02.743371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dda8c8-48bb-4d92-af7e-b105059b52fc None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:35:02.802076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:35:02.813547 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8cd17-37e2-4fe4-a94a-874ade9ebbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:35:02.814889 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8cd17-37e2-4fe4-a94a-874ade9ebbb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:02.815166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8cd17-37e2-4fe4-a94a-874ade9ebbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:02.815613 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8cd17-37e2-4fe4-a94a-874ade9ebbb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:02.816329 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8cd17-37e2-4fe4-a94a-874ade9ebbb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:35:02.818424 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8cd17-37e2-4fe4-a94a-874ade9ebbb1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:35:02.845739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1351/2691] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:35:02 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:35:02.850206 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b52e83-e629-4e3d-9349-3ccb4b8ac053 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:35:02.865369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b52e83-e629-4e3d-9349-3ccb4b8ac053 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:35:02.870579 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9430d77-fbcf-4a95-8739-816ced8ef6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:35:02.872942 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9430d77-fbcf-4a95-8739-816ced8ef6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:02.873242 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9430d77-fbcf-4a95-8739-816ced8ef6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:02.873516 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9430d77-fbcf-4a95-8739-816ced8ef6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:02.874278 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9430d77-fbcf-4a95-8739-816ced8ef6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:35:02.875914 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9430d77-fbcf-4a95-8739-816ced8ef6a3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:35:02.887663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1341/2692] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:35:02.891826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8cd17-37e2-4fe4-a94a-874ade9ebbb1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:35:02.905254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8cd17-37e2-4fe4-a94a-874ade9ebbb1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:35:02.911574 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb59fa3-91c8-4dc9-8c3b-c2d69871d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:35:02.912796 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb59fa3-91c8-4dc9-8c3b-c2d69871d5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:02.913089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb59fa3-91c8-4dc9-8c3b-c2d69871d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:02.913491 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb59fa3-91c8-4dc9-8c3b-c2d69871d5f9 admin admin] PATH_INFO: `/v3/projects/cde73e0d32264c35baa39cd82d73bc41/users/b22f2f4ffe8e438d83bd8541f3420ff8/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:02.930766 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb59fa3-91c8-4dc9-8c3b-c2d69871d5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde73e0d32264c35baa39cd82d73bc41, user_id=b22f2f4ffe8e438d83bd8541f3420ff8, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:35:02.933817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb59fa3-91c8-4dc9-8c3b-c2d69871d5f9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:35:02.963004 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1352/2693] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:35:02 2022] PUT /identity/v3/projects/cde73e0d32264c35baa39cd82d73bc41/users/b22f2f4ffe8e438d83bd8541f3420ff8/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:35:02.967118 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9430d77-fbcf-4a95-8739-816ced8ef6a3 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:35:02.978826 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9430d77-fbcf-4a95-8739-816ced8ef6a3 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:35:03.061395 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048ff08-5368-43b5-9a5c-c14a05fcc859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:35:03.062640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048ff08-5368-43b5-9a5c-c14a05fcc859 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:03.062640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048ff08-5368-43b5-9a5c-c14a05fcc859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:03.062871 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048ff08-5368-43b5-9a5c-c14a05fcc859 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:03.063497 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048ff08-5368-43b5-9a5c-c14a05fcc859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:35:03.065543 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048ff08-5368-43b5-9a5c-c14a05fcc859 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:35:03.079491 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1342/2694] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:35:03.083431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb59fa3-91c8-4dc9-8c3b-c2d69871d5f9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:35:03.094651 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb59fa3-91c8-4dc9-8c3b-c2d69871d5f9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:35:03.099719 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b1a36-4d75-427f-8564-ad70db09da53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:35:03.100659 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b1a36-4d75-427f-8564-ad70db09da53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:03.100940 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b1a36-4d75-427f-8564-ad70db09da53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:03.101215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b1a36-4d75-427f-8564-ad70db09da53 admin admin] PATH_INFO: `/v3/projects/cde73e0d32264c35baa39cd82d73bc41/users/b22f2f4ffe8e438d83bd8541f3420ff8/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:03.103243 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b1a36-4d75-427f-8564-ad70db09da53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde73e0d32264c35baa39cd82d73bc41, user_id=b22f2f4ffe8e438d83bd8541f3420ff8, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:35:03.106291 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b1a36-4d75-427f-8564-ad70db09da53 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:35:03.117465 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1353/2695] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:35:03 2022] PUT /identity/v3/projects/cde73e0d32264c35baa39cd82d73bc41/users/b22f2f4ffe8e438d83bd8541f3420ff8/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:35:07.585195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e7749-3559-4b69-a6ef-e30c3c31bae9 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:07.586439 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e7749-3559-4b69-a6ef-e30c3c31bae9 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:07.586812 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e7749-3559-4b69-a6ef-e30c3c31bae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:07.618734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2f9e7749-3559-4b69-a6ef-e30c3c31bae9 None None] MFA Rules not processed for user `b22f2f4ffe8e438d83bd8541f3420ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:35:07.620117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2f9e7749-3559-4b69-a6ef-e30c3c31bae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:35:07.703212 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1343/2696] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:35:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:35:07.717860 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b1a36-4d75-427f-8564-ad70db09da53 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:35:07.720534 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b39b1a36-4d75-427f-8564-ad70db09da53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:35:07.807066 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b1a36-4d75-427f-8564-ad70db09da53 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:35:07.814846 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41852386-f624-451c-a5f8-446fc77f77e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:35:07.815522 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41852386-f624-451c-a5f8-446fc77f77e3 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:07.815789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41852386-f624-451c-a5f8-446fc77f77e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:07.816057 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41852386-f624-451c-a5f8-446fc77f77e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:07.878779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41852386-f624-451c-a5f8-446fc77f77e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:35:07.880411 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41852386-f624-451c-a5f8-446fc77f77e3 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:35:07.890773 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1354/2697] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:35:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:35:09.314801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839c626-15bd-4757-918a-04b3f0215039 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:09.315337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839c626-15bd-4757-918a-04b3f0215039 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:09.315337 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839c626-15bd-4757-918a-04b3f0215039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:09.334970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9839c626-15bd-4757-918a-04b3f0215039 None None] MFA Rules not processed for user `0ad58a62e6024e20a5fe2a520260cfd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:35:09.336544 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9839c626-15bd-4757-918a-04b3f0215039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:35:09.344294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1344/2698] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:35:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:35:17.886338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=75,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:35:19.329324 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:35:20.910503 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0d656-e880-47d4-9468-7cd3511c8e08 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:20.911302 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0d656-e880-47d4-9468-7cd3511c8e08 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:20.911302 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0d656-e880-47d4-9468-7cd3511c8e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:20.932745 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-79e0d656-e880-47d4-9468-7cd3511c8e08 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:35:20.933958 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-79e0d656-e880-47d4-9468-7cd3511c8e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:35:21.002144 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1355/2699] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Jul 12 03:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:35:21.023669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839c626-15bd-4757-918a-04b3f0215039 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:35:21.037041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839c626-15bd-4757-918a-04b3f0215039 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:35:21.042951 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a42a2-f37f-4eea-9107-8e72145178cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:35:21.043621 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a42a2-f37f-4eea-9107-8e72145178cd service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:21.043938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a42a2-f37f-4eea-9107-8e72145178cd service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:21.044214 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a42a2-f37f-4eea-9107-8e72145178cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:21.055233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a42a2-f37f-4eea-9107-8e72145178cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:35:21.056850 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a42a2-f37f-4eea-9107-8e72145178cd service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:35:21.067150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1345/2700] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:35:24.102017 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4527-3a02-4bb7-8eae-04dc51ce1c02 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:24.102654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4527-3a02-4bb7-8eae-04dc51ce1c02 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:24.102654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4527-3a02-4bb7-8eae-04dc51ce1c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:24.123577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9e4b4527-3a02-4bb7-8eae-04dc51ce1c02 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:35:24.124826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9e4b4527-3a02-4bb7-8eae-04dc51ce1c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:35:24.134166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1356/2701] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Jul 12 03:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:35:24.149789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a42a2-f37f-4eea-9107-8e72145178cd service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:35:24.151280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7a0a42a2-f37f-4eea-9107-8e72145178cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:35:24.166266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a42a2-f37f-4eea-9107-8e72145178cd service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:35:24.172541 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58987f-23fa-4d50-b948-86145a718313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:35:24.173228 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58987f-23fa-4d50-b948-86145a718313 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:24.173511 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58987f-23fa-4d50-b948-86145a718313 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:24.173789 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58987f-23fa-4d50-b948-86145a718313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:24.182378 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58987f-23fa-4d50-b948-86145a718313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:35:24.183962 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58987f-23fa-4d50-b948-86145a718313 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:35:24.194375 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1346/2702] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:35:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:35:27.218703 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda83bab-c95a-44e7-aaa6-60cc81d62464 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:27.219292 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda83bab-c95a-44e7-aaa6-60cc81d62464 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:27.219292 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda83bab-c95a-44e7-aaa6-60cc81d62464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:27.237983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bda83bab-c95a-44e7-aaa6-60cc81d62464 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:35:27.239169 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bda83bab-c95a-44e7-aaa6-60cc81d62464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:35:27.247617 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1357/2703] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Jul 12 03:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:35:27.262870 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58987f-23fa-4d50-b948-86145a718313 service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:35:27.274983 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58987f-23fa-4d50-b948-86145a718313 service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:35:27.281525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7653d2-506c-48d8-82c8-5684990dcab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:35:27.282166 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7653d2-506c-48d8-82c8-5684990dcab6 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:27.282441 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7653d2-506c-48d8-82c8-5684990dcab6 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:27.282709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7653d2-506c-48d8-82c8-5684990dcab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:27.291658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7653d2-506c-48d8-82c8-5684990dcab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:35:27.293424 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7653d2-506c-48d8-82c8-5684990dcab6 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:35:27.303384 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1347/2704] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:35:30.321721 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de96fc-0d44-4de9-a44b-1e1004486bbe None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:30.322231 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de96fc-0d44-4de9-a44b-1e1004486bbe None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:30.322349 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de96fc-0d44-4de9-a44b-1e1004486bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:30.342620 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b7de96fc-0d44-4de9-a44b-1e1004486bbe None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:35:30.343753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b7de96fc-0d44-4de9-a44b-1e1004486bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:35:30.352499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1358/2705] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Jul 12 03:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:35:30.370733 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7653d2-506c-48d8-82c8-5684990dcab6 service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:35:30.384270 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7653d2-506c-48d8-82c8-5684990dcab6 service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:35:30.391284 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4642c9-3373-48fd-8c20-c02e90aa966e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:35:30.392324 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4642c9-3373-48fd-8c20-c02e90aa966e service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:30.392837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4642c9-3373-48fd-8c20-c02e90aa966e service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:30.393349 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4642c9-3373-48fd-8c20-c02e90aa966e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:30.404361 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4642c9-3373-48fd-8c20-c02e90aa966e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:35:30.406293 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4642c9-3373-48fd-8c20-c02e90aa966e service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:35:30.417978 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1348/2706] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:35:33.494549 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc282f-d5f9-4fd3-b9dc-31e85791ee28 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:33.495108 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc282f-d5f9-4fd3-b9dc-31e85791ee28 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:33.495214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc282f-d5f9-4fd3-b9dc-31e85791ee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:33.515090 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c2fc282f-d5f9-4fd3-b9dc-31e85791ee28 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:35:33.516320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c2fc282f-d5f9-4fd3-b9dc-31e85791ee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:35:33.528864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1359/2707] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Jul 12 03:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:35:33.544065 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4642c9-3373-48fd-8c20-c02e90aa966e service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:35:33.555459 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4642c9-3373-48fd-8c20-c02e90aa966e service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:35:33.561550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde59b7-230e-448f-a5ea-bdda293b5f71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:35:33.562195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde59b7-230e-448f-a5ea-bdda293b5f71 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:33.562477 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde59b7-230e-448f-a5ea-bdda293b5f71 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:33.562723 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde59b7-230e-448f-a5ea-bdda293b5f71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:33.572057 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde59b7-230e-448f-a5ea-bdda293b5f71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:35:33.573672 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde59b7-230e-448f-a5ea-bdda293b5f71 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:35:33.584241 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1349/2708] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:35:36.674803 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a95bc-b894-4e61-a08c-9e9bba258d0f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:36.675315 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a95bc-b894-4e61-a08c-9e9bba258d0f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:36.675315 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a95bc-b894-4e61-a08c-9e9bba258d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:36.694816 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e68a95bc-b894-4e61-a08c-9e9bba258d0f None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:35:36.695930 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e68a95bc-b894-4e61-a08c-9e9bba258d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:35:36.705738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1360/2709] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Jul 12 03:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:35:36.727462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde59b7-230e-448f-a5ea-bdda293b5f71 service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:35:36.739247 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde59b7-230e-448f-a5ea-bdda293b5f71 service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:35:36.745455 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd1303-bb45-48e5-a353-20d7dafb40c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:35:36.746086 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd1303-bb45-48e5-a353-20d7dafb40c3 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:36.746489 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd1303-bb45-48e5-a353-20d7dafb40c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:36.746782 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd1303-bb45-48e5-a353-20d7dafb40c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:36.756060 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd1303-bb45-48e5-a353-20d7dafb40c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:35:36.757683 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd1303-bb45-48e5-a353-20d7dafb40c3 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:35:36.767703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1350/2710] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:35:38.545964 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a95bc-b894-4e61-a08c-9e9bba258d0f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:35:38.547662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e68a95bc-b894-4e61-a08c-9e9bba258d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:35:38.607212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a95bc-b894-4e61-a08c-9e9bba258d0f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:35:38.611612 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e682306-cf28-42d5-805f-74b09bcf60fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:35:38.612274 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e682306-cf28-42d5-805f-74b09bcf60fe service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:38.612541 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e682306-cf28-42d5-805f-74b09bcf60fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:38.612842 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e682306-cf28-42d5-805f-74b09bcf60fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:38.622966 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e682306-cf28-42d5-805f-74b09bcf60fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:35:38.624403 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e682306-cf28-42d5-805f-74b09bcf60fe service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:35:38.634189 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1361/2711] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:35:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:35:40.522845 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd1303-bb45-48e5-a353-20d7dafb40c3 service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:35:40.534022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd1303-bb45-48e5-a353-20d7dafb40c3 service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:35:40.539879 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3ea1a-2335-4907-8426-00150dc90417 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:35:40.540494 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ea1a-2335-4907-8426-00150dc90417 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:40.540799 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ea1a-2335-4907-8426-00150dc90417 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:40.541069 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ea1a-2335-4907-8426-00150dc90417 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:40.543028 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-48d3ea1a-2335-4907-8426-00150dc90417 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:35:40.555744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3ea1a-2335-4907-8426-00150dc90417 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:35:40.557365 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3ea1a-2335-4907-8426-00150dc90417 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:35:40.569154 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1351/2712] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:35:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:35:48.630057 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=68 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:35:50.563866 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=42 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:35:53.553023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2da2a-f42c-451b-97f7-5904e88f0e88 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:53.553594 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2da2a-f42c-451b-97f7-5904e88f0e88 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:53.553594 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2da2a-f42c-451b-97f7-5904e88f0e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:53.572076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5ef2da2a-f42c-451b-97f7-5904e88f0e88 None None] MFA Rules not processed for user `c9211a496a7a466a9d0032c48363e544`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:35:53.573388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5ef2da2a-f42c-451b-97f7-5904e88f0e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:35:53.631738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1362/2713] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:35:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:35:54.060298 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623f8fe-0cf0-485f-b935-dcdcba07291d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:35:54.060899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623f8fe-0cf0-485f-b935-dcdcba07291d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:35:54.060899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623f8fe-0cf0-485f-b935-dcdcba07291d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:35:54.078609 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-0623f8fe-0cf0-485f-b935-dcdcba07291d None None] MFA Rules not processed for user `06823668819b44d699dc5f72c913d3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:35:54.079873 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0623f8fe-0cf0-485f-b935-dcdcba07291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:35:54.137072 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1352/2714] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:35:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:36:03.624668 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=25 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:36:04.130279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=25 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:36:09.445717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eaf2e-ae11-4e0d-8b56-a97af52b1443 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:36:09.446180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eaf2e-ae11-4e0d-8b56-a97af52b1443 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:36:09.446326 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eaf2e-ae11-4e0d-8b56-a97af52b1443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:36:09.466923 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-028eaf2e-ae11-4e0d-8b56-a97af52b1443 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:36:09.468190 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-028eaf2e-ae11-4e0d-8b56-a97af52b1443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:36:09.480458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1363/2715] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Jul 12 03:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:36:09.495215 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623f8fe-0cf0-485f-b935-dcdcba07291d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:36:09.508863 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623f8fe-0cf0-485f-b935-dcdcba07291d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:36:09.515387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b3556-f70c-482b-8458-41008efa2bc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:36:09.516045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b3556-f70c-482b-8458-41008efa2bc0 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:36:09.516318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b3556-f70c-482b-8458-41008efa2bc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:36:09.516619 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b3556-f70c-482b-8458-41008efa2bc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:36:09.525122 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b3556-f70c-482b-8458-41008efa2bc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:36:09.526805 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b3556-f70c-482b-8458-41008efa2bc0 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:36:09.536552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1353/2716] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:36:12.738604 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b952ee-ad4c-486c-a4d0-9e6f2f384008 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:36:12.739078 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b952ee-ad4c-486c-a4d0-9e6f2f384008 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:36:12.739339 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b952ee-ad4c-486c-a4d0-9e6f2f384008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:36:12.759316 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-51b952ee-ad4c-486c-a4d0-9e6f2f384008 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:36:12.760704 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-51b952ee-ad4c-486c-a4d0-9e6f2f384008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:36:12.770019 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1364/2717] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Jul 12 03:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:36:12.799967 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b3556-f70c-482b-8458-41008efa2bc0 service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:36:12.812304 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b3556-f70c-482b-8458-41008efa2bc0 service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:36:12.820184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d9c49-9ef2-4986-90b7-57d81544f095 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:36:12.820863 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d9c49-9ef2-4986-90b7-57d81544f095 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:36:12.821137 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d9c49-9ef2-4986-90b7-57d81544f095 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:36:12.821400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d9c49-9ef2-4986-90b7-57d81544f095 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:36:12.830306 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d9c49-9ef2-4986-90b7-57d81544f095 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:36:12.831887 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d9c49-9ef2-4986-90b7-57d81544f095 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:36:12.842201 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1354/2718] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:36:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:36:15.857187 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28821f17-32fe-43ad-be6d-5c045177bbe9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:36:15.858387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28821f17-32fe-43ad-be6d-5c045177bbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:36:15.858906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28821f17-32fe-43ad-be6d-5c045177bbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:36:15.960418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-28821f17-32fe-43ad-be6d-5c045177bbe9 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:36:15.961960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-28821f17-32fe-43ad-be6d-5c045177bbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:36:16.017074 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1365/2719] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Jul 12 03:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:36:16.033374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d9c49-9ef2-4986-90b7-57d81544f095 service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:36:16.107182 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d9c49-9ef2-4986-90b7-57d81544f095 service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:36:16.113767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7dcb4-7907-4555-8270-e396bf1c9bd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:36:16.114428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7dcb4-7907-4555-8270-e396bf1c9bd6 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:36:16.114712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7dcb4-7907-4555-8270-e396bf1c9bd6 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:36:16.114986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7dcb4-7907-4555-8270-e396bf1c9bd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:36:16.124283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7dcb4-7907-4555-8270-e396bf1c9bd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:36:16.125947 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7dcb4-7907-4555-8270-e396bf1c9bd6 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:36:16.135645 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1355/2720] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:36:19.005550 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337f3cd-c66c-4b8d-b9df-d24a36718ee5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:36:19.006020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337f3cd-c66c-4b8d-b9df-d24a36718ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:36:19.006212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337f3cd-c66c-4b8d-b9df-d24a36718ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:36:19.029185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8337f3cd-c66c-4b8d-b9df-d24a36718ee5 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:36:19.030363 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8337f3cd-c66c-4b8d-b9df-d24a36718ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:36:19.038671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1366/2721] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Jul 12 03:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:36:19.062772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7dcb4-7907-4555-8270-e396bf1c9bd6 service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:36:19.075772 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7dcb4-7907-4555-8270-e396bf1c9bd6 service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:36:19.083516 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa36ed-5bab-4cc1-8e79-25477730a6b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:36:19.084385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa36ed-5bab-4cc1-8e79-25477730a6b9 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:36:19.084822 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa36ed-5bab-4cc1-8e79-25477730a6b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:36:19.085214 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa36ed-5bab-4cc1-8e79-25477730a6b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:36:19.094775 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa36ed-5bab-4cc1-8e79-25477730a6b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:36:19.096351 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa36ed-5bab-4cc1-8e79-25477730a6b9 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:36:19.105988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1356/2722] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:36:22.205673 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bba1ac-9b54-4047-a6dc-30ec8f9cf5de None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:36:22.206195 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bba1ac-9b54-4047-a6dc-30ec8f9cf5de None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:36:22.206195 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bba1ac-9b54-4047-a6dc-30ec8f9cf5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:36:22.226244 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a3bba1ac-9b54-4047-a6dc-30ec8f9cf5de None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:36:22.227435 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a3bba1ac-9b54-4047-a6dc-30ec8f9cf5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:36:22.236695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1367/2723] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Jul 12 03:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:36:22.259870 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa36ed-5bab-4cc1-8e79-25477730a6b9 service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:36:22.271837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa36ed-5bab-4cc1-8e79-25477730a6b9 service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:36:22.278946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65304f-f7a8-4831-9aa4-8ee36d5d7ede service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:36:22.279590 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65304f-f7a8-4831-9aa4-8ee36d5d7ede service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:36:22.279907 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65304f-f7a8-4831-9aa4-8ee36d5d7ede service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:36:22.280178 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65304f-f7a8-4831-9aa4-8ee36d5d7ede service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:36:22.289414 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65304f-f7a8-4831-9aa4-8ee36d5d7ede service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:36:22.291308 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65304f-f7a8-4831-9aa4-8ee36d5d7ede service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:36:22.301595 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1357/2724] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:36:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:36:31.487521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bba1ac-9b54-4047-a6dc-30ec8f9cf5de None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:36:31.489388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a3bba1ac-9b54-4047-a6dc-30ec8f9cf5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:36:31.600495 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bba1ac-9b54-4047-a6dc-30ec8f9cf5de None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:36:31.606500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efde4b-6ba7-4d48-943d-c4802bc3a26a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '361ad35021eb43cca46d9b66e6f24ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:36:31.607156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efde4b-6ba7-4d48-943d-c4802bc3a26a service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:36:31.607397 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efde4b-6ba7-4d48-943d-c4802bc3a26a service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:36:31.608278 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efde4b-6ba7-4d48-943d-c4802bc3a26a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:36:31.612127 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b8efde4b-6ba7-4d48-943d-c4802bc3a26a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:36:31.629500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efde4b-6ba7-4d48-943d-c4802bc3a26a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:36:31.631294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efde4b-6ba7-4d48-943d-c4802bc3a26a service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:36:31.644630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1368/2725] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:36:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:36:32.297157 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=54 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:36:41.639503 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:36:50.469452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65304f-f7a8-4831-9aa4-8ee36d5d7ede service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:36:50.482413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65304f-f7a8-4831-9aa4-8ee36d5d7ede service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:36:50.487890 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac8fa4-9ebd-4e2d-8818-533905774edc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '361ad35021eb43cca46d9b66e6f24ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:36:50.488561 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac8fa4-9ebd-4e2d-8818-533905774edc service placement] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:36:50.488846 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac8fa4-9ebd-4e2d-8818-533905774edc service placement] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:36:50.489114 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac8fa4-9ebd-4e2d-8818-533905774edc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:36:50.491244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-57ac8fa4-9ebd-4e2d-8818-533905774edc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:36:50.504016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac8fa4-9ebd-4e2d-8818-533905774edc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:36:50.505813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac8fa4-9ebd-4e2d-8818-533905774edc service placement] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:36:50.521717 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1358/2726] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:36:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:36:50.529714 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efde4b-6ba7-4d48-943d-c4802bc3a26a service placement] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:36:50.531273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b8efde4b-6ba7-4d48-943d-c4802bc3a26a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:36:50.545737 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efde4b-6ba7-4d48-943d-c4802bc3a26a service placement] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:36:50.559369 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709ebb4-9e84-4156-8fe4-3435562dcf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:36:50.560276 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ebb4-9e84-4156-8fe4-3435562dcf67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:36:50.560567 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ebb4-9e84-4156-8fe4-3435562dcf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:36:50.560845 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ebb4-9e84-4156-8fe4-3435562dcf67 admin admin] PATH_INFO: `/v3/users/06823668819b44d699dc5f72c913d3e0` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:36:50.562083 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709ebb4-9e84-4156-8fe4-3435562dcf67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06823668819b44d699dc5f72c913d3e0)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:36:50.564076 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709ebb4-9e84-4156-8fe4-3435562dcf67 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:36:50.613983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c709ebb4-9e84-4156-8fe4-3435562dcf67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06823668819b44d699dc5f72c913d3e0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:36:50.623604 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c709ebb4-9e84-4156-8fe4-3435562dcf67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06823668819b44d699dc5f72c913d3e0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:36:50.630953 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c709ebb4-9e84-4156-8fe4-3435562dcf67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06823668819b44d699dc5f72c913d3e0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:36:50.631636 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c709ebb4-9e84-4156-8fe4-3435562dcf67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06823668819b44d699dc5f72c913d3e0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:36:50.643717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c709ebb4-9e84-4156-8fe4-3435562dcf67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06823668819b44d699dc5f72c913d3e0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:36:50.650609 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1369/2727] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:36:50 2022] DELETE /identity/v3/users/06823668819b44d699dc5f72c913d3e0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:36:50.842980 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac8fa4-9ebd-4e2d-8818-533905774edc service placement] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:36:50.854300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac8fa4-9ebd-4e2d-8818-533905774edc service placement] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:36:50.916593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d733807-b14c-4f84-8078-bb0cb40fb80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:36:50.917468 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733807-b14c-4f84-8078-bb0cb40fb80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:36:50.917743 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733807-b14c-4f84-8078-bb0cb40fb80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:36:50.918020 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733807-b14c-4f84-8078-bb0cb40fb80f admin admin] PATH_INFO: `/v3/projects/57601cacadea41a4a7821cc90b604a6a` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:36:50.919227 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d733807-b14c-4f84-8078-bb0cb40fb80f admin admin] RBAC: Authorizing `identity:delete_project(project_id=57601cacadea41a4a7821cc90b604a6a)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:36:50.921146 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d733807-b14c-4f84-8078-bb0cb40fb80f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:36:50.973754 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0d733807-b14c-4f84-8078-bb0cb40fb80f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57601cacadea41a4a7821cc90b604a6a', 'request_id': 'req-0d733807-b14c-4f84-8078-bb0cb40fb80f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:36:50.982984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0d733807-b14c-4f84-8078-bb0cb40fb80f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57601cacadea41a4a7821cc90b604a6a', 'request_id': 'req-0d733807-b14c-4f84-8078-bb0cb40fb80f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:36:50.989307 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0d733807-b14c-4f84-8078-bb0cb40fb80f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57601cacadea41a4a7821cc90b604a6a', 'request_id': 'req-0d733807-b14c-4f84-8078-bb0cb40fb80f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:36:51.002011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0d733807-b14c-4f84-8078-bb0cb40fb80f admin admin] The token cache is being invalidate because project 57601cacadea41a4a7821cc90b604a6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:36:51.002308 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0d733807-b14c-4f84-8078-bb0cb40fb80f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:36:51.002952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0d733807-b14c-4f84-8078-bb0cb40fb80f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:36:51.004637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1359/2728] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:36:50 2022] DELETE /identity/v3/projects/57601cacadea41a4a7821cc90b604a6a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:36:56.123724 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71304185-aa82-4c80-b0e2-92be7da8cce4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:36:56.124274 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71304185-aa82-4c80-b0e2-92be7da8cce4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:36:56.124274 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71304185-aa82-4c80-b0e2-92be7da8cce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:36:56.153580 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-71304185-aa82-4c80-b0e2-92be7da8cce4 None None] MFA Rules not processed for user `e23aea853cce44698b19d6bc087093c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:36:56.154771 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-71304185-aa82-4c80-b0e2-92be7da8cce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:36:56.213521 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1370/2729] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 03:36:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:36:56.261642 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d733807-b14c-4f84-8078-bb0cb40fb80f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:36:56.263271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0d733807-b14c-4f84-8078-bb0cb40fb80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:36:56.337394 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d733807-b14c-4f84-8078-bb0cb40fb80f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:36:56.343267 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68100be-552d-4d31-9644-025da8341076 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc4cbd87dd249868cfb704535774126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:36:56.343910 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68100be-552d-4d31-9644-025da8341076 service swift] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:36:56.344186 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68100be-552d-4d31-9644-025da8341076 service swift] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:36:56.344452 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68100be-552d-4d31-9644-025da8341076 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:36:56.353267 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68100be-552d-4d31-9644-025da8341076 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:36:56.354840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68100be-552d-4d31-9644-025da8341076 service swift] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:36:56.362890 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1360/2730] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 03:36:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 03:37:06.205031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=58,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:37:06.359893 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:37:09.914041 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd6289-cfda-417a-85c4-6fa39f122e8e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:37:09.915466 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd6289-cfda-417a-85c4-6fa39f122e8e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:37:09.915466 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd6289-cfda-417a-85c4-6fa39f122e8e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:37:09.915968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1371/2731] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 03:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:37:09.922101 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6104b2-0c89-4bf5-8281-9511a63e83df None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:37:09.922577 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6104b2-0c89-4bf5-8281-9511a63e83df None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:37:09.922694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6104b2-0c89-4bf5-8281-9511a63e83df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:37:09.954976 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3d6104b2-0c89-4bf5-8281-9511a63e83df None None] MFA Rules not processed for user `0c43d9d0a6264b19a843077a4669ce70`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:37:09.956183 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3d6104b2-0c89-4bf5-8281-9511a63e83df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:37:10.028250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1361/2732] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 03:37:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:37:10.040306 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd6289-cfda-417a-85c4-6fa39f122e8e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:37:10.042247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fbfd6289-cfda-417a-85c4-6fa39f122e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:37:10.107030 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd6289-cfda-417a-85c4-6fa39f122e8e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:37:10.112871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea91c7-bc15-45a7-81d1-f46b76855bd8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97fe9d04ccb445208f3783a8b55cd31e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:37:10.113755 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea91c7-bc15-45a7-81d1-f46b76855bd8 service glance] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:37:10.114085 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea91c7-bc15-45a7-81d1-f46b76855bd8 service glance] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:37:10.114387 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea91c7-bc15-45a7-81d1-f46b76855bd8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:37:10.132026 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea91c7-bc15-45a7-81d1-f46b76855bd8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:37:10.133604 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea91c7-bc15-45a7-81d1-f46b76855bd8 service glance] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:37:10.144641 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1372/2733] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:37:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:37:10.218014 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97c033-6280-4951-a73e-1638bda1bf33 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:37:10.218301 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97c033-6280-4951-a73e-1638bda1bf33 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:37:10.218574 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97c033-6280-4951-a73e-1638bda1bf33 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:37:10.219934 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1362/2734] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 03:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:37:10.225039 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4792d-7d32-496d-9bd6-63ae95faccda None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:37:10.225936 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4792d-7d32-496d-9bd6-63ae95faccda None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:37:10.226253 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4792d-7d32-496d-9bd6-63ae95faccda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:37:10.257274 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-48e4792d-7d32-496d-9bd6-63ae95faccda None None] MFA Rules not processed for user `c2908efc19944583810abceb4c5d8d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:37:10.258495 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-48e4792d-7d32-496d-9bd6-63ae95faccda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:37:10.324359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1373/2735] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 03:37:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:37:10.339016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97c033-6280-4951-a73e-1638bda1bf33 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:37:10.341091 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8e97c033-6280-4951-a73e-1638bda1bf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:37:10.356380 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97c033-6280-4951-a73e-1638bda1bf33 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:37:10.360445 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4504438-98f3-4128-b491-02bdcc3cef94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:37:10.361123 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4504438-98f3-4128-b491-02bdcc3cef94 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:37:10.361395 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4504438-98f3-4128-b491-02bdcc3cef94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:37:10.361664 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4504438-98f3-4128-b491-02bdcc3cef94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:37:10.369547 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4504438-98f3-4128-b491-02bdcc3cef94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:37:10.370992 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4504438-98f3-4128-b491-02bdcc3cef94 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:37:10.379045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1363/2736] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:37:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:37:10.463154 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed326b-2bae-4676-9063-2c4f0a7694e8 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:37:10.463511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed326b-2bae-4676-9063-2c4f0a7694e8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:37:10.463807 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed326b-2bae-4676-9063-2c4f0a7694e8 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:37:10.465313 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1374/2737] 10.222.0.26 () {54 vars in 921 bytes} [Tue Jul 12 03:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 03:37:10.470598 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24210230-ba1a-44f1-9518-7c3cf1e4878f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:37:10.470887 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24210230-ba1a-44f1-9518-7c3cf1e4878f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:37:10.471165 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24210230-ba1a-44f1-9518-7c3cf1e4878f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:37:10.491361 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-24210230-ba1a-44f1-9518-7c3cf1e4878f None None] MFA Rules not processed for user `0c43d9d0a6264b19a843077a4669ce70`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:37:10.492546 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-24210230-ba1a-44f1-9518-7c3cf1e4878f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:37:10.503932 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1364/2738] 10.222.0.26 () {58 vars in 1018 bytes} [Tue Jul 12 03:37:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:37:10.514791 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed326b-2bae-4676-9063-2c4f0a7694e8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:37:10.527746 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed326b-2bae-4676-9063-2c4f0a7694e8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:37:10.531815 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e4f53-a71b-4f08-b036-d75c957955f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:37:10.532474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e4f53-a71b-4f08-b036-d75c957955f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:37:10.532781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e4f53-a71b-4f08-b036-d75c957955f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:37:10.533050 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e4f53-a71b-4f08-b036-d75c957955f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:37:10.543742 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e4f53-a71b-4f08-b036-d75c957955f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:37:10.545211 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e4f53-a71b-4f08-b036-d75c957955f0 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:37:10.556221 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1375/2739] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:37:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:37:12.170151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928189b3-c44f-4c39-8b45-ff87797b52db None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:37:12.170658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928189b3-c44f-4c39-8b45-ff87797b52db None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:37:12.170658 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928189b3-c44f-4c39-8b45-ff87797b52db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:37:12.190742 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-928189b3-c44f-4c39-8b45-ff87797b52db None None] MFA Rules not processed for user `e23aea853cce44698b19d6bc087093c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:37:12.191977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-928189b3-c44f-4c39-8b45-ff87797b52db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:37:12.201087 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1365/2740] 10.222.0.26 () {58 vars in 1009 bytes} [Tue Jul 12 03:37:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:37:12.213656 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e4f53-a71b-4f08-b036-d75c957955f0 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:37:12.225847 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e4f53-a71b-4f08-b036-d75c957955f0 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:37:12.231621 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c46671-b33b-4efc-8686-d1734100dbd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc4cbd87dd249868cfb704535774126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:37:12.232251 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c46671-b33b-4efc-8686-d1734100dbd3 service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:37:12.232544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c46671-b33b-4efc-8686-d1734100dbd3 service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:37:12.232821 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c46671-b33b-4efc-8686-d1734100dbd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:37:12.241826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c46671-b33b-4efc-8686-d1734100dbd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:37:12.243409 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c46671-b33b-4efc-8686-d1734100dbd3 service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:37:12.252078 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1376/2741] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 03:37:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 03:37:22.184949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=48 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:37:22.248787 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=70 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:37:25.945158 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa95cb3-6204-4320-993d-e277faeee6e8 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:37:25.945697 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa95cb3-6204-4320-993d-e277faeee6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:37:25.945697 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa95cb3-6204-4320-993d-e277faeee6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:37:25.967150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-afa95cb3-6204-4320-993d-e277faeee6e8 None None] MFA Rules not processed for user `e23aea853cce44698b19d6bc087093c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:37:25.968369 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-afa95cb3-6204-4320-993d-e277faeee6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:37:25.977078 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1366/2742] 10.222.0.26 () {58 vars in 967 bytes} [Tue Jul 12 03:37:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:37:25.989247 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c46671-b33b-4efc-8686-d1734100dbd3 service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:37:26.000459 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c46671-b33b-4efc-8686-d1734100dbd3 service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:37:26.007173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f844-a8bc-49b9-8377-65e098de2ee8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffc4cbd87dd249868cfb704535774126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:37:26.007811 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f844-a8bc-49b9-8377-65e098de2ee8 service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:37:26.008094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f844-a8bc-49b9-8377-65e098de2ee8 service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:37:26.008366 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f844-a8bc-49b9-8377-65e098de2ee8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:37:26.017370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7f844-a8bc-49b9-8377-65e098de2ee8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:37:26.018968 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7f844-a8bc-49b9-8377-65e098de2ee8 service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:37:26.027541 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1377/2743] 10.222.0.26 () {60 vars in 1384 bytes} [Tue Jul 12 03:37:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 03:37:35.961672 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:37:36.024084 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:08.543488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa95cb3-6204-4320-993d-e277faeee6e8 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:08.544934 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-afa95cb3-6204-4320-993d-e277faeee6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:08.556782 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa95cb3-6204-4320-993d-e277faeee6e8 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:08.560592 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db87636-f519-41bc-bc4b-70fa672d80b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:08.561218 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db87636-f519-41bc-bc4b-70fa672d80b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:08.561495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db87636-f519-41bc-bc4b-70fa672d80b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:08.561762 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db87636-f519-41bc-bc4b-70fa672d80b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:08.563568 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4db87636-f519-41bc-bc4b-70fa672d80b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:08.638088 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db87636-f519-41bc-bc4b-70fa672d80b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:08.640459 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db87636-f519-41bc-bc4b-70fa672d80b2 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:08.653782 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1367/2744] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:09.448922 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f844-a8bc-49b9-8377-65e098de2ee8 service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:09.450542 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-53a7f844-a8bc-49b9-8377-65e098de2ee8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:09.469146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f844-a8bc-49b9-8377-65e098de2ee8 service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:09.477712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86997dc9-6d3e-48f9-b337-5f8a4ef16468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:09.478590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86997dc9-6d3e-48f9-b337-5f8a4ef16468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:09.478867 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86997dc9-6d3e-48f9-b337-5f8a4ef16468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:09.479134 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86997dc9-6d3e-48f9-b337-5f8a4ef16468 admin admin] PATH_INFO: `/v3/users/c9211a496a7a466a9d0032c48363e544` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:09.480367 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86997dc9-6d3e-48f9-b337-5f8a4ef16468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9211a496a7a466a9d0032c48363e544)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:09.482333 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86997dc9-6d3e-48f9-b337-5f8a4ef16468 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:09.535891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-86997dc9-6d3e-48f9-b337-5f8a4ef16468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9211a496a7a466a9d0032c48363e544'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:09.548591 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-86997dc9-6d3e-48f9-b337-5f8a4ef16468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9211a496a7a466a9d0032c48363e544'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:09.556047 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-86997dc9-6d3e-48f9-b337-5f8a4ef16468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9211a496a7a466a9d0032c48363e544'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:09.556784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-86997dc9-6d3e-48f9-b337-5f8a4ef16468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9211a496a7a466a9d0032c48363e544'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:09.569526 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-86997dc9-6d3e-48f9-b337-5f8a4ef16468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9211a496a7a466a9d0032c48363e544'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:09.576060 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1378/2745] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:38:09 2022] DELETE /identity/v3/users/c9211a496a7a466a9d0032c48363e544 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:09.754986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db87636-f519-41bc-bc4b-70fa672d80b2 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:09.766776 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db87636-f519-41bc-bc4b-70fa672d80b2 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:09.825575 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04123815-ede6-45c2-8828-c76cd022d406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:09.826518 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04123815-ede6-45c2-8828-c76cd022d406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:09.826730 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04123815-ede6-45c2-8828-c76cd022d406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:09.827001 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04123815-ede6-45c2-8828-c76cd022d406 admin admin] PATH_INFO: `/v3/projects/aba3c24136af44a0aeb30a154224dc93` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:09.828198 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04123815-ede6-45c2-8828-c76cd022d406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba3c24136af44a0aeb30a154224dc93)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:09.830183 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04123815-ede6-45c2-8828-c76cd022d406 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:09.880176 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-04123815-ede6-45c2-8828-c76cd022d406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba3c24136af44a0aeb30a154224dc93', 'request_id': 'req-04123815-ede6-45c2-8828-c76cd022d406'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:09.889915 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-04123815-ede6-45c2-8828-c76cd022d406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba3c24136af44a0aeb30a154224dc93', 'request_id': 'req-04123815-ede6-45c2-8828-c76cd022d406'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:09.896312 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-04123815-ede6-45c2-8828-c76cd022d406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba3c24136af44a0aeb30a154224dc93', 'request_id': 'req-04123815-ede6-45c2-8828-c76cd022d406'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:09.908064 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-04123815-ede6-45c2-8828-c76cd022d406 admin admin] The token cache is being invalidate because project aba3c24136af44a0aeb30a154224dc93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:38:09.908349 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-04123815-ede6-45c2-8828-c76cd022d406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:09.909093 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-04123815-ede6-45c2-8828-c76cd022d406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:09.910722 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1368/2746] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:38:09 2022] DELETE /identity/v3/projects/aba3c24136af44a0aeb30a154224dc93 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:09.917297 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc5741-c241-4ded-8af9-8ba594e66839 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:09.917582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc5741-c241-4ded-8af9-8ba594e66839 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:09.917855 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc5741-c241-4ded-8af9-8ba594e66839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:09.936952 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c0bc5741-c241-4ded-8af9-8ba594e66839 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:09.938157 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c0bc5741-c241-4ded-8af9-8ba594e66839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:09.999662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1379/2747] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:10.008077 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63edb8-53e0-40e5-a007-6aad3b3f317c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:10.008367 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63edb8-53e0-40e5-a007-6aad3b3f317c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:10.008676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63edb8-53e0-40e5-a007-6aad3b3f317c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:10.027694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-7d63edb8-53e0-40e5-a007-6aad3b3f317c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:10.028936 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7d63edb8-53e0-40e5-a007-6aad3b3f317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:10.037475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1369/2748] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:10.041931 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc5741-c241-4ded-8af9-8ba594e66839 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:10.051906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc5741-c241-4ded-8af9-8ba594e66839 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:10.057062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7cdce-18a2-4e7e-b0fd-7066c94cb69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:10.057755 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7cdce-18a2-4e7e-b0fd-7066c94cb69d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:10.058028 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7cdce-18a2-4e7e-b0fd-7066c94cb69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:10.058294 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7cdce-18a2-4e7e-b0fd-7066c94cb69d admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:10.059027 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7cdce-18a2-4e7e-b0fd-7066c94cb69d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:38:10.059328 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7cdce-18a2-4e7e-b0fd-7066c94cb69d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:10.061020 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7cdce-18a2-4e7e-b0fd-7066c94cb69d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:10.073452 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1380/2749] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:38:10.077801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63edb8-53e0-40e5-a007-6aad3b3f317c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:10.087749 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63edb8-53e0-40e5-a007-6aad3b3f317c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:10.092813 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346203a9-3471-42b1-963a-2bd5cb9f707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:10.093470 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346203a9-3471-42b1-963a-2bd5cb9f707d admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:10.093751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346203a9-3471-42b1-963a-2bd5cb9f707d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:10.094025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346203a9-3471-42b1-963a-2bd5cb9f707d admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:10.094717 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346203a9-3471-42b1-963a-2bd5cb9f707d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:10.096684 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346203a9-3471-42b1-963a-2bd5cb9f707d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:10.111488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:10.131223 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1370/2750] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:38:10 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:10.135631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7cdce-18a2-4e7e-b0fd-7066c94cb69d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:10.145814 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7cdce-18a2-4e7e-b0fd-7066c94cb69d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:10.201905 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ad62c-17d5-4436-8e70-1f781c574e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:10.202560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad62c-17d5-4436-8e70-1f781c574e47 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:10.202840 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad62c-17d5-4436-8e70-1f781c574e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:10.203109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ad62c-17d5-4436-8e70-1f781c574e47 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:10.203792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ad62c-17d5-4436-8e70-1f781c574e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:10.205740 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ad62c-17d5-4436-8e70-1f781c574e47 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:10.212834 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:10.231967 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1381/2751] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:38:10 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:10.235994 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346203a9-3471-42b1-963a-2bd5cb9f707d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:10.246559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346203a9-3471-42b1-963a-2bd5cb9f707d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:10.251699 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db268616-288b-4f2f-8f96-d42f00755805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:10.252357 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db268616-288b-4f2f-8f96-d42f00755805 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:10.252673 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db268616-288b-4f2f-8f96-d42f00755805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:10.252941 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db268616-288b-4f2f-8f96-d42f00755805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:10.253665 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db268616-288b-4f2f-8f96-d42f00755805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:10.255250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db268616-288b-4f2f-8f96-d42f00755805 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:10.266387 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1371/2752] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:38:10.272324 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ad62c-17d5-4436-8e70-1f781c574e47 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:10.285654 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ad62c-17d5-4436-8e70-1f781c574e47 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:10.292454 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cd145-9993-415d-b323-2f82e5c7a0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:10.293175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cd145-9993-415d-b323-2f82e5c7a0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:10.293456 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cd145-9993-415d-b323-2f82e5c7a0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:10.293721 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cd145-9993-415d-b323-2f82e5c7a0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:10.294471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cd145-9993-415d-b323-2f82e5c7a0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:10.296055 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cd145-9993-415d-b323-2f82e5c7a0c8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:10.307936 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1382/2753] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:10.312211 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db268616-288b-4f2f-8f96-d42f00755805 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:10.322982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db268616-288b-4f2f-8f96-d42f00755805 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:10.328967 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269e4a2-168d-4ce0-a455-00e98f7d81d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:10.329773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269e4a2-168d-4ce0-a455-00e98f7d81d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:10.330096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269e4a2-168d-4ce0-a455-00e98f7d81d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:10.330348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269e4a2-168d-4ce0-a455-00e98f7d81d2 admin admin] PATH_INFO: `/v3/projects/450074c5bf8e405b88fec64ecb72864e/users/10157b37a57440379264534d097bdd15/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:10.346568 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269e4a2-168d-4ce0-a455-00e98f7d81d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=450074c5bf8e405b88fec64ecb72864e, user_id=10157b37a57440379264534d097bdd15, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:10.349271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269e4a2-168d-4ce0-a455-00e98f7d81d2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:10.364118 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1372/2754] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:10 2022] PUT /identity/v3/projects/450074c5bf8e405b88fec64ecb72864e/users/10157b37a57440379264534d097bdd15/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:10.374994 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b666b-fd62-4ea8-bec6-30a0d701b4c6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:10.375275 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b666b-fd62-4ea8-bec6-30a0d701b4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:10.375546 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b666b-fd62-4ea8-bec6-30a0d701b4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:10.406508 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cb5b666b-fd62-4ea8-bec6-30a0d701b4c6 None None] MFA Rules not processed for user `10157b37a57440379264534d097bdd15`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:10.407753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cb5b666b-fd62-4ea8-bec6-30a0d701b4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:10.476046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1383/2755] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:10.481190 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269e4a2-168d-4ce0-a455-00e98f7d81d2 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:10.547939 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269e4a2-168d-4ce0-a455-00e98f7d81d2 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:10.553603 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7fb20-6d1f-46d1-b65d-b390fd47d125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:10.554250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7fb20-6d1f-46d1-b65d-b390fd47d125 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:10.554528 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7fb20-6d1f-46d1-b65d-b390fd47d125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:10.554800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7fb20-6d1f-46d1-b65d-b390fd47d125 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:10.555482 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7fb20-6d1f-46d1-b65d-b390fd47d125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:10.557496 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7fb20-6d1f-46d1-b65d-b390fd47d125 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:10.584751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1373/2756] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:38:10 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:10.589080 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b666b-fd62-4ea8-bec6-30a0d701b4c6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:10.599926 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b666b-fd62-4ea8-bec6-30a0d701b4c6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:10.661570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd50e5-b919-49b4-af51-3e9ec13b3fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:10.662236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd50e5-b919-49b4-af51-3e9ec13b3fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:10.662515 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd50e5-b919-49b4-af51-3e9ec13b3fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:10.662761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd50e5-b919-49b4-af51-3e9ec13b3fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:10.663462 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd50e5-b919-49b4-af51-3e9ec13b3fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:10.665409 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd50e5-b919-49b4-af51-3e9ec13b3fb3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:10.686556 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1384/2757] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:38:10 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:10.690622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7fb20-6d1f-46d1-b65d-b390fd47d125 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:10.702236 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7fb20-6d1f-46d1-b65d-b390fd47d125 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:10.707615 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99b21f-8e46-4bfa-9448-305e3f5ce1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:10.708285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99b21f-8e46-4bfa-9448-305e3f5ce1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:10.708600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99b21f-8e46-4bfa-9448-305e3f5ce1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:10.708880 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99b21f-8e46-4bfa-9448-305e3f5ce1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:10.709642 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99b21f-8e46-4bfa-9448-305e3f5ce1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:10.711277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99b21f-8e46-4bfa-9448-305e3f5ce1c6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:10.722797 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1374/2758] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:10.728631 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd50e5-b919-49b4-af51-3e9ec13b3fb3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:10.739236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd50e5-b919-49b4-af51-3e9ec13b3fb3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:10.744122 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803e861-970e-4fb1-9275-9295fd3f26ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:10.745024 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803e861-970e-4fb1-9275-9295fd3f26ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:10.745299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803e861-970e-4fb1-9275-9295fd3f26ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:10.745566 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803e861-970e-4fb1-9275-9295fd3f26ca admin admin] PATH_INFO: `/v3/projects/b3ecf04f491141ec9a3ee58a6686a06a/users/450e6a468dcb4843a011b10e737bba98/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:10.760582 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803e861-970e-4fb1-9275-9295fd3f26ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ecf04f491141ec9a3ee58a6686a06a, user_id=450e6a468dcb4843a011b10e737bba98, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:10.763337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803e861-970e-4fb1-9275-9295fd3f26ca admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:10.779776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1385/2759] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:10 2022] PUT /identity/v3/projects/b3ecf04f491141ec9a3ee58a6686a06a/users/450e6a468dcb4843a011b10e737bba98/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:38:10.783861 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99b21f-8e46-4bfa-9448-305e3f5ce1c6 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:10.794731 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99b21f-8e46-4bfa-9448-305e3f5ce1c6 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:10.854442 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d240ae-b1fe-42a8-b97e-2620a7f547c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:10.855027 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d240ae-b1fe-42a8-b97e-2620a7f547c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:10.855346 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d240ae-b1fe-42a8-b97e-2620a7f547c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:10.855620 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d240ae-b1fe-42a8-b97e-2620a7f547c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:10.856342 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d240ae-b1fe-42a8-b97e-2620a7f547c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:10.857967 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d240ae-b1fe-42a8-b97e-2620a7f547c3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:10.867638 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1375/2760] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:10.872264 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803e861-970e-4fb1-9275-9295fd3f26ca admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:10.882677 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803e861-970e-4fb1-9275-9295fd3f26ca admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:10.887942 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f8fc5-1f59-47ff-ae4b-0b1fc63b345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:10.888857 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f8fc5-1f59-47ff-ae4b-0b1fc63b345e admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:10.889132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f8fc5-1f59-47ff-ae4b-0b1fc63b345e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:10.889412 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f8fc5-1f59-47ff-ae4b-0b1fc63b345e admin admin] PATH_INFO: `/v3/projects/b3ecf04f491141ec9a3ee58a6686a06a/users/450e6a468dcb4843a011b10e737bba98/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:10.891645 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f8fc5-1f59-47ff-ae4b-0b1fc63b345e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ecf04f491141ec9a3ee58a6686a06a, user_id=450e6a468dcb4843a011b10e737bba98, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:10.894351 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f8fc5-1f59-47ff-ae4b-0b1fc63b345e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:10.905997 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1386/2761] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:10 2022] PUT /identity/v3/projects/b3ecf04f491141ec9a3ee58a6686a06a/users/450e6a468dcb4843a011b10e737bba98/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:10.916551 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a23448-4e17-49dd-895b-74b998e54e8a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:10.916862 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a23448-4e17-49dd-895b-74b998e54e8a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:10.917138 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a23448-4e17-49dd-895b-74b998e54e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:10.944793 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-88a23448-4e17-49dd-895b-74b998e54e8a None None] MFA Rules not processed for user `450e6a468dcb4843a011b10e737bba98`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:10.945998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-88a23448-4e17-49dd-895b-74b998e54e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:10.965595 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:11.018571 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1376/2762] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:11.036185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f8fc5-1f59-47ff-ae4b-0b1fc63b345e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:11.039359 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-800f8fc5-1f59-47ff-ae4b-0b1fc63b345e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:11.063895 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:11.133149 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f8fc5-1f59-47ff-ae4b-0b1fc63b345e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:11.137345 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0db4c4-3c79-491b-8948-d3a0164cf4b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:11.138006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0db4c4-3c79-491b-8948-d3a0164cf4b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:11.138287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0db4c4-3c79-491b-8948-d3a0164cf4b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:11.138562 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0db4c4-3c79-491b-8948-d3a0164cf4b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:11.147871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0db4c4-3c79-491b-8948-d3a0164cf4b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:11.149334 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0db4c4-3c79-491b-8948-d3a0164cf4b8 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:11.158922 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1387/2763] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:11.579801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a23448-4e17-49dd-895b-74b998e54e8a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:11.644857 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a23448-4e17-49dd-895b-74b998e54e8a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:11.649804 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ef5de-4f0e-4a95-89cc-d67a927da7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:11.650621 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ef5de-4f0e-4a95-89cc-d67a927da7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:11.650900 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ef5de-4f0e-4a95-89cc-d67a927da7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:11.651175 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ef5de-4f0e-4a95-89cc-d67a927da7b5 admin admin] PATH_INFO: `/v3/users/10157b37a57440379264534d097bdd15` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:11.652383 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ef5de-4f0e-4a95-89cc-d67a927da7b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10157b37a57440379264534d097bdd15)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:11.654349 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ef5de-4f0e-4a95-89cc-d67a927da7b5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:11.708905 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3d5ef5de-4f0e-4a95-89cc-d67a927da7b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10157b37a57440379264534d097bdd15'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:11.719042 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3d5ef5de-4f0e-4a95-89cc-d67a927da7b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10157b37a57440379264534d097bdd15'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:11.732385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3d5ef5de-4f0e-4a95-89cc-d67a927da7b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10157b37a57440379264534d097bdd15'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:11.733323 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3d5ef5de-4f0e-4a95-89cc-d67a927da7b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10157b37a57440379264534d097bdd15'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:11.744434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3d5ef5de-4f0e-4a95-89cc-d67a927da7b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10157b37a57440379264534d097bdd15'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:11.754816 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1377/2764] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:38:11 2022] DELETE /identity/v3/users/10157b37a57440379264534d097bdd15 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:11.760036 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b72e32-3d0b-4bd8-9fcc-0fba1272775e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:11.760567 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b72e32-3d0b-4bd8-9fcc-0fba1272775e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:11.760567 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b72e32-3d0b-4bd8-9fcc-0fba1272775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:11.778805 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f4b72e32-3d0b-4bd8-9fcc-0fba1272775e None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:11.780016 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f4b72e32-3d0b-4bd8-9fcc-0fba1272775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:11.848555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1388/2765] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:11.858898 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ef5de-4f0e-4a95-89cc-d67a927da7b5 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:11.860446 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3d5ef5de-4f0e-4a95-89cc-d67a927da7b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:11.902472 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:11.923713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ef5de-4f0e-4a95-89cc-d67a927da7b5 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:11.929679 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c2f35-2402-4bf4-b457-15f7ed79afbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:11.930588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c2f35-2402-4bf4-b457-15f7ed79afbb service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:11.931545 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c2f35-2402-4bf4-b457-15f7ed79afbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:11.931825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c2f35-2402-4bf4-b457-15f7ed79afbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:11.941434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c2f35-2402-4bf4-b457-15f7ed79afbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:11.942860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c2f35-2402-4bf4-b457-15f7ed79afbb service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:11.956783 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1378/2766] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:12.235198 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b72e32-3d0b-4bd8-9fcc-0fba1272775e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:12.237132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f4b72e32-3d0b-4bd8-9fcc-0fba1272775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:12.250670 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b72e32-3d0b-4bd8-9fcc-0fba1272775e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:12.256999 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6bd77-249d-482f-b2c4-31cc5758f5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:12.257885 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6bd77-249d-482f-b2c4-31cc5758f5ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:12.258175 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6bd77-249d-482f-b2c4-31cc5758f5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:12.258488 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6bd77-249d-482f-b2c4-31cc5758f5ab admin admin] PATH_INFO: `/v3/projects/450074c5bf8e405b88fec64ecb72864e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:12.260544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6bd77-249d-482f-b2c4-31cc5758f5ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=450074c5bf8e405b88fec64ecb72864e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:12.262485 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6bd77-249d-482f-b2c4-31cc5758f5ab admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:12.312928 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-24b6bd77-249d-482f-b2c4-31cc5758f5ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '450074c5bf8e405b88fec64ecb72864e', 'request_id': 'req-24b6bd77-249d-482f-b2c4-31cc5758f5ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:12.322648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-24b6bd77-249d-482f-b2c4-31cc5758f5ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '450074c5bf8e405b88fec64ecb72864e', 'request_id': 'req-24b6bd77-249d-482f-b2c4-31cc5758f5ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:12.328418 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-24b6bd77-249d-482f-b2c4-31cc5758f5ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '450074c5bf8e405b88fec64ecb72864e', 'request_id': 'req-24b6bd77-249d-482f-b2c4-31cc5758f5ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:12.340322 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-24b6bd77-249d-482f-b2c4-31cc5758f5ab admin admin] The token cache is being invalidate because project 450074c5bf8e405b88fec64ecb72864e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:38:12.340648 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-24b6bd77-249d-482f-b2c4-31cc5758f5ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:12.341270 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-24b6bd77-249d-482f-b2c4-31cc5758f5ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:12.342809 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1389/2767] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:38:12 2022] DELETE /identity/v3/projects/450074c5bf8e405b88fec64ecb72864e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:12.347090 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c2f35-2402-4bf4-b457-15f7ed79afbb service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:12.357215 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c2f35-2402-4bf4-b457-15f7ed79afbb service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:12.428311 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262018be-9411-4eb6-b882-13c9ff774e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:12.429156 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262018be-9411-4eb6-b882-13c9ff774e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:12.429430 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262018be-9411-4eb6-b882-13c9ff774e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:12.429704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262018be-9411-4eb6-b882-13c9ff774e2b admin admin] PATH_INFO: `/v3/users/450e6a468dcb4843a011b10e737bba98` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:12.431063 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262018be-9411-4eb6-b882-13c9ff774e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=450e6a468dcb4843a011b10e737bba98)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:12.433245 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262018be-9411-4eb6-b882-13c9ff774e2b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:12.492022 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-262018be-9411-4eb6-b882-13c9ff774e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '450e6a468dcb4843a011b10e737bba98'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:12.501273 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-262018be-9411-4eb6-b882-13c9ff774e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '450e6a468dcb4843a011b10e737bba98'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:12.513344 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-262018be-9411-4eb6-b882-13c9ff774e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '450e6a468dcb4843a011b10e737bba98'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:12.513959 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-262018be-9411-4eb6-b882-13c9ff774e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '450e6a468dcb4843a011b10e737bba98'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:12.520659 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-262018be-9411-4eb6-b882-13c9ff774e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '450e6a468dcb4843a011b10e737bba98'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:12.526780 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1379/2768] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:38:12 2022] DELETE /identity/v3/users/450e6a468dcb4843a011b10e737bba98 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:38:12.809123 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6bd77-249d-482f-b2c4-31cc5758f5ab admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:12.810611 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-24b6bd77-249d-482f-b2c4-31cc5758f5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:12.824146 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6bd77-249d-482f-b2c4-31cc5758f5ab admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:12.850210 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:12.882669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fc9b7-21ea-4e51-9afd-3c0dd0ca1da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:12.883538 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fc9b7-21ea-4e51-9afd-3c0dd0ca1da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:12.883870 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fc9b7-21ea-4e51-9afd-3c0dd0ca1da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:12.884238 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fc9b7-21ea-4e51-9afd-3c0dd0ca1da1 admin admin] PATH_INFO: `/v3/projects/b3ecf04f491141ec9a3ee58a6686a06a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:12.885474 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3fc9b7-21ea-4e51-9afd-3c0dd0ca1da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ecf04f491141ec9a3ee58a6686a06a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:12.887364 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3fc9b7-21ea-4e51-9afd-3c0dd0ca1da1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:12.938101 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fa3fc9b7-21ea-4e51-9afd-3c0dd0ca1da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ecf04f491141ec9a3ee58a6686a06a', 'request_id': 'req-fa3fc9b7-21ea-4e51-9afd-3c0dd0ca1da1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:12.947958 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fa3fc9b7-21ea-4e51-9afd-3c0dd0ca1da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ecf04f491141ec9a3ee58a6686a06a', 'request_id': 'req-fa3fc9b7-21ea-4e51-9afd-3c0dd0ca1da1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:12.953720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fa3fc9b7-21ea-4e51-9afd-3c0dd0ca1da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ecf04f491141ec9a3ee58a6686a06a', 'request_id': 'req-fa3fc9b7-21ea-4e51-9afd-3c0dd0ca1da1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:12.965184 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fa3fc9b7-21ea-4e51-9afd-3c0dd0ca1da1 admin admin] The token cache is being invalidate because project b3ecf04f491141ec9a3ee58a6686a06a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:38:12.965468 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fa3fc9b7-21ea-4e51-9afd-3c0dd0ca1da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:12.966125 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fa3fc9b7-21ea-4e51-9afd-3c0dd0ca1da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:12.967669 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1390/2769] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:38:12 2022] DELETE /identity/v3/projects/b3ecf04f491141ec9a3ee58a6686a06a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:38:12.972722 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a505f-097f-4d52-8915-46cdf07795d0 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:12.973239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a505f-097f-4d52-8915-46cdf07795d0 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:12.973239 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a505f-097f-4d52-8915-46cdf07795d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:12.992556 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ca4a505f-097f-4d52-8915-46cdf07795d0 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:12.994351 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ca4a505f-097f-4d52-8915-46cdf07795d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:13.047496 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:13.065748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1380/2770] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:38:13.074114 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba849f4-a97e-45de-ac99-d42be1961465 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:13.074405 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba849f4-a97e-45de-ac99-d42be1961465 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:13.074684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba849f4-a97e-45de-ac99-d42be1961465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:13.093869 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5ba849f4-a97e-45de-ac99-d42be1961465 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:13.095083 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5ba849f4-a97e-45de-ac99-d42be1961465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:13.103681 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1391/2771] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:13.107938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a505f-097f-4d52-8915-46cdf07795d0 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:13.118043 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a505f-097f-4d52-8915-46cdf07795d0 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:13.123657 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be817bb2-621b-4322-93b0-84a4b570b2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:13.124311 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be817bb2-621b-4322-93b0-84a4b570b2ae admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:13.124622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be817bb2-621b-4322-93b0-84a4b570b2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:13.124895 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be817bb2-621b-4322-93b0-84a4b570b2ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:13.125645 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be817bb2-621b-4322-93b0-84a4b570b2ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:38:13.125952 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be817bb2-621b-4322-93b0-84a4b570b2ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:13.127588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be817bb2-621b-4322-93b0-84a4b570b2ae admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:13.139142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1381/2772] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:38:13.143324 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba849f4-a97e-45de-ac99-d42be1961465 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:13.152575 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba849f4-a97e-45de-ac99-d42be1961465 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:13.157517 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571422be-ef48-4f32-9a36-70d24621f7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:13.158160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571422be-ef48-4f32-9a36-70d24621f7ea admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:13.158437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571422be-ef48-4f32-9a36-70d24621f7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:13.158711 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571422be-ef48-4f32-9a36-70d24621f7ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:13.159399 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571422be-ef48-4f32-9a36-70d24621f7ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:13.161338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571422be-ef48-4f32-9a36-70d24621f7ea admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:13.188941 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1392/2773] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:38:13 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:13.192868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be817bb2-621b-4322-93b0-84a4b570b2ae admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:13.203087 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be817bb2-621b-4322-93b0-84a4b570b2ae admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:13.262653 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c980a-8747-40e0-83b4-50420426070b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:13.263327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c980a-8747-40e0-83b4-50420426070b admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:13.263601 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c980a-8747-40e0-83b4-50420426070b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:13.263866 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c980a-8747-40e0-83b4-50420426070b admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:13.264563 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c980a-8747-40e0-83b4-50420426070b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:13.266515 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c980a-8747-40e0-83b4-50420426070b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:13.288557 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1382/2774] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:38:13 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:38:13.292915 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571422be-ef48-4f32-9a36-70d24621f7ea admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:13.303343 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571422be-ef48-4f32-9a36-70d24621f7ea admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:13.308555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11aceb9-97ea-46cd-a5ed-3136dcd9ccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:13.309220 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aceb9-97ea-46cd-a5ed-3136dcd9ccfd admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:13.309499 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aceb9-97ea-46cd-a5ed-3136dcd9ccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:13.309753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aceb9-97ea-46cd-a5ed-3136dcd9ccfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:13.310479 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11aceb9-97ea-46cd-a5ed-3136dcd9ccfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:13.312111 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11aceb9-97ea-46cd-a5ed-3136dcd9ccfd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:13.323062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1393/2775] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:13.327053 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c980a-8747-40e0-83b4-50420426070b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:13.338246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c980a-8747-40e0-83b4-50420426070b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:13.343037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097d695-8cb8-4696-b798-3e3a45a9d899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:13.343712 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097d695-8cb8-4696-b798-3e3a45a9d899 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:13.343993 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097d695-8cb8-4696-b798-3e3a45a9d899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:13.344248 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097d695-8cb8-4696-b798-3e3a45a9d899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:13.345037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097d695-8cb8-4696-b798-3e3a45a9d899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:13.346645 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097d695-8cb8-4696-b798-3e3a45a9d899 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:13.357785 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1383/2776] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:13.362090 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11aceb9-97ea-46cd-a5ed-3136dcd9ccfd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:13.372476 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11aceb9-97ea-46cd-a5ed-3136dcd9ccfd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:13.378223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1042df4-9ed2-43e1-9df6-c32416d132ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:13.379140 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1042df4-9ed2-43e1-9df6-c32416d132ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:13.379421 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1042df4-9ed2-43e1-9df6-c32416d132ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:13.379716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1042df4-9ed2-43e1-9df6-c32416d132ef admin admin] PATH_INFO: `/v3/projects/c3c3486005384cfc8c8e9126c6dc0b78/users/0f567edeb35948f4b5098e8a5595f24a/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:13.395603 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1042df4-9ed2-43e1-9df6-c32416d132ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c3486005384cfc8c8e9126c6dc0b78, user_id=0f567edeb35948f4b5098e8a5595f24a, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:13.398314 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1042df4-9ed2-43e1-9df6-c32416d132ef admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:13.413197 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1394/2777] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:13 2022] PUT /identity/v3/projects/c3c3486005384cfc8c8e9126c6dc0b78/users/0f567edeb35948f4b5098e8a5595f24a/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:13.423611 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670f237-5e10-4834-a626-3159a35ef2cc None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:13.423900 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670f237-5e10-4834-a626-3159a35ef2cc None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:13.424176 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670f237-5e10-4834-a626-3159a35ef2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:13.451224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-7670f237-5e10-4834-a626-3159a35ef2cc None None] MFA Rules not processed for user `0f567edeb35948f4b5098e8a5595f24a`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:13.452370 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7670f237-5e10-4834-a626-3159a35ef2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:13.517390 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1384/2778] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:13.522099 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1042df4-9ed2-43e1-9df6-c32416d132ef admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:13.577604 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:13.589390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1042df4-9ed2-43e1-9df6-c32416d132ef admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:13.595522 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f1886-37f9-4b8e-ac1f-96e78c56558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:13.596178 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f1886-37f9-4b8e-ac1f-96e78c56558a admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:13.596467 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f1886-37f9-4b8e-ac1f-96e78c56558a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:13.596785 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f1886-37f9-4b8e-ac1f-96e78c56558a admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:13.597697 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f1886-37f9-4b8e-ac1f-96e78c56558a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:13.599603 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f1886-37f9-4b8e-ac1f-96e78c56558a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:13.626874 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1395/2779] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:38:13 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:13.631354 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670f237-5e10-4834-a626-3159a35ef2cc None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:13.645553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670f237-5e10-4834-a626-3159a35ef2cc None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:13.695019 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:13.706641 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ad3cf-51f7-401d-a2a1-1fe027e51f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:13.707642 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad3cf-51f7-401d-a2a1-1fe027e51f5d admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:13.707916 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad3cf-51f7-401d-a2a1-1fe027e51f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:13.708181 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad3cf-51f7-401d-a2a1-1fe027e51f5d admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:13.708903 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ad3cf-51f7-401d-a2a1-1fe027e51f5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:13.710825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ad3cf-51f7-401d-a2a1-1fe027e51f5d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:13.732705 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1385/2780] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:38:13 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:13.736853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f1886-37f9-4b8e-ac1f-96e78c56558a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:13.747324 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f1886-37f9-4b8e-ac1f-96e78c56558a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:13.752124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b9793-818a-4f47-b321-12891fee5faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:13.752814 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b9793-818a-4f47-b321-12891fee5faf admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:13.753111 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b9793-818a-4f47-b321-12891fee5faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:13.753384 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b9793-818a-4f47-b321-12891fee5faf admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:13.754118 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b9793-818a-4f47-b321-12891fee5faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:13.755723 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b9793-818a-4f47-b321-12891fee5faf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:13.766555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1396/2781] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:13.770704 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ad3cf-51f7-401d-a2a1-1fe027e51f5d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:13.781277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ad3cf-51f7-401d-a2a1-1fe027e51f5d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:13.786747 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b79aaf-3c9f-4df8-80a0-e4f63dbe1253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:13.787654 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b79aaf-3c9f-4df8-80a0-e4f63dbe1253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:13.787927 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b79aaf-3c9f-4df8-80a0-e4f63dbe1253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:13.788195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b79aaf-3c9f-4df8-80a0-e4f63dbe1253 admin admin] PATH_INFO: `/v3/projects/f0a756d863154242b8ea13e049dd9f09/users/7865e5b92f0149a7b1df29ad397d3261/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:13.803949 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b79aaf-3c9f-4df8-80a0-e4f63dbe1253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a756d863154242b8ea13e049dd9f09, user_id=7865e5b92f0149a7b1df29ad397d3261, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:13.807216 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b79aaf-3c9f-4df8-80a0-e4f63dbe1253 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:13.822508 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1386/2782] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:13 2022] PUT /identity/v3/projects/f0a756d863154242b8ea13e049dd9f09/users/7865e5b92f0149a7b1df29ad397d3261/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:13.826675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b9793-818a-4f47-b321-12891fee5faf admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:13.837781 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b9793-818a-4f47-b321-12891fee5faf admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:13.897573 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e85644-063a-45ce-b324-3a7a992ec7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:13.898242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e85644-063a-45ce-b324-3a7a992ec7aa admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:13.898527 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e85644-063a-45ce-b324-3a7a992ec7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:13.898799 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e85644-063a-45ce-b324-3a7a992ec7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:13.899569 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e85644-063a-45ce-b324-3a7a992ec7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:13.901218 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e85644-063a-45ce-b324-3a7a992ec7aa admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:13.911299 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1397/2783] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:13.915669 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b79aaf-3c9f-4df8-80a0-e4f63dbe1253 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:13.926081 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b79aaf-3c9f-4df8-80a0-e4f63dbe1253 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:13.931943 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d87fc-eebb-4258-a3cf-fc6d0ffdf44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:13.932964 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d87fc-eebb-4258-a3cf-fc6d0ffdf44c admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:13.933241 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d87fc-eebb-4258-a3cf-fc6d0ffdf44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:13.933597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d87fc-eebb-4258-a3cf-fc6d0ffdf44c admin admin] PATH_INFO: `/v3/projects/f0a756d863154242b8ea13e049dd9f09/users/7865e5b92f0149a7b1df29ad397d3261/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:13.936158 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d87fc-eebb-4258-a3cf-fc6d0ffdf44c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a756d863154242b8ea13e049dd9f09, user_id=7865e5b92f0149a7b1df29ad397d3261, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:13.938926 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d87fc-eebb-4258-a3cf-fc6d0ffdf44c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:13.950254 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1387/2784] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:13 2022] PUT /identity/v3/projects/f0a756d863154242b8ea13e049dd9f09/users/7865e5b92f0149a7b1df29ad397d3261/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:38:13.961944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b4c4e-fc49-4594-a092-9db266b23bfe None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:13.962543 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b4c4e-fc49-4594-a092-9db266b23bfe None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:13.962543 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b4c4e-fc49-4594-a092-9db266b23bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:13.999722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f15b4c4e-fc49-4594-a092-9db266b23bfe None None] MFA Rules not processed for user `7865e5b92f0149a7b1df29ad397d3261`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:14.000972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f15b4c4e-fc49-4594-a092-9db266b23bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:14.074284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1398/2785] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:14.086272 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d87fc-eebb-4258-a3cf-fc6d0ffdf44c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:14.088382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-210d87fc-eebb-4258-a3cf-fc6d0ffdf44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:14.157755 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d87fc-eebb-4258-a3cf-fc6d0ffdf44c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:14.162729 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf55ed-5d4a-4da0-93cd-7e67c37a448e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:14.163367 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf55ed-5d4a-4da0-93cd-7e67c37a448e service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:14.163642 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf55ed-5d4a-4da0-93cd-7e67c37a448e service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:14.163909 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf55ed-5d4a-4da0-93cd-7e67c37a448e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:14.174683 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf55ed-5d4a-4da0-93cd-7e67c37a448e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:14.176111 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf55ed-5d4a-4da0-93cd-7e67c37a448e service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:14.186039 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1388/2786] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:14.264675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b4c4e-fc49-4594-a092-9db266b23bfe None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:14.274644 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b4c4e-fc49-4594-a092-9db266b23bfe None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:14.278586 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c9612-8f8b-4826-b19f-927d3ebc0807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:14.279243 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c9612-8f8b-4826-b19f-927d3ebc0807 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:14.279557 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c9612-8f8b-4826-b19f-927d3ebc0807 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:14.279832 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c9612-8f8b-4826-b19f-927d3ebc0807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:14.326551 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:14.341124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c9612-8f8b-4826-b19f-927d3ebc0807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:14.342575 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c9612-8f8b-4826-b19f-927d3ebc0807 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:14.351744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1399/2787] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:17.131142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf55ed-5d4a-4da0-93cd-7e67c37a448e service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:17.196097 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf55ed-5d4a-4da0-93cd-7e67c37a448e service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:17.201136 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac8881-1866-4918-acb8-b5e91ca43b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:17.201995 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac8881-1866-4918-acb8-b5e91ca43b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:17.202266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac8881-1866-4918-acb8-b5e91ca43b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:17.202525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac8881-1866-4918-acb8-b5e91ca43b64 admin admin] PATH_INFO: `/v3/users/0f567edeb35948f4b5098e8a5595f24a` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:17.203736 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac8881-1866-4918-acb8-b5e91ca43b64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f567edeb35948f4b5098e8a5595f24a)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:17.205662 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac8881-1866-4918-acb8-b5e91ca43b64 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:17.257277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-27ac8881-1866-4918-acb8-b5e91ca43b64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f567edeb35948f4b5098e8a5595f24a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:17.260123 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:17.266054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-27ac8881-1866-4918-acb8-b5e91ca43b64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f567edeb35948f4b5098e8a5595f24a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:17.279534 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-27ac8881-1866-4918-acb8-b5e91ca43b64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f567edeb35948f4b5098e8a5595f24a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:17.280163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-27ac8881-1866-4918-acb8-b5e91ca43b64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f567edeb35948f4b5098e8a5595f24a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:17.286986 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-27ac8881-1866-4918-acb8-b5e91ca43b64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f567edeb35948f4b5098e8a5595f24a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:17.293230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1389/2788] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:38:17 2022] DELETE /identity/v3/users/0f567edeb35948f4b5098e8a5595f24a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:17.297933 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e73db-40e4-45de-9a1a-28630d2eb3d7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:17.298397 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e73db-40e4-45de-9a1a-28630d2eb3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:17.298512 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e73db-40e4-45de-9a1a-28630d2eb3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:17.315740 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a38e73db-40e4-45de-9a1a-28630d2eb3d7 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:17.317000 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a38e73db-40e4-45de-9a1a-28630d2eb3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:17.377240 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1400/2789] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:17.386975 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac8881-1866-4918-acb8-b5e91ca43b64 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:17.388545 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-27ac8881-1866-4918-acb8-b5e91ca43b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:17.454155 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac8881-1866-4918-acb8-b5e91ca43b64 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:17.460550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6fd99-7286-42d7-b133-dd53c387669b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:17.461204 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6fd99-7286-42d7-b133-dd53c387669b service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:17.461479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6fd99-7286-42d7-b133-dd53c387669b service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:17.461744 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6fd99-7286-42d7-b133-dd53c387669b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:17.471734 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6fd99-7286-42d7-b133-dd53c387669b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:17.473209 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6fd99-7286-42d7-b133-dd53c387669b service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:17.482993 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1390/2790] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:17.775722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e73db-40e4-45de-9a1a-28630d2eb3d7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:17.777821 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a38e73db-40e4-45de-9a1a-28630d2eb3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:17.792186 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e73db-40e4-45de-9a1a-28630d2eb3d7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:17.798306 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0a811-72af-46a9-a13c-ae4f78bde677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:17.799203 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a811-72af-46a9-a13c-ae4f78bde677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:17.804772 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a811-72af-46a9-a13c-ae4f78bde677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:17.805072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a811-72af-46a9-a13c-ae4f78bde677 admin admin] PATH_INFO: `/v3/projects/c3c3486005384cfc8c8e9126c6dc0b78` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:17.806606 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0a811-72af-46a9-a13c-ae4f78bde677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c3486005384cfc8c8e9126c6dc0b78)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:17.808575 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0a811-72af-46a9-a13c-ae4f78bde677 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:17.858215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-30c0a811-72af-46a9-a13c-ae4f78bde677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c3486005384cfc8c8e9126c6dc0b78', 'request_id': 'req-30c0a811-72af-46a9-a13c-ae4f78bde677'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:17.867385 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-30c0a811-72af-46a9-a13c-ae4f78bde677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c3486005384cfc8c8e9126c6dc0b78', 'request_id': 'req-30c0a811-72af-46a9-a13c-ae4f78bde677'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:17.873870 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-30c0a811-72af-46a9-a13c-ae4f78bde677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c3486005384cfc8c8e9126c6dc0b78', 'request_id': 'req-30c0a811-72af-46a9-a13c-ae4f78bde677'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:17.885577 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-30c0a811-72af-46a9-a13c-ae4f78bde677 admin admin] The token cache is being invalidate because project c3c3486005384cfc8c8e9126c6dc0b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:38:17.885869 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-30c0a811-72af-46a9-a13c-ae4f78bde677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:17.886511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-30c0a811-72af-46a9-a13c-ae4f78bde677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:17.888122 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1401/2791] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:38:17 2022] DELETE /identity/v3/projects/c3c3486005384cfc8c8e9126c6dc0b78 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:17.892393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6fd99-7286-42d7-b133-dd53c387669b service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:17.903483 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6fd99-7286-42d7-b133-dd53c387669b service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:17.963796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbd162-7234-47f4-a8ad-df7862bd9fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:17.964829 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbd162-7234-47f4-a8ad-df7862bd9fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:17.965115 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbd162-7234-47f4-a8ad-df7862bd9fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:17.965418 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbd162-7234-47f4-a8ad-df7862bd9fb8 admin admin] PATH_INFO: `/v3/users/7865e5b92f0149a7b1df29ad397d3261` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:17.966622 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbd162-7234-47f4-a8ad-df7862bd9fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7865e5b92f0149a7b1df29ad397d3261)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:17.968564 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbd162-7234-47f4-a8ad-df7862bd9fb8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:18.020756 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-24cbd162-7234-47f4-a8ad-df7862bd9fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7865e5b92f0149a7b1df29ad397d3261'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:18.032500 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-24cbd162-7234-47f4-a8ad-df7862bd9fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7865e5b92f0149a7b1df29ad397d3261'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:18.045629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-24cbd162-7234-47f4-a8ad-df7862bd9fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7865e5b92f0149a7b1df29ad397d3261'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:18.046355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-24cbd162-7234-47f4-a8ad-df7862bd9fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7865e5b92f0149a7b1df29ad397d3261'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:18.047626 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:18.056371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-24cbd162-7234-47f4-a8ad-df7862bd9fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7865e5b92f0149a7b1df29ad397d3261'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:18.063447 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1391/2792] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:38:17 2022] DELETE /identity/v3/users/7865e5b92f0149a7b1df29ad397d3261 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:18.344303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0a811-72af-46a9-a13c-ae4f78bde677 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:18.345929 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-30c0a811-72af-46a9-a13c-ae4f78bde677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:18.362563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0a811-72af-46a9-a13c-ae4f78bde677 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:18.431845 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ff9b9-0468-495a-bf53-9dfc6f10d511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:18.432763 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ff9b9-0468-495a-bf53-9dfc6f10d511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:18.433075 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ff9b9-0468-495a-bf53-9dfc6f10d511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:18.433375 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ff9b9-0468-495a-bf53-9dfc6f10d511 admin admin] PATH_INFO: `/v3/projects/f0a756d863154242b8ea13e049dd9f09` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:18.434863 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ff9b9-0468-495a-bf53-9dfc6f10d511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a756d863154242b8ea13e049dd9f09)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:18.436818 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ff9b9-0468-495a-bf53-9dfc6f10d511 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:18.448552 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:18.484716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0b8ff9b9-0468-495a-bf53-9dfc6f10d511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a756d863154242b8ea13e049dd9f09', 'request_id': 'req-0b8ff9b9-0468-495a-bf53-9dfc6f10d511'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:18.494220 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0b8ff9b9-0468-495a-bf53-9dfc6f10d511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a756d863154242b8ea13e049dd9f09', 'request_id': 'req-0b8ff9b9-0468-495a-bf53-9dfc6f10d511'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:18.500728 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0b8ff9b9-0468-495a-bf53-9dfc6f10d511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a756d863154242b8ea13e049dd9f09', 'request_id': 'req-0b8ff9b9-0468-495a-bf53-9dfc6f10d511'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:18.512742 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0b8ff9b9-0468-495a-bf53-9dfc6f10d511 admin admin] The token cache is being invalidate because project f0a756d863154242b8ea13e049dd9f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:38:18.513027 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0b8ff9b9-0468-495a-bf53-9dfc6f10d511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:18.513739 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0b8ff9b9-0468-495a-bf53-9dfc6f10d511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:18.515370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1402/2793] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:38:18 2022] DELETE /identity/v3/projects/f0a756d863154242b8ea13e049dd9f09 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:18.520418 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00236701-cf8f-45a0-a01f-6f914f35a83e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:18.520977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00236701-cf8f-45a0-a01f-6f914f35a83e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:18.520977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00236701-cf8f-45a0-a01f-6f914f35a83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:18.541221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-00236701-cf8f-45a0-a01f-6f914f35a83e None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:18.542435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-00236701-cf8f-45a0-a01f-6f914f35a83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:18.603416 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1392/2794] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:18.611290 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c96d8-5611-4d4a-b27f-3d58dc9ed7df None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:18.611590 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c96d8-5611-4d4a-b27f-3d58dc9ed7df None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:18.611856 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c96d8-5611-4d4a-b27f-3d58dc9ed7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:18.630882 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a05c96d8-5611-4d4a-b27f-3d58dc9ed7df None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:18.632102 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a05c96d8-5611-4d4a-b27f-3d58dc9ed7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:18.640870 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1403/2795] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:18.645123 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00236701-cf8f-45a0-a01f-6f914f35a83e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:18.655240 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00236701-cf8f-45a0-a01f-6f914f35a83e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:18.660503 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabeb01-bad2-4a1e-a29a-dea4c657abd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:18.661183 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabeb01-bad2-4a1e-a29a-dea4c657abd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:18.661466 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabeb01-bad2-4a1e-a29a-dea4c657abd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:18.661739 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabeb01-bad2-4a1e-a29a-dea4c657abd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:18.662478 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabeb01-bad2-4a1e-a29a-dea4c657abd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:38:18.662784 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabeb01-bad2-4a1e-a29a-dea4c657abd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:18.664405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabeb01-bad2-4a1e-a29a-dea4c657abd3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:18.676453 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1393/2796] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:38:18.680683 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c96d8-5611-4d4a-b27f-3d58dc9ed7df None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:18.690628 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c96d8-5611-4d4a-b27f-3d58dc9ed7df None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:18.695778 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b41f53-72d3-4b5e-9d3a-516eede9f8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:18.696478 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b41f53-72d3-4b5e-9d3a-516eede9f8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:18.696792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b41f53-72d3-4b5e-9d3a-516eede9f8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:18.697048 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b41f53-72d3-4b5e-9d3a-516eede9f8e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:18.697780 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b41f53-72d3-4b5e-9d3a-516eede9f8e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:18.699706 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b41f53-72d3-4b5e-9d3a-516eede9f8e6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:18.740699 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1404/2797] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:38:18 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:38:18.745359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabeb01-bad2-4a1e-a29a-dea4c657abd3 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:18.755410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabeb01-bad2-4a1e-a29a-dea4c657abd3 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:18.816050 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5824d-6db9-474d-9901-0aff0d44cbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:18.816754 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5824d-6db9-474d-9901-0aff0d44cbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:18.817043 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5824d-6db9-474d-9901-0aff0d44cbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:18.817320 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5824d-6db9-474d-9901-0aff0d44cbd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:18.818001 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5824d-6db9-474d-9901-0aff0d44cbd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:18.819936 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5824d-6db9-474d-9901-0aff0d44cbd3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:18.842693 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1394/2798] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:38:18 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:18.847266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b41f53-72d3-4b5e-9d3a-516eede9f8e6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:18.861989 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b41f53-72d3-4b5e-9d3a-516eede9f8e6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:18.869340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba9a47-c82d-485b-9d38-db024071bb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:18.869992 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba9a47-c82d-485b-9d38-db024071bb31 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:18.870269 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba9a47-c82d-485b-9d38-db024071bb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:18.870536 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba9a47-c82d-485b-9d38-db024071bb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:18.871266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba9a47-c82d-485b-9d38-db024071bb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:18.873002 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba9a47-c82d-485b-9d38-db024071bb31 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:18.883184 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1405/2799] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:18.889584 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5824d-6db9-474d-9901-0aff0d44cbd3 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:18.902840 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5824d-6db9-474d-9901-0aff0d44cbd3 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:18.908002 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942e5cc-a63a-4e23-95a7-403e17339f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:18.908688 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942e5cc-a63a-4e23-95a7-403e17339f76 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:18.908989 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942e5cc-a63a-4e23-95a7-403e17339f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:18.909263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942e5cc-a63a-4e23-95a7-403e17339f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:18.909989 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942e5cc-a63a-4e23-95a7-403e17339f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:18.911593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942e5cc-a63a-4e23-95a7-403e17339f76 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:18.921561 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1395/2800] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:18.925576 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba9a47-c82d-485b-9d38-db024071bb31 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:18.936199 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba9a47-c82d-485b-9d38-db024071bb31 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:18.941759 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0419e3-aae7-463c-946b-ff78da05418e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:18.942642 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0419e3-aae7-463c-946b-ff78da05418e admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:18.942920 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0419e3-aae7-463c-946b-ff78da05418e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:18.943195 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0419e3-aae7-463c-946b-ff78da05418e admin admin] PATH_INFO: `/v3/projects/171f5316fbf643659f926c29f1eea7f1/users/f60641e900c44d9ab685fd3796ba436e/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:18.959304 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0419e3-aae7-463c-946b-ff78da05418e admin admin] RBAC: Authorizing `identity:create_grant(project_id=171f5316fbf643659f926c29f1eea7f1, user_id=f60641e900c44d9ab685fd3796ba436e, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:18.962031 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0419e3-aae7-463c-946b-ff78da05418e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:18.978531 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1406/2801] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:18 2022] PUT /identity/v3/projects/171f5316fbf643659f926c29f1eea7f1/users/f60641e900c44d9ab685fd3796ba436e/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:38:18.994801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f8e0e-ac8d-4043-892d-9b903210bb86 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:18.995089 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f8e0e-ac8d-4043-892d-9b903210bb86 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:18.995363 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f8e0e-ac8d-4043-892d-9b903210bb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:19.025196 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ad1f8e0e-ac8d-4043-892d-9b903210bb86 None None] MFA Rules not processed for user `f60641e900c44d9ab685fd3796ba436e`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:19.026410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ad1f8e0e-ac8d-4043-892d-9b903210bb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:19.073086 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:19.095193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1396/2802] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:19.099751 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0419e3-aae7-463c-946b-ff78da05418e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:19.165179 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0419e3-aae7-463c-946b-ff78da05418e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:19.173315 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08953b5a-dc28-4e24-a081-01a2b1f0b230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:19.174272 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08953b5a-dc28-4e24-a081-01a2b1f0b230 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:19.174649 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08953b5a-dc28-4e24-a081-01a2b1f0b230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:19.174951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08953b5a-dc28-4e24-a081-01a2b1f0b230 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:19.176027 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08953b5a-dc28-4e24-a081-01a2b1f0b230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:19.179101 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08953b5a-dc28-4e24-a081-01a2b1f0b230 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:19.213962 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1407/2803] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:38:19 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:38:19.218050 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f8e0e-ac8d-4043-892d-9b903210bb86 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:19.228727 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f8e0e-ac8d-4043-892d-9b903210bb86 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:19.287409 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395fd5f-e320-425b-9095-8f3b11e83ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:19.288070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395fd5f-e320-425b-9095-8f3b11e83ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:19.288345 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395fd5f-e320-425b-9095-8f3b11e83ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:19.288640 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395fd5f-e320-425b-9095-8f3b11e83ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:19.289324 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395fd5f-e320-425b-9095-8f3b11e83ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:19.291268 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395fd5f-e320-425b-9095-8f3b11e83ea0 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:19.312224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1397/2804] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:38:19 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:19.316287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08953b5a-dc28-4e24-a081-01a2b1f0b230 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:19.327709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08953b5a-dc28-4e24-a081-01a2b1f0b230 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:19.333639 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de6248-8123-4e66-af65-971744638926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:19.334295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de6248-8123-4e66-af65-971744638926 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:19.334579 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de6248-8123-4e66-af65-971744638926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:19.334843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de6248-8123-4e66-af65-971744638926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:19.335544 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de6248-8123-4e66-af65-971744638926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:19.337396 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de6248-8123-4e66-af65-971744638926 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:19.347819 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1408/2805] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:19.351885 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395fd5f-e320-425b-9095-8f3b11e83ea0 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:19.362980 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395fd5f-e320-425b-9095-8f3b11e83ea0 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:19.368612 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62dd1b-ceec-4234-ba2d-2ef2b210e43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:19.369516 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62dd1b-ceec-4234-ba2d-2ef2b210e43a admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:19.369804 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62dd1b-ceec-4234-ba2d-2ef2b210e43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:19.370059 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62dd1b-ceec-4234-ba2d-2ef2b210e43a admin admin] PATH_INFO: `/v3/projects/4f4b19f58f9b4bd49e194b8f25e69058/users/cad06887c1b44dd1bb3a32db78abe11f/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:19.386481 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62dd1b-ceec-4234-ba2d-2ef2b210e43a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4b19f58f9b4bd49e194b8f25e69058, user_id=cad06887c1b44dd1bb3a32db78abe11f, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:19.389232 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62dd1b-ceec-4234-ba2d-2ef2b210e43a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:19.403790 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1398/2806] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:19 2022] PUT /identity/v3/projects/4f4b19f58f9b4bd49e194b8f25e69058/users/cad06887c1b44dd1bb3a32db78abe11f/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:19.408007 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de6248-8123-4e66-af65-971744638926 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:19.413831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:19.421061 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de6248-8123-4e66-af65-971744638926 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:19.483653 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e174ad-943a-4907-8655-4e1f8c08d61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:19.484254 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e174ad-943a-4907-8655-4e1f8c08d61e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:19.484533 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e174ad-943a-4907-8655-4e1f8c08d61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:19.484853 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e174ad-943a-4907-8655-4e1f8c08d61e admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:19.485584 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e174ad-943a-4907-8655-4e1f8c08d61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:19.487266 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e174ad-943a-4907-8655-4e1f8c08d61e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:19.498287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1409/2807] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:19.502623 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62dd1b-ceec-4234-ba2d-2ef2b210e43a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:19.513276 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62dd1b-ceec-4234-ba2d-2ef2b210e43a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:19.526096 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e33bc0-f380-4e3c-a87b-1db88566229f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:19.526982 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e33bc0-f380-4e3c-a87b-1db88566229f admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:19.527258 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e33bc0-f380-4e3c-a87b-1db88566229f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:19.527512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e33bc0-f380-4e3c-a87b-1db88566229f admin admin] PATH_INFO: `/v3/projects/4f4b19f58f9b4bd49e194b8f25e69058/users/cad06887c1b44dd1bb3a32db78abe11f/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:19.529674 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e33bc0-f380-4e3c-a87b-1db88566229f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4b19f58f9b4bd49e194b8f25e69058, user_id=cad06887c1b44dd1bb3a32db78abe11f, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:19.532293 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e33bc0-f380-4e3c-a87b-1db88566229f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:19.543873 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1399/2808] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:19 2022] PUT /identity/v3/projects/4f4b19f58f9b4bd49e194b8f25e69058/users/cad06887c1b44dd1bb3a32db78abe11f/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:19.607812 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02318431-9905-4ffc-a849-b5f02d31a07e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:19.608052 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02318431-9905-4ffc-a849-b5f02d31a07e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:19.608370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02318431-9905-4ffc-a849-b5f02d31a07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:19.637352 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-02318431-9905-4ffc-a849-b5f02d31a07e None None] MFA Rules not processed for user `cad06887c1b44dd1bb3a32db78abe11f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:19.638586 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-02318431-9905-4ffc-a849-b5f02d31a07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:19.711570 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1410/2809] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:19.723024 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e33bc0-f380-4e3c-a87b-1db88566229f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:19.724972 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-59e33bc0-f380-4e3c-a87b-1db88566229f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:19.782761 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e33bc0-f380-4e3c-a87b-1db88566229f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:19.787052 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab4cfc-067a-4da9-acf0-1ad9ec6e6f85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:19.787679 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab4cfc-067a-4da9-acf0-1ad9ec6e6f85 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:19.787953 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab4cfc-067a-4da9-acf0-1ad9ec6e6f85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:19.788219 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab4cfc-067a-4da9-acf0-1ad9ec6e6f85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:19.797746 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab4cfc-067a-4da9-acf0-1ad9ec6e6f85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:19.799163 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab4cfc-067a-4da9-acf0-1ad9ec6e6f85 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:19.809041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1400/2810] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:19.838232 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02318431-9905-4ffc-a849-b5f02d31a07e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:19.920801 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02318431-9905-4ffc-a849-b5f02d31a07e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:19.926532 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e51c9-dbbb-496d-aba9-f615c924cb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:19.927432 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e51c9-dbbb-496d-aba9-f615c924cb63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:19.927709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e51c9-dbbb-496d-aba9-f615c924cb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:19.927980 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e51c9-dbbb-496d-aba9-f615c924cb63 admin admin] PATH_INFO: `/v3/users/f60641e900c44d9ab685fd3796ba436e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:19.929271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e51c9-dbbb-496d-aba9-f615c924cb63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f60641e900c44d9ab685fd3796ba436e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:19.931223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e51c9-dbbb-496d-aba9-f615c924cb63 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:19.961974 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:19.985072 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-108e51c9-dbbb-496d-aba9-f615c924cb63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f60641e900c44d9ab685fd3796ba436e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:19.994129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-108e51c9-dbbb-496d-aba9-f615c924cb63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f60641e900c44d9ab685fd3796ba436e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:20.001375 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-108e51c9-dbbb-496d-aba9-f615c924cb63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f60641e900c44d9ab685fd3796ba436e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:20.002087 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-108e51c9-dbbb-496d-aba9-f615c924cb63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f60641e900c44d9ab685fd3796ba436e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:20.015967 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-108e51c9-dbbb-496d-aba9-f615c924cb63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f60641e900c44d9ab685fd3796ba436e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:20.022046 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1411/2811] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:38:19 2022] DELETE /identity/v3/users/f60641e900c44d9ab685fd3796ba436e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:20.027236 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575dc41-c0e9-4b45-aff8-9caee192bb85 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:20.027526 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575dc41-c0e9-4b45-aff8-9caee192bb85 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:20.027809 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575dc41-c0e9-4b45-aff8-9caee192bb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:20.047257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f575dc41-c0e9-4b45-aff8-9caee192bb85 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:20.048380 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f575dc41-c0e9-4b45-aff8-9caee192bb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:20.081317 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:20.108837 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1401/2812] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:20.118895 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e51c9-dbbb-496d-aba9-f615c924cb63 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:20.120729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-108e51c9-dbbb-496d-aba9-f615c924cb63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:20.183209 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e51c9-dbbb-496d-aba9-f615c924cb63 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:20.187662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32ebc7-8e6c-4a43-8cfc-524348e705bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:20.188318 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32ebc7-8e6c-4a43-8cfc-524348e705bb service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:20.188627 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32ebc7-8e6c-4a43-8cfc-524348e705bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:20.188900 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32ebc7-8e6c-4a43-8cfc-524348e705bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:20.200132 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32ebc7-8e6c-4a43-8cfc-524348e705bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:20.201609 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32ebc7-8e6c-4a43-8cfc-524348e705bb service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:20.212268 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1412/2813] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:20.498846 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575dc41-c0e9-4b45-aff8-9caee192bb85 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:20.500438 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f575dc41-c0e9-4b45-aff8-9caee192bb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:20.517650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575dc41-c0e9-4b45-aff8-9caee192bb85 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:20.523214 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda82e7-769f-4059-9323-00efb6a83a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:20.524512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda82e7-769f-4059-9323-00efb6a83a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:20.525240 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda82e7-769f-4059-9323-00efb6a83a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:20.525240 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda82e7-769f-4059-9323-00efb6a83a72 admin admin] PATH_INFO: `/v3/projects/171f5316fbf643659f926c29f1eea7f1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:20.527064 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda82e7-769f-4059-9323-00efb6a83a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=171f5316fbf643659f926c29f1eea7f1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:20.529393 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda82e7-769f-4059-9323-00efb6a83a72 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:20.589382 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cfda82e7-769f-4059-9323-00efb6a83a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '171f5316fbf643659f926c29f1eea7f1', 'request_id': 'req-cfda82e7-769f-4059-9323-00efb6a83a72'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:20.597222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cfda82e7-769f-4059-9323-00efb6a83a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '171f5316fbf643659f926c29f1eea7f1', 'request_id': 'req-cfda82e7-769f-4059-9323-00efb6a83a72'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:20.602691 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cfda82e7-769f-4059-9323-00efb6a83a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '171f5316fbf643659f926c29f1eea7f1', 'request_id': 'req-cfda82e7-769f-4059-9323-00efb6a83a72'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:20.613690 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cfda82e7-769f-4059-9323-00efb6a83a72 admin admin] The token cache is being invalidate because project 171f5316fbf643659f926c29f1eea7f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:38:20.613985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cfda82e7-769f-4059-9323-00efb6a83a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:20.614643 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cfda82e7-769f-4059-9323-00efb6a83a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:20.616218 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1402/2814] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:38:20 2022] DELETE /identity/v3/projects/171f5316fbf643659f926c29f1eea7f1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:20.620500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32ebc7-8e6c-4a43-8cfc-524348e705bb service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:20.630365 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32ebc7-8e6c-4a43-8cfc-524348e705bb service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:20.687967 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e901e4-654e-4d2e-bb7a-347c7036c743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:20.688893 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e901e4-654e-4d2e-bb7a-347c7036c743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:20.689180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e901e4-654e-4d2e-bb7a-347c7036c743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:20.689456 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e901e4-654e-4d2e-bb7a-347c7036c743 admin admin] PATH_INFO: `/v3/users/cad06887c1b44dd1bb3a32db78abe11f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:20.690712 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e901e4-654e-4d2e-bb7a-347c7036c743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cad06887c1b44dd1bb3a32db78abe11f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:20.692727 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e901e4-654e-4d2e-bb7a-347c7036c743 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:20.739802 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-49e901e4-654e-4d2e-bb7a-347c7036c743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cad06887c1b44dd1bb3a32db78abe11f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:20.741537 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:20.748362 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-49e901e4-654e-4d2e-bb7a-347c7036c743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cad06887c1b44dd1bb3a32db78abe11f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:20.756779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-49e901e4-654e-4d2e-bb7a-347c7036c743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cad06887c1b44dd1bb3a32db78abe11f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:20.757405 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-49e901e4-654e-4d2e-bb7a-347c7036c743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cad06887c1b44dd1bb3a32db78abe11f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:20.769165 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-49e901e4-654e-4d2e-bb7a-347c7036c743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cad06887c1b44dd1bb3a32db78abe11f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:20.775430 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1413/2815] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:38:20 2022] DELETE /identity/v3/users/cad06887c1b44dd1bb3a32db78abe11f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:21.066694 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda82e7-769f-4059-9323-00efb6a83a72 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:21.068195 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cfda82e7-769f-4059-9323-00efb6a83a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:21.084969 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda82e7-769f-4059-9323-00efb6a83a72 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:21.147197 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708fa04-a47b-4b70-ac72-87b110d68ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:21.148116 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708fa04-a47b-4b70-ac72-87b110d68ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:21.148400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708fa04-a47b-4b70-ac72-87b110d68ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:21.148773 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708fa04-a47b-4b70-ac72-87b110d68ee5 admin admin] PATH_INFO: `/v3/projects/4f4b19f58f9b4bd49e194b8f25e69058` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:21.150167 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708fa04-a47b-4b70-ac72-87b110d68ee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f4b19f58f9b4bd49e194b8f25e69058)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:21.152078 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708fa04-a47b-4b70-ac72-87b110d68ee5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:21.200465 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5708fa04-a47b-4b70-ac72-87b110d68ee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f4b19f58f9b4bd49e194b8f25e69058', 'request_id': 'req-5708fa04-a47b-4b70-ac72-87b110d68ee5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:21.209808 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5708fa04-a47b-4b70-ac72-87b110d68ee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f4b19f58f9b4bd49e194b8f25e69058', 'request_id': 'req-5708fa04-a47b-4b70-ac72-87b110d68ee5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:21.216212 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5708fa04-a47b-4b70-ac72-87b110d68ee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f4b19f58f9b4bd49e194b8f25e69058', 'request_id': 'req-5708fa04-a47b-4b70-ac72-87b110d68ee5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:21.217349 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:21.230400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5708fa04-a47b-4b70-ac72-87b110d68ee5 admin admin] The token cache is being invalidate because project 4f4b19f58f9b4bd49e194b8f25e69058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:38:21.230713 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5708fa04-a47b-4b70-ac72-87b110d68ee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:21.231375 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5708fa04-a47b-4b70-ac72-87b110d68ee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:21.232959 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1403/2816] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:38:21 2022] DELETE /identity/v3/projects/4f4b19f58f9b4bd49e194b8f25e69058 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:21.238062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7733ec-cf5f-4367-9e08-22bb09730e94 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:21.238441 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7733ec-cf5f-4367-9e08-22bb09730e94 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:21.238731 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7733ec-cf5f-4367-9e08-22bb09730e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:21.258536 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-fe7733ec-cf5f-4367-9e08-22bb09730e94 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:21.259890 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fe7733ec-cf5f-4367-9e08-22bb09730e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:21.326348 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1414/2817] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:38:21.336243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd04f3-e63c-4352-8c84-1481799e8090 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:21.337118 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd04f3-e63c-4352-8c84-1481799e8090 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:21.337243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd04f3-e63c-4352-8c84-1481799e8090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:21.356634 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-38bd04f3-e63c-4352-8c84-1481799e8090 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:21.357753 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-38bd04f3-e63c-4352-8c84-1481799e8090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:21.366117 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1404/2818] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:21.370803 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7733ec-cf5f-4367-9e08-22bb09730e94 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:21.380862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7733ec-cf5f-4367-9e08-22bb09730e94 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:21.386349 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27761a-d03c-4b0e-b879-a9dd0ac2ddb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:21.387006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27761a-d03c-4b0e-b879-a9dd0ac2ddb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:21.387282 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27761a-d03c-4b0e-b879-a9dd0ac2ddb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:21.387551 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27761a-d03c-4b0e-b879-a9dd0ac2ddb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:21.388287 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27761a-d03c-4b0e-b879-a9dd0ac2ddb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:38:21.388624 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27761a-d03c-4b0e-b879-a9dd0ac2ddb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:21.390311 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27761a-d03c-4b0e-b879-a9dd0ac2ddb6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:21.402670 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1415/2819] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:38:21.407079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd04f3-e63c-4352-8c84-1481799e8090 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:21.416808 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd04f3-e63c-4352-8c84-1481799e8090 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:21.422745 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68438695-cdf7-4a2d-85bb-54f70c247112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:21.423398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68438695-cdf7-4a2d-85bb-54f70c247112 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:21.423670 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68438695-cdf7-4a2d-85bb-54f70c247112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:21.423933 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68438695-cdf7-4a2d-85bb-54f70c247112 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:21.424657 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68438695-cdf7-4a2d-85bb-54f70c247112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:21.426568 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68438695-cdf7-4a2d-85bb-54f70c247112 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:21.455879 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1405/2820] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:38:21 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:21.461766 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27761a-d03c-4b0e-b879-a9dd0ac2ddb6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:21.472783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27761a-d03c-4b0e-b879-a9dd0ac2ddb6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:21.534105 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3e186-7f8a-4c89-a42e-e9dbf2c9b399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:21.534891 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3e186-7f8a-4c89-a42e-e9dbf2c9b399 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:21.535165 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3e186-7f8a-4c89-a42e-e9dbf2c9b399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:21.535438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3e186-7f8a-4c89-a42e-e9dbf2c9b399 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:21.536093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3e186-7f8a-4c89-a42e-e9dbf2c9b399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:21.538297 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3e186-7f8a-4c89-a42e-e9dbf2c9b399 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:21.560571 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1416/2821] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:38:21 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:21.565299 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68438695-cdf7-4a2d-85bb-54f70c247112 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:21.577934 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68438695-cdf7-4a2d-85bb-54f70c247112 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:21.582865 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80165eed-b428-48e6-b246-902db2aa7e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:21.583532 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80165eed-b428-48e6-b246-902db2aa7e66 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:21.583814 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80165eed-b428-48e6-b246-902db2aa7e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:21.584090 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80165eed-b428-48e6-b246-902db2aa7e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:21.584858 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80165eed-b428-48e6-b246-902db2aa7e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:21.586486 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80165eed-b428-48e6-b246-902db2aa7e66 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:21.598114 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1406/2822] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:21.602428 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3e186-7f8a-4c89-a42e-e9dbf2c9b399 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:21.613743 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3e186-7f8a-4c89-a42e-e9dbf2c9b399 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:21.618994 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6ff65-9163-43fe-8d43-a92647398abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:21.619680 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6ff65-9163-43fe-8d43-a92647398abf admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:21.619987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6ff65-9163-43fe-8d43-a92647398abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:21.620262 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6ff65-9163-43fe-8d43-a92647398abf admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:21.621034 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6ff65-9163-43fe-8d43-a92647398abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:21.622642 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6ff65-9163-43fe-8d43-a92647398abf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:21.633260 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1417/2823] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:21.638294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80165eed-b428-48e6-b246-902db2aa7e66 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:21.651738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80165eed-b428-48e6-b246-902db2aa7e66 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:21.657121 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f048565-4c1e-4207-b385-1982d29e8c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:21.658006 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f048565-4c1e-4207-b385-1982d29e8c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:21.658278 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f048565-4c1e-4207-b385-1982d29e8c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:21.658545 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f048565-4c1e-4207-b385-1982d29e8c9d admin admin] PATH_INFO: `/v3/projects/9c5364949bb24ba4b637ec9762b7dd5b/users/471d10e060e844e3a74e27f594d66145/roles/713f175e9435403f9e39528c805bd956` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:21.674150 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f048565-4c1e-4207-b385-1982d29e8c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c5364949bb24ba4b637ec9762b7dd5b, user_id=471d10e060e844e3a74e27f594d66145, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:21.676811 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f048565-4c1e-4207-b385-1982d29e8c9d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:21.691971 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1407/2824] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:21 2022] PUT /identity/v3/projects/9c5364949bb24ba4b637ec9762b7dd5b/users/471d10e060e844e3a74e27f594d66145/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:21.703911 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf59530-a9d1-4574-a2de-410490cd6245 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:21.704451 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf59530-a9d1-4574-a2de-410490cd6245 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:21.704831 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf59530-a9d1-4574-a2de-410490cd6245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:21.732917 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7cf59530-a9d1-4574-a2de-410490cd6245 None None] MFA Rules not processed for user `471d10e060e844e3a74e27f594d66145`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:21.734154 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7cf59530-a9d1-4574-a2de-410490cd6245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:21.753481 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:21.803904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1418/2825] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:21.808758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f048565-4c1e-4207-b385-1982d29e8c9d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:21.879180 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f048565-4c1e-4207-b385-1982d29e8c9d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:21.884700 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16867716-5be5-4d21-a17a-382886bbdf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:21.885348 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16867716-5be5-4d21-a17a-382886bbdf8d admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:21.885623 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16867716-5be5-4d21-a17a-382886bbdf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:21.885877 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16867716-5be5-4d21-a17a-382886bbdf8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:21.886545 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16867716-5be5-4d21-a17a-382886bbdf8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:21.888435 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16867716-5be5-4d21-a17a-382886bbdf8d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:21.916101 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1408/2826] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:38:21 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:21.922044 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf59530-a9d1-4574-a2de-410490cd6245 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:21.933850 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf59530-a9d1-4574-a2de-410490cd6245 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:21.992902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f5d0d-cb8d-44d4-8ae5-d22a2ef07221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:21.993650 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f5d0d-cb8d-44d4-8ae5-d22a2ef07221 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:21.993931 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f5d0d-cb8d-44d4-8ae5-d22a2ef07221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:21.994210 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f5d0d-cb8d-44d4-8ae5-d22a2ef07221 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:21.994906 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f5d0d-cb8d-44d4-8ae5-d22a2ef07221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:21.996864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f5d0d-cb8d-44d4-8ae5-d22a2ef07221 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:22.018273 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1419/2827] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:38:21 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:22.022515 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16867716-5be5-4d21-a17a-382886bbdf8d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:22.033448 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16867716-5be5-4d21-a17a-382886bbdf8d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:22.039193 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e1847-5311-4489-ace7-13f9d7a43438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:22.039848 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e1847-5311-4489-ace7-13f9d7a43438 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:22.040200 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e1847-5311-4489-ace7-13f9d7a43438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:22.040714 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e1847-5311-4489-ace7-13f9d7a43438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:22.041768 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e1847-5311-4489-ace7-13f9d7a43438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:22.043576 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e1847-5311-4489-ace7-13f9d7a43438 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:22.054860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1409/2828] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:22.059553 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f5d0d-cb8d-44d4-8ae5-d22a2ef07221 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:22.069834 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f5d0d-cb8d-44d4-8ae5-d22a2ef07221 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:22.074726 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17fa6e-70bc-4595-91ad-9a14f42b3f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:22.075607 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17fa6e-70bc-4595-91ad-9a14f42b3f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:22.075889 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17fa6e-70bc-4595-91ad-9a14f42b3f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:22.076159 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17fa6e-70bc-4595-91ad-9a14f42b3f6b admin admin] PATH_INFO: `/v3/projects/b5451145e70f4a0b9b2cbca5c21a7216/users/ca5afc97907049d5939fc737d020f58b/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:22.091814 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17fa6e-70bc-4595-91ad-9a14f42b3f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5451145e70f4a0b9b2cbca5c21a7216, user_id=ca5afc97907049d5939fc737d020f58b, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:22.094548 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17fa6e-70bc-4595-91ad-9a14f42b3f6b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:22.109665 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1420/2829] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:22 2022] PUT /identity/v3/projects/b5451145e70f4a0b9b2cbca5c21a7216/users/ca5afc97907049d5939fc737d020f58b/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:38:22.114270 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e1847-5311-4489-ace7-13f9d7a43438 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:22.129815 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e1847-5311-4489-ace7-13f9d7a43438 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:22.190324 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03876fb4-075f-4401-8d15-688da7a228d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:22.191036 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03876fb4-075f-4401-8d15-688da7a228d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:22.191314 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03876fb4-075f-4401-8d15-688da7a228d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:22.191587 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03876fb4-075f-4401-8d15-688da7a228d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:22.192318 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03876fb4-075f-4401-8d15-688da7a228d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:22.193973 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03876fb4-075f-4401-8d15-688da7a228d4 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:22.200988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:22.206471 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1410/2830] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:22.211627 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17fa6e-70bc-4595-91ad-9a14f42b3f6b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:22.222988 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17fa6e-70bc-4595-91ad-9a14f42b3f6b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:22.228357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536a3d4-ddf6-40e5-bac9-2b47ef3f4253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:22.229295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536a3d4-ddf6-40e5-bac9-2b47ef3f4253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:22.229578 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536a3d4-ddf6-40e5-bac9-2b47ef3f4253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:22.229850 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536a3d4-ddf6-40e5-bac9-2b47ef3f4253 admin admin] PATH_INFO: `/v3/projects/b5451145e70f4a0b9b2cbca5c21a7216/users/ca5afc97907049d5939fc737d020f58b/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:22.231921 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6536a3d4-ddf6-40e5-bac9-2b47ef3f4253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5451145e70f4a0b9b2cbca5c21a7216, user_id=ca5afc97907049d5939fc737d020f58b, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:22.234614 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6536a3d4-ddf6-40e5-bac9-2b47ef3f4253 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:22.245729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1421/2831] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:22 2022] PUT /identity/v3/projects/b5451145e70f4a0b9b2cbca5c21a7216/users/ca5afc97907049d5939fc737d020f58b/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:22.257570 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e83c-3cb5-4154-9bcb-77d8dd9fbdbe None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:22.257863 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e83c-3cb5-4154-9bcb-77d8dd9fbdbe None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:22.258142 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e83c-3cb5-4154-9bcb-77d8dd9fbdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:22.292374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6b17e83c-3cb5-4154-9bcb-77d8dd9fbdbe None None] MFA Rules not processed for user `ca5afc97907049d5939fc737d020f58b`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:22.293612 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6b17e83c-3cb5-4154-9bcb-77d8dd9fbdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:22.371899 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1411/2832] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:22.384092 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536a3d4-ddf6-40e5-bac9-2b47ef3f4253 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:22.385904 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6536a3d4-ddf6-40e5-bac9-2b47ef3f4253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:22.444563 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536a3d4-ddf6-40e5-bac9-2b47ef3f4253 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:22.448575 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2ce80-5bff-460a-acaf-7dc1f3e70654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:22.449291 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2ce80-5bff-460a-acaf-7dc1f3e70654 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:22.449509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2ce80-5bff-460a-acaf-7dc1f3e70654 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:22.449783 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2ce80-5bff-460a-acaf-7dc1f3e70654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:22.459445 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2ce80-5bff-460a-acaf-7dc1f3e70654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:22.460910 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2ce80-5bff-460a-acaf-7dc1f3e70654 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:22.470675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1422/2833] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:22.851023 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17e83c-3cb5-4154-9bcb-77d8dd9fbdbe None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:22.914021 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17e83c-3cb5-4154-9bcb-77d8dd9fbdbe None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:22.919434 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50df94-87d8-4c8c-b461-6f826c68a861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:22.920302 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50df94-87d8-4c8c-b461-6f826c68a861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:22.920607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50df94-87d8-4c8c-b461-6f826c68a861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:22.920872 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50df94-87d8-4c8c-b461-6f826c68a861 admin admin] PATH_INFO: `/v3/users/471d10e060e844e3a74e27f594d66145` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:22.922168 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50df94-87d8-4c8c-b461-6f826c68a861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=471d10e060e844e3a74e27f594d66145)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:22.924082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50df94-87d8-4c8c-b461-6f826c68a861 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:22.982767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4f50df94-87d8-4c8c-b461-6f826c68a861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471d10e060e844e3a74e27f594d66145'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:22.992388 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4f50df94-87d8-4c8c-b461-6f826c68a861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471d10e060e844e3a74e27f594d66145'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:23.005105 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4f50df94-87d8-4c8c-b461-6f826c68a861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471d10e060e844e3a74e27f594d66145'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:23.005756 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4f50df94-87d8-4c8c-b461-6f826c68a861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471d10e060e844e3a74e27f594d66145'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:23.012886 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4f50df94-87d8-4c8c-b461-6f826c68a861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471d10e060e844e3a74e27f594d66145'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:23.018883 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1412/2834] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:38:22 2022] DELETE /identity/v3/users/471d10e060e844e3a74e27f594d66145 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:23.023650 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beabc43-c941-4557-8aa9-0d417525de1d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:23.024160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beabc43-c941-4557-8aa9-0d417525de1d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:23.024160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beabc43-c941-4557-8aa9-0d417525de1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:23.043536 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5beabc43-c941-4557-8aa9-0d417525de1d None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:23.044766 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5beabc43-c941-4557-8aa9-0d417525de1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:23.055182 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:23.105468 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1423/2835] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:38:23.117650 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50df94-87d8-4c8c-b461-6f826c68a861 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:23.119280 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4f50df94-87d8-4c8c-b461-6f826c68a861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:23.126635 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:23.186187 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50df94-87d8-4c8c-b461-6f826c68a861 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:23.190316 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da931447-8be9-462b-99e6-7ee3e27c9b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:23.190963 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da931447-8be9-462b-99e6-7ee3e27c9b2d service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:23.191246 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da931447-8be9-462b-99e6-7ee3e27c9b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:23.191519 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da931447-8be9-462b-99e6-7ee3e27c9b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:23.202219 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da931447-8be9-462b-99e6-7ee3e27c9b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:23.203687 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da931447-8be9-462b-99e6-7ee3e27c9b2d service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:23.215386 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1413/2836] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:23.504202 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beabc43-c941-4557-8aa9-0d417525de1d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:23.505843 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5beabc43-c941-4557-8aa9-0d417525de1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:23.518663 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beabc43-c941-4557-8aa9-0d417525de1d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:23.523763 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b1470-4949-425b-b5ab-186a64c6f9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:23.524674 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b1470-4949-425b-b5ab-186a64c6f9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:23.524950 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b1470-4949-425b-b5ab-186a64c6f9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:23.525675 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b1470-4949-425b-b5ab-186a64c6f9a0 admin admin] PATH_INFO: `/v3/projects/9c5364949bb24ba4b637ec9762b7dd5b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:23.526511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b1470-4949-425b-b5ab-186a64c6f9a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c5364949bb24ba4b637ec9762b7dd5b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:23.528422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b1470-4949-425b-b5ab-186a64c6f9a0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:23.581421 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c48b1470-4949-425b-b5ab-186a64c6f9a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c5364949bb24ba4b637ec9762b7dd5b', 'request_id': 'req-c48b1470-4949-425b-b5ab-186a64c6f9a0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:23.590794 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c48b1470-4949-425b-b5ab-186a64c6f9a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c5364949bb24ba4b637ec9762b7dd5b', 'request_id': 'req-c48b1470-4949-425b-b5ab-186a64c6f9a0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:23.596871 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c48b1470-4949-425b-b5ab-186a64c6f9a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c5364949bb24ba4b637ec9762b7dd5b', 'request_id': 'req-c48b1470-4949-425b-b5ab-186a64c6f9a0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:23.608437 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c48b1470-4949-425b-b5ab-186a64c6f9a0 admin admin] The token cache is being invalidate because project 9c5364949bb24ba4b637ec9762b7dd5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:38:23.608760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c48b1470-4949-425b-b5ab-186a64c6f9a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:23.609511 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c48b1470-4949-425b-b5ab-186a64c6f9a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:23.611103 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1424/2837] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:38:23 2022] DELETE /identity/v3/projects/9c5364949bb24ba4b637ec9762b7dd5b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:23.615221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da931447-8be9-462b-99e6-7ee3e27c9b2d service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:23.626051 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da931447-8be9-462b-99e6-7ee3e27c9b2d service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:23.683796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fa963-ccee-499b-83b2-3855d0e2a014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:23.684709 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fa963-ccee-499b-83b2-3855d0e2a014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:23.684985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fa963-ccee-499b-83b2-3855d0e2a014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:23.685250 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fa963-ccee-499b-83b2-3855d0e2a014 admin admin] PATH_INFO: `/v3/users/ca5afc97907049d5939fc737d020f58b` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:23.686458 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fa963-ccee-499b-83b2-3855d0e2a014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5afc97907049d5939fc737d020f58b)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:23.688385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fa963-ccee-499b-83b2-3855d0e2a014 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:23.738988 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b74fa963-ccee-499b-83b2-3855d0e2a014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5afc97907049d5939fc737d020f58b'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:23.746210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b74fa963-ccee-499b-83b2-3855d0e2a014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5afc97907049d5939fc737d020f58b'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:23.757749 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b74fa963-ccee-499b-83b2-3855d0e2a014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5afc97907049d5939fc737d020f58b'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:23.758362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b74fa963-ccee-499b-83b2-3855d0e2a014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5afc97907049d5939fc737d020f58b'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:23.765294 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b74fa963-ccee-499b-83b2-3855d0e2a014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5afc97907049d5939fc737d020f58b'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:23.771016 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1414/2838] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:38:23 2022] DELETE /identity/v3/users/ca5afc97907049d5939fc737d020f58b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:24.065784 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b1470-4949-425b-b5ab-186a64c6f9a0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:24.067218 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c48b1470-4949-425b-b5ab-186a64c6f9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:24.083842 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b1470-4949-425b-b5ab-186a64c6f9a0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:24.142195 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945692d-40f8-4780-82e1-018c2891ed17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:24.143062 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945692d-40f8-4780-82e1-018c2891ed17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:24.143341 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945692d-40f8-4780-82e1-018c2891ed17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:24.143588 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945692d-40f8-4780-82e1-018c2891ed17 admin admin] PATH_INFO: `/v3/projects/b5451145e70f4a0b9b2cbca5c21a7216` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:24.144868 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945692d-40f8-4780-82e1-018c2891ed17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5451145e70f4a0b9b2cbca5c21a7216)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:24.146826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945692d-40f8-4780-82e1-018c2891ed17 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:24.190109 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:24.196949 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1945692d-40f8-4780-82e1-018c2891ed17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5451145e70f4a0b9b2cbca5c21a7216', 'request_id': 'req-1945692d-40f8-4780-82e1-018c2891ed17'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:24.206661 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1945692d-40f8-4780-82e1-018c2891ed17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5451145e70f4a0b9b2cbca5c21a7216', 'request_id': 'req-1945692d-40f8-4780-82e1-018c2891ed17'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:24.214001 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1945692d-40f8-4780-82e1-018c2891ed17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5451145e70f4a0b9b2cbca5c21a7216', 'request_id': 'req-1945692d-40f8-4780-82e1-018c2891ed17'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:24.225225 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1945692d-40f8-4780-82e1-018c2891ed17 admin admin] The token cache is being invalidate because project b5451145e70f4a0b9b2cbca5c21a7216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:38:24.225509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1945692d-40f8-4780-82e1-018c2891ed17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:24.226137 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1945692d-40f8-4780-82e1-018c2891ed17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:24.227884 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1425/2839] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:38:24 2022] DELETE /identity/v3/projects/b5451145e70f4a0b9b2cbca5c21a7216 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:24.232930 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c836c5-e752-4055-ac08-9667d6e42c24 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:24.233428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c836c5-e752-4055-ac08-9667d6e42c24 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:24.233428 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c836c5-e752-4055-ac08-9667d6e42c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:24.253535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a9c836c5-e752-4055-ac08-9667d6e42c24 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:24.254762 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a9c836c5-e752-4055-ac08-9667d6e42c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:24.275279 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:24.316431 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1415/2840] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:24.324337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ff580-8acb-4b12-897a-605a68b6111c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:24.324662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ff580-8acb-4b12-897a-605a68b6111c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:24.324939 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ff580-8acb-4b12-897a-605a68b6111c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:24.343439 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8e3ff580-8acb-4b12-897a-605a68b6111c None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:24.344718 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8e3ff580-8acb-4b12-897a-605a68b6111c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:24.353423 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1426/2841] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:24.358076 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c836c5-e752-4055-ac08-9667d6e42c24 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:24.373281 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c836c5-e752-4055-ac08-9667d6e42c24 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:24.381998 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12af98-6c12-48d7-a13e-d838ed375219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:24.382930 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12af98-6c12-48d7-a13e-d838ed375219 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:24.383224 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12af98-6c12-48d7-a13e-d838ed375219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:24.383495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12af98-6c12-48d7-a13e-d838ed375219 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:24.384648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12af98-6c12-48d7-a13e-d838ed375219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:38:24.384958 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12af98-6c12-48d7-a13e-d838ed375219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:24.386553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12af98-6c12-48d7-a13e-d838ed375219 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:24.398404 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1416/2842] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:38:24.402983 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ff580-8acb-4b12-897a-605a68b6111c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:24.412775 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ff580-8acb-4b12-897a-605a68b6111c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:24.418948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef05448-28c5-4f8d-aab6-7f2d21cd987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:24.419610 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef05448-28c5-4f8d-aab6-7f2d21cd987b admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:24.419886 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef05448-28c5-4f8d-aab6-7f2d21cd987b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:24.420156 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef05448-28c5-4f8d-aab6-7f2d21cd987b admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:24.420898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef05448-28c5-4f8d-aab6-7f2d21cd987b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:24.422816 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef05448-28c5-4f8d-aab6-7f2d21cd987b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:24.451953 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1427/2843] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:38:24 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:24.458379 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12af98-6c12-48d7-a13e-d838ed375219 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:24.468488 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12af98-6c12-48d7-a13e-d838ed375219 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:24.531648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b37c0b-49ce-4a9d-abb9-b5fa82d211dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:24.532222 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b37c0b-49ce-4a9d-abb9-b5fa82d211dd admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:24.532495 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b37c0b-49ce-4a9d-abb9-b5fa82d211dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:24.532797 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b37c0b-49ce-4a9d-abb9-b5fa82d211dd admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:24.533455 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b37c0b-49ce-4a9d-abb9-b5fa82d211dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:24.535371 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b37c0b-49ce-4a9d-abb9-b5fa82d211dd admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:24.557230 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1417/2844] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:38:24 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:38:24.563622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef05448-28c5-4f8d-aab6-7f2d21cd987b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:24.577000 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef05448-28c5-4f8d-aab6-7f2d21cd987b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:24.583401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421c8b8-1907-40c2-8784-da4cf24a9c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:24.584089 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421c8b8-1907-40c2-8784-da4cf24a9c5a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:24.584368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421c8b8-1907-40c2-8784-da4cf24a9c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:24.584672 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421c8b8-1907-40c2-8784-da4cf24a9c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:24.585404 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421c8b8-1907-40c2-8784-da4cf24a9c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:24.587006 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421c8b8-1907-40c2-8784-da4cf24a9c5a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:24.597996 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1428/2845] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:24.602313 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b37c0b-49ce-4a9d-abb9-b5fa82d211dd admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:24.619232 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b37c0b-49ce-4a9d-abb9-b5fa82d211dd admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:24.625183 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea688279-4f21-40d5-a70a-7b7704c6f364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:24.625874 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea688279-4f21-40d5-a70a-7b7704c6f364 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:24.626132 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea688279-4f21-40d5-a70a-7b7704c6f364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:24.626403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea688279-4f21-40d5-a70a-7b7704c6f364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:24.627127 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea688279-4f21-40d5-a70a-7b7704c6f364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:24.628771 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea688279-4f21-40d5-a70a-7b7704c6f364 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:24.639711 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1418/2846] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:24.644215 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421c8b8-1907-40c2-8784-da4cf24a9c5a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:24.655720 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421c8b8-1907-40c2-8784-da4cf24a9c5a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:24.661242 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6edf1-c579-4c82-bcf1-70efdeda8f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:24.662129 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6edf1-c579-4c82-bcf1-70efdeda8f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:24.662406 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6edf1-c579-4c82-bcf1-70efdeda8f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:24.662676 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6edf1-c579-4c82-bcf1-70efdeda8f70 admin admin] PATH_INFO: `/v3/projects/59c133bd6b484f699b02fbce30e79e41/users/b54edd2d7b4d44099965b38721f0a6a7/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:24.680159 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6edf1-c579-4c82-bcf1-70efdeda8f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c133bd6b484f699b02fbce30e79e41, user_id=b54edd2d7b4d44099965b38721f0a6a7, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:24.682960 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6edf1-c579-4c82-bcf1-70efdeda8f70 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:24.698337 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1429/2847] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:24 2022] PUT /identity/v3/projects/59c133bd6b484f699b02fbce30e79e41/users/b54edd2d7b4d44099965b38721f0a6a7/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:24.709227 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68d079-dc8b-4501-821c-a0c727c9cbaa None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:24.709509 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68d079-dc8b-4501-821c-a0c727c9cbaa None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:24.709775 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68d079-dc8b-4501-821c-a0c727c9cbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:24.738868 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-0d68d079-dc8b-4501-821c-a0c727c9cbaa None None] MFA Rules not processed for user `b54edd2d7b4d44099965b38721f0a6a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:24.740062 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0d68d079-dc8b-4501-821c-a0c727c9cbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:24.806491 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1419/2848] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:24.811001 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6edf1-c579-4c82-bcf1-70efdeda8f70 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:24.874271 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6edf1-c579-4c82-bcf1-70efdeda8f70 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:24.879121 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0ee2c-330b-44a6-a395-9512ca50a0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:24.879763 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0ee2c-330b-44a6-a395-9512ca50a0cd admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:24.880038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0ee2c-330b-44a6-a395-9512ca50a0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:24.880307 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0ee2c-330b-44a6-a395-9512ca50a0cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:24.881034 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0ee2c-330b-44a6-a395-9512ca50a0cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:24.882936 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0ee2c-330b-44a6-a395-9512ca50a0cd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:24.909838 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1430/2849] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:38:24 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 03:38:24.914056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68d079-dc8b-4501-821c-a0c727c9cbaa None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:24.925374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68d079-dc8b-4501-821c-a0c727c9cbaa None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:24.943621 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:24.984913 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1b51f-7e89-49d4-8ae2-5bf30a976ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:24.985588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1b51f-7e89-49d4-8ae2-5bf30a976ebd admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:24.985869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1b51f-7e89-49d4-8ae2-5bf30a976ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:24.986144 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1b51f-7e89-49d4-8ae2-5bf30a976ebd admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:24.986847 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1b51f-7e89-49d4-8ae2-5bf30a976ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:24.988800 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1b51f-7e89-49d4-8ae2-5bf30a976ebd admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:25.010285 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1420/2850] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:38:24 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:25.014513 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0ee2c-330b-44a6-a395-9512ca50a0cd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:25.031213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0ee2c-330b-44a6-a395-9512ca50a0cd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:25.036401 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1443771-b3cb-46ef-bf86-5fe31bc7d4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:25.037093 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1443771-b3cb-46ef-bf86-5fe31bc7d4aa admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:25.037376 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1443771-b3cb-46ef-bf86-5fe31bc7d4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:25.037647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1443771-b3cb-46ef-bf86-5fe31bc7d4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:25.038381 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1443771-b3cb-46ef-bf86-5fe31bc7d4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:25.040130 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1443771-b3cb-46ef-bf86-5fe31bc7d4aa admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:25.051350 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1431/2851] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:25.055597 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1b51f-7e89-49d4-8ae2-5bf30a976ebd admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:25.066103 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1b51f-7e89-49d4-8ae2-5bf30a976ebd admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:25.071038 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08700b4d-19ad-4899-b0bf-eb98884ff9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:25.071981 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08700b4d-19ad-4899-b0bf-eb98884ff9d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:25.072264 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08700b4d-19ad-4899-b0bf-eb98884ff9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:25.072532 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08700b4d-19ad-4899-b0bf-eb98884ff9d9 admin admin] PATH_INFO: `/v3/projects/88425e22301a40dda8786c80ffc81246/users/8f8a06c33afb430595369c9a93f059ac/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:25.087852 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08700b4d-19ad-4899-b0bf-eb98884ff9d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88425e22301a40dda8786c80ffc81246, user_id=8f8a06c33afb430595369c9a93f059ac, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:25.090573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08700b4d-19ad-4899-b0bf-eb98884ff9d9 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:25.105480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1421/2852] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:25 2022] PUT /identity/v3/projects/88425e22301a40dda8786c80ffc81246/users/8f8a06c33afb430595369c9a93f059ac/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:38:25.109458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1443771-b3cb-46ef-bf86-5fe31bc7d4aa admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:25.119589 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1443771-b3cb-46ef-bf86-5fe31bc7d4aa admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:25.157223 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:25.177124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8d5e7-cfc9-4ba7-acd7-daef53866595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:25.177788 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8d5e7-cfc9-4ba7-acd7-daef53866595 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:25.178065 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8d5e7-cfc9-4ba7-acd7-daef53866595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:25.178333 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8d5e7-cfc9-4ba7-acd7-daef53866595 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:25.179121 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8d5e7-cfc9-4ba7-acd7-daef53866595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:25.181142 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8d5e7-cfc9-4ba7-acd7-daef53866595 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:25.191318 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1432/2853] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:25.195720 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08700b4d-19ad-4899-b0bf-eb98884ff9d9 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:25.207028 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08700b4d-19ad-4899-b0bf-eb98884ff9d9 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:25.213372 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07445c3c-b7e7-4014-bde2-6ffc2ed41353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:25.214258 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07445c3c-b7e7-4014-bde2-6ffc2ed41353 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:25.214533 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07445c3c-b7e7-4014-bde2-6ffc2ed41353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:25.214801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07445c3c-b7e7-4014-bde2-6ffc2ed41353 admin admin] PATH_INFO: `/v3/projects/88425e22301a40dda8786c80ffc81246/users/8f8a06c33afb430595369c9a93f059ac/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:25.217100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07445c3c-b7e7-4014-bde2-6ffc2ed41353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88425e22301a40dda8786c80ffc81246, user_id=8f8a06c33afb430595369c9a93f059ac, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:25.219750 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07445c3c-b7e7-4014-bde2-6ffc2ed41353 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:25.231171 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1422/2854] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:25 2022] PUT /identity/v3/projects/88425e22301a40dda8786c80ffc81246/users/8f8a06c33afb430595369c9a93f059ac/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:25.242417 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c488b54-737d-40ef-ba29-a036696aa7d4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:25.242776 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c488b54-737d-40ef-ba29-a036696aa7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:25.243061 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c488b54-737d-40ef-ba29-a036696aa7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:25.272609 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6c488b54-737d-40ef-ba29-a036696aa7d4 None None] MFA Rules not processed for user `8f8a06c33afb430595369c9a93f059ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:25.273821 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6c488b54-737d-40ef-ba29-a036696aa7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:25.354150 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1433/2855] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:25.366003 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07445c3c-b7e7-4014-bde2-6ffc2ed41353 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:25.368060 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-07445c3c-b7e7-4014-bde2-6ffc2ed41353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:25.427390 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07445c3c-b7e7-4014-bde2-6ffc2ed41353 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:25.431920 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbb154-eeac-4386-a167-0c09f48b760c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:25.432588 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbb154-eeac-4386-a167-0c09f48b760c service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:25.432866 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbb154-eeac-4386-a167-0c09f48b760c service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:25.433133 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbb154-eeac-4386-a167-0c09f48b760c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:25.443271 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bbb154-eeac-4386-a167-0c09f48b760c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:25.444738 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bbb154-eeac-4386-a167-0c09f48b760c service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:25.454489 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1423/2856] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:25.529992 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c488b54-737d-40ef-ba29-a036696aa7d4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:25.539948 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c488b54-737d-40ef-ba29-a036696aa7d4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:25.543666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39736faa-f599-4a19-ab3c-2ebbebdf583c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:25.544303 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39736faa-f599-4a19-ab3c-2ebbebdf583c service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:25.544623 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39736faa-f599-4a19-ab3c-2ebbebdf583c service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:25.544898 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39736faa-f599-4a19-ab3c-2ebbebdf583c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:25.617894 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39736faa-f599-4a19-ab3c-2ebbebdf583c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:25.620300 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39736faa-f599-4a19-ab3c-2ebbebdf583c service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:25.629624 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1434/2857] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:25.897462 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbb154-eeac-4386-a167-0c09f48b760c service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:25.963109 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbb154-eeac-4386-a167-0c09f48b760c service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:25.970985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb87099-480a-4eb7-b3c5-48aff2679d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:25.972362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb87099-480a-4eb7-b3c5-48aff2679d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:25.972663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb87099-480a-4eb7-b3c5-48aff2679d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:25.973044 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb87099-480a-4eb7-b3c5-48aff2679d6f admin admin] PATH_INFO: `/v3/users/b54edd2d7b4d44099965b38721f0a6a7` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:25.975048 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb87099-480a-4eb7-b3c5-48aff2679d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b54edd2d7b4d44099965b38721f0a6a7)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:25.978095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb87099-480a-4eb7-b3c5-48aff2679d6f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:25.999227 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:26.033637 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0fb87099-480a-4eb7-b3c5-48aff2679d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b54edd2d7b4d44099965b38721f0a6a7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:26.043732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0fb87099-480a-4eb7-b3c5-48aff2679d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b54edd2d7b4d44099965b38721f0a6a7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:26.055877 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0fb87099-480a-4eb7-b3c5-48aff2679d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b54edd2d7b4d44099965b38721f0a6a7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:26.056607 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0fb87099-480a-4eb7-b3c5-48aff2679d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b54edd2d7b4d44099965b38721f0a6a7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:26.063473 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0fb87099-480a-4eb7-b3c5-48aff2679d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b54edd2d7b4d44099965b38721f0a6a7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:26.069380 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1424/2858] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:38:25 2022] DELETE /identity/v3/users/b54edd2d7b4d44099965b38721f0a6a7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:26.074370 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa6816-7eb6-4b2a-ac3d-723c54fcd21b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:26.074662 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa6816-7eb6-4b2a-ac3d-723c54fcd21b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:26.074951 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa6816-7eb6-4b2a-ac3d-723c54fcd21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:26.093457 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-75aa6816-7eb6-4b2a-ac3d-723c54fcd21b None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:26.094747 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-75aa6816-7eb6-4b2a-ac3d-723c54fcd21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:26.152809 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:26.161286 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1435/2859] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:26.171648 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb87099-480a-4eb7-b3c5-48aff2679d6f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:26.173184 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0fb87099-480a-4eb7-b3c5-48aff2679d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:26.238951 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb87099-480a-4eb7-b3c5-48aff2679d6f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:26.243474 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41eaf1-732c-4aa2-be16-f0143823f033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:26.244479 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41eaf1-732c-4aa2-be16-f0143823f033 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:26.244802 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41eaf1-732c-4aa2-be16-f0143823f033 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:26.245072 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41eaf1-732c-4aa2-be16-f0143823f033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:26.254573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41eaf1-732c-4aa2-be16-f0143823f033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:26.256010 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41eaf1-732c-4aa2-be16-f0143823f033 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:26.270402 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1425/2860] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:26.561095 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa6816-7eb6-4b2a-ac3d-723c54fcd21b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:26.562700 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-75aa6816-7eb6-4b2a-ac3d-723c54fcd21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:26.577054 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa6816-7eb6-4b2a-ac3d-723c54fcd21b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:26.582201 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bac8a-e40f-4199-90b1-6a3675019438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:26.583398 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bac8a-e40f-4199-90b1-6a3675019438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:26.583682 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bac8a-e40f-4199-90b1-6a3675019438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:26.583956 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bac8a-e40f-4199-90b1-6a3675019438 admin admin] PATH_INFO: `/v3/projects/59c133bd6b484f699b02fbce30e79e41` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:26.585296 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bac8a-e40f-4199-90b1-6a3675019438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c133bd6b484f699b02fbce30e79e41)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:26.587230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bac8a-e40f-4199-90b1-6a3675019438 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:26.635738 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-452bac8a-e40f-4199-90b1-6a3675019438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c133bd6b484f699b02fbce30e79e41', 'request_id': 'req-452bac8a-e40f-4199-90b1-6a3675019438'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:26.642987 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-452bac8a-e40f-4199-90b1-6a3675019438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c133bd6b484f699b02fbce30e79e41', 'request_id': 'req-452bac8a-e40f-4199-90b1-6a3675019438'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:26.652864 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-452bac8a-e40f-4199-90b1-6a3675019438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c133bd6b484f699b02fbce30e79e41', 'request_id': 'req-452bac8a-e40f-4199-90b1-6a3675019438'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:26.667433 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-452bac8a-e40f-4199-90b1-6a3675019438 admin admin] The token cache is being invalidate because project 59c133bd6b484f699b02fbce30e79e41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:38:26.667722 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-452bac8a-e40f-4199-90b1-6a3675019438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:26.668447 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-452bac8a-e40f-4199-90b1-6a3675019438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:26.670211 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1436/2861] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:38:26 2022] DELETE /identity/v3/projects/59c133bd6b484f699b02fbce30e79e41 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:26.674398 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41eaf1-732c-4aa2-be16-f0143823f033 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:26.684172 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41eaf1-732c-4aa2-be16-f0143823f033 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:26.743421 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509bc91-504c-4564-9b82-45dabb11b67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:26.744282 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509bc91-504c-4564-9b82-45dabb11b67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:26.744549 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509bc91-504c-4564-9b82-45dabb11b67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:26.744863 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509bc91-504c-4564-9b82-45dabb11b67a admin admin] PATH_INFO: `/v3/users/8f8a06c33afb430595369c9a93f059ac` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:26.746082 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509bc91-504c-4564-9b82-45dabb11b67a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f8a06c33afb430595369c9a93f059ac)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:26.748026 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509bc91-504c-4564-9b82-45dabb11b67a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:26.801489 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:26.807063 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8509bc91-504c-4564-9b82-45dabb11b67a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f8a06c33afb430595369c9a93f059ac'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:26.815940 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8509bc91-504c-4564-9b82-45dabb11b67a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f8a06c33afb430595369c9a93f059ac'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:26.831844 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8509bc91-504c-4564-9b82-45dabb11b67a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f8a06c33afb430595369c9a93f059ac'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:26.833257 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8509bc91-504c-4564-9b82-45dabb11b67a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f8a06c33afb430595369c9a93f059ac'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:26.843911 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8509bc91-504c-4564-9b82-45dabb11b67a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f8a06c33afb430595369c9a93f059ac'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:26.852977 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1426/2862] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:38:26 2022] DELETE /identity/v3/users/8f8a06c33afb430595369c9a93f059ac => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:27.133465 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bac8a-e40f-4199-90b1-6a3675019438 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:27.135326 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-452bac8a-e40f-4199-90b1-6a3675019438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:27.152202 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bac8a-e40f-4199-90b1-6a3675019438 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:27.213750 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee430f-474c-4fda-8a39-69fb2aa9234c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:27.214525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee430f-474c-4fda-8a39-69fb2aa9234c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:27.214800 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee430f-474c-4fda-8a39-69fb2aa9234c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:27.215063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee430f-474c-4fda-8a39-69fb2aa9234c admin admin] PATH_INFO: `/v3/projects/88425e22301a40dda8786c80ffc81246` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:27.216255 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee430f-474c-4fda-8a39-69fb2aa9234c admin admin] RBAC: Authorizing `identity:delete_project(project_id=88425e22301a40dda8786c80ffc81246)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:27.218188 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee430f-474c-4fda-8a39-69fb2aa9234c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:27.265709 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4cee430f-474c-4fda-8a39-69fb2aa9234c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88425e22301a40dda8786c80ffc81246', 'request_id': 'req-4cee430f-474c-4fda-8a39-69fb2aa9234c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:27.274434 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4cee430f-474c-4fda-8a39-69fb2aa9234c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88425e22301a40dda8786c80ffc81246', 'request_id': 'req-4cee430f-474c-4fda-8a39-69fb2aa9234c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:27.280650 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4cee430f-474c-4fda-8a39-69fb2aa9234c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88425e22301a40dda8786c80ffc81246', 'request_id': 'req-4cee430f-474c-4fda-8a39-69fb2aa9234c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:27.291494 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4cee430f-474c-4fda-8a39-69fb2aa9234c admin admin] The token cache is being invalidate because project 88425e22301a40dda8786c80ffc81246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:38:27.291779 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4cee430f-474c-4fda-8a39-69fb2aa9234c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:27.292392 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4cee430f-474c-4fda-8a39-69fb2aa9234c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:27.294241 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1437/2863] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:38:27 2022] DELETE /identity/v3/projects/88425e22301a40dda8786c80ffc81246 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:27.299212 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214acd7-c141-4988-8f50-c3db0f23ff96 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:27.299525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214acd7-c141-4988-8f50-c3db0f23ff96 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:27.299796 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214acd7-c141-4988-8f50-c3db0f23ff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:27.318487 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4214acd7-c141-4988-8f50-c3db0f23ff96 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:27.319695 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4214acd7-c141-4988-8f50-c3db0f23ff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:27.387659 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1427/2864] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:38:27.395371 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627762b-cfdf-400c-b12a-df1d3b732444 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:27.395681 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627762b-cfdf-400c-b12a-df1d3b732444 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:27.395959 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627762b-cfdf-400c-b12a-df1d3b732444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:27.414760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0627762b-cfdf-400c-b12a-df1d3b732444 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:27.416066 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0627762b-cfdf-400c-b12a-df1d3b732444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:27.425863 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1438/2865] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:27.430263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214acd7-c141-4988-8f50-c3db0f23ff96 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:27.440405 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214acd7-c141-4988-8f50-c3db0f23ff96 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:27.446821 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e87162-8a9e-4814-9400-c7fdffa58753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:27.447234 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e87162-8a9e-4814-9400-c7fdffa58753 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:27.447512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e87162-8a9e-4814-9400-c7fdffa58753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:27.447784 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e87162-8a9e-4814-9400-c7fdffa58753 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:27.448509 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e87162-8a9e-4814-9400-c7fdffa58753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:38:27.448843 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e87162-8a9e-4814-9400-c7fdffa58753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:27.450444 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e87162-8a9e-4814-9400-c7fdffa58753 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:27.462505 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1428/2866] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:38:27.466896 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627762b-cfdf-400c-b12a-df1d3b732444 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:27.476240 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627762b-cfdf-400c-b12a-df1d3b732444 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:27.481726 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cda33-6340-4dc0-bc77-faefaae8e2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:27.482357 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cda33-6340-4dc0-bc77-faefaae8e2bc admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:27.482638 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cda33-6340-4dc0-bc77-faefaae8e2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:27.482913 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cda33-6340-4dc0-bc77-faefaae8e2bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:27.483614 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cda33-6340-4dc0-bc77-faefaae8e2bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:27.485555 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cda33-6340-4dc0-bc77-faefaae8e2bc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:27.488840 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:27.513240 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1439/2867] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:38:27 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:27.517481 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e87162-8a9e-4814-9400-c7fdffa58753 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:27.528368 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e87162-8a9e-4814-9400-c7fdffa58753 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:27.593413 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ce38a-6626-4c34-8d37-0559297a7a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:27.594362 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ce38a-6626-4c34-8d37-0559297a7a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:27.594726 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ce38a-6626-4c34-8d37-0559297a7a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:27.595088 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ce38a-6626-4c34-8d37-0559297a7a03 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:27.596070 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ce38a-6626-4c34-8d37-0559297a7a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:27.599037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ce38a-6626-4c34-8d37-0559297a7a03 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:27.630425 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1429/2868] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:38:27 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:27.635075 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cda33-6340-4dc0-bc77-faefaae8e2bc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:27.646283 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cda33-6340-4dc0-bc77-faefaae8e2bc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:27.651804 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b17afd-0f9b-42c6-89c6-ba945fa5e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:27.652497 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b17afd-0f9b-42c6-89c6-ba945fa5e118 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:27.652805 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b17afd-0f9b-42c6-89c6-ba945fa5e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:27.653073 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b17afd-0f9b-42c6-89c6-ba945fa5e118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:27.653789 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b17afd-0f9b-42c6-89c6-ba945fa5e118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:27.655423 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b17afd-0f9b-42c6-89c6-ba945fa5e118 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:27.666632 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1440/2869] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:27.670818 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ce38a-6626-4c34-8d37-0559297a7a03 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:27.681708 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ce38a-6626-4c34-8d37-0559297a7a03 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:27.687324 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2c6c8-0f73-46f0-8d4c-d3da9b9259ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:27.688007 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2c6c8-0f73-46f0-8d4c-d3da9b9259ab admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:27.688288 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2c6c8-0f73-46f0-8d4c-d3da9b9259ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:27.688540 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2c6c8-0f73-46f0-8d4c-d3da9b9259ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:27.689289 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2c6c8-0f73-46f0-8d4c-d3da9b9259ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:27.690918 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2c6c8-0f73-46f0-8d4c-d3da9b9259ab admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:27.702177 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1430/2870] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:27.706572 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b17afd-0f9b-42c6-89c6-ba945fa5e118 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:27.717647 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b17afd-0f9b-42c6-89c6-ba945fa5e118 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:27.722693 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516ed21-b966-490d-8d52-d88e0bdf681e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:27.723572 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516ed21-b966-490d-8d52-d88e0bdf681e admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:27.723851 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516ed21-b966-490d-8d52-d88e0bdf681e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:27.724124 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516ed21-b966-490d-8d52-d88e0bdf681e admin admin] PATH_INFO: `/v3/projects/3a23a2ade63144b2adceae7bdca47e98/users/0c4b2ed5333c45c7b41abab0618b42a4/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:27.738861 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516ed21-b966-490d-8d52-d88e0bdf681e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a23a2ade63144b2adceae7bdca47e98, user_id=0c4b2ed5333c45c7b41abab0618b42a4, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:27.741574 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516ed21-b966-490d-8d52-d88e0bdf681e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:27.759826 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1441/2871] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:27 2022] PUT /identity/v3/projects/3a23a2ade63144b2adceae7bdca47e98/users/0c4b2ed5333c45c7b41abab0618b42a4/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:27.765197 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7f10a-105b-4bd6-bfc3-fba223491478 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:27.765491 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7f10a-105b-4bd6-bfc3-fba223491478 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:27.765771 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7f10a-105b-4bd6-bfc3-fba223491478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:27.784349 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-88a7f10a-105b-4bd6-bfc3-fba223491478 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:27.785585 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-88a7f10a-105b-4bd6-bfc3-fba223491478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:27.804017 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:27.848558 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1431/2872] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:27.858466 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516ed21-b966-490d-8d52-d88e0bdf681e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:27.860315 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0516ed21-b966-490d-8d52-d88e0bdf681e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:27.921694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516ed21-b966-490d-8d52-d88e0bdf681e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:27.926218 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ac0a2-5334-4404-8575-1bff79842801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:27.926865 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ac0a2-5334-4404-8575-1bff79842801 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:27.927143 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ac0a2-5334-4404-8575-1bff79842801 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:27.927411 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ac0a2-5334-4404-8575-1bff79842801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:27.938458 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ac0a2-5334-4404-8575-1bff79842801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:27.939902 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ac0a2-5334-4404-8575-1bff79842801 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:27.950554 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1442/2873] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:28.577283 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3256f-b522-4ac0-b531-4984e71ea3d0 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:28.577583 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3256f-b522-4ac0-b531-4984e71ea3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:28.577869 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3256f-b522-4ac0-b531-4984e71ea3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:28.606243 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-22c3256f-b522-4ac0-b531-4984e71ea3d0 None None] MFA Rules not processed for user `0c4b2ed5333c45c7b41abab0618b42a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:28.607450 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-22c3256f-b522-4ac0-b531-4984e71ea3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:28.687129 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1432/2874] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:28.691751 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ac0a2-5334-4404-8575-1bff79842801 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:28.702174 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ac0a2-5334-4404-8575-1bff79842801 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:28.707200 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de8e77-eb82-479d-ada2-02e4dc0af098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:28.708190 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de8e77-eb82-479d-ada2-02e4dc0af098 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:28.708443 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de8e77-eb82-479d-ada2-02e4dc0af098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:28.708760 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de8e77-eb82-479d-ada2-02e4dc0af098 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:28.709490 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de8e77-eb82-479d-ada2-02e4dc0af098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:28.711414 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de8e77-eb82-479d-ada2-02e4dc0af098 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:28.739932 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1443/2875] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:38:28 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:28.744353 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3256f-b522-4ac0-b531-4984e71ea3d0 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:28.755767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3256f-b522-4ac0-b531-4984e71ea3d0 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:28.812112 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aabee-29ad-48f2-a2c6-b23ae322ec4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:28.813111 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aabee-29ad-48f2-a2c6-b23ae322ec4f admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:28.813385 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aabee-29ad-48f2-a2c6-b23ae322ec4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:28.813663 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aabee-29ad-48f2-a2c6-b23ae322ec4f admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:28.814377 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aabee-29ad-48f2-a2c6-b23ae322ec4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:28.816310 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aabee-29ad-48f2-a2c6-b23ae322ec4f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:28.838960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1433/2876] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:38:28 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:38:28.843795 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de8e77-eb82-479d-ada2-02e4dc0af098 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:28.857525 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de8e77-eb82-479d-ada2-02e4dc0af098 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:28.863583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b43f54-bd96-423c-a05c-aa6bc5accc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:28.864256 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b43f54-bd96-423c-a05c-aa6bc5accc5f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:28.864551 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b43f54-bd96-423c-a05c-aa6bc5accc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:28.864836 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b43f54-bd96-423c-a05c-aa6bc5accc5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:28.865583 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b43f54-bd96-423c-a05c-aa6bc5accc5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:28.867213 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b43f54-bd96-423c-a05c-aa6bc5accc5f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:28.878552 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1444/2877] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 03:38:28.882984 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aabee-29ad-48f2-a2c6-b23ae322ec4f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:28.893763 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aabee-29ad-48f2-a2c6-b23ae322ec4f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:28.898970 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b68c4f-c0e2-49a1-8b95-a5090e2f49ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:28.899964 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b68c4f-c0e2-49a1-8b95-a5090e2f49ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:28.900255 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b68c4f-c0e2-49a1-8b95-a5090e2f49ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:28.900559 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b68c4f-c0e2-49a1-8b95-a5090e2f49ae admin admin] PATH_INFO: `/v3/projects/afed6d31b5fd4ab6b87724d00acb9dde/users/35ac2b70ce8f4dadb111f2a8dfdefdb0/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:28.915359 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b68c4f-c0e2-49a1-8b95-a5090e2f49ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=afed6d31b5fd4ab6b87724d00acb9dde, user_id=35ac2b70ce8f4dadb111f2a8dfdefdb0, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:28.918071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b68c4f-c0e2-49a1-8b95-a5090e2f49ae admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:28.933037 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1434/2878] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:28 2022] PUT /identity/v3/projects/afed6d31b5fd4ab6b87724d00acb9dde/users/35ac2b70ce8f4dadb111f2a8dfdefdb0/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:28.937407 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b43f54-bd96-423c-a05c-aa6bc5accc5f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:28.948099 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b43f54-bd96-423c-a05c-aa6bc5accc5f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:29.010549 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce08b9-fe2b-44bf-aee7-4b028dfe71ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:29.011138 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce08b9-fe2b-44bf-aee7-4b028dfe71ea admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:29.011422 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce08b9-fe2b-44bf-aee7-4b028dfe71ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:29.011697 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce08b9-fe2b-44bf-aee7-4b028dfe71ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:29.012431 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce08b9-fe2b-44bf-aee7-4b028dfe71ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:29.014091 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce08b9-fe2b-44bf-aee7-4b028dfe71ea admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:29.024026 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1445/2879] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:38:29.028366 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b68c4f-c0e2-49a1-8b95-a5090e2f49ae admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:29.039045 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b68c4f-c0e2-49a1-8b95-a5090e2f49ae admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:29.044041 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3aa297-1410-4ab5-b550-2cb7b869acb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:29.044962 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3aa297-1410-4ab5-b550-2cb7b869acb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:29.045244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3aa297-1410-4ab5-b550-2cb7b869acb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:29.045521 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3aa297-1410-4ab5-b550-2cb7b869acb5 admin admin] PATH_INFO: `/v3/projects/afed6d31b5fd4ab6b87724d00acb9dde/users/35ac2b70ce8f4dadb111f2a8dfdefdb0/roles/f557c8be1c0a46d49499d22d273b67c6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:29.047553 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3aa297-1410-4ab5-b550-2cb7b869acb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afed6d31b5fd4ab6b87724d00acb9dde, user_id=35ac2b70ce8f4dadb111f2a8dfdefdb0, role_id=f557c8be1c0a46d49499d22d273b67c6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:29.050233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3aa297-1410-4ab5-b550-2cb7b869acb5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:29.060927 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1435/2880] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:38:29 2022] PUT /identity/v3/projects/afed6d31b5fd4ab6b87724d00acb9dde/users/35ac2b70ce8f4dadb111f2a8dfdefdb0/roles/f557c8be1c0a46d49499d22d273b67c6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:38:29.703642 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19a1b7-0a93-4e48-93e0-d422b0810c10 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:29.704235 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19a1b7-0a93-4e48-93e0-d422b0810c10 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:29.704694 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19a1b7-0a93-4e48-93e0-d422b0810c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:29.735366 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2c19a1b7-0a93-4e48-93e0-d422b0810c10 None None] MFA Rules not processed for user `35ac2b70ce8f4dadb111f2a8dfdefdb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:29.736651 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2c19a1b7-0a93-4e48-93e0-d422b0810c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:29.740841 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:29.815636 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1446/2881] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:29 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:29.826227 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78ad8e-5580-4096-be5b-7d14f7ee9319 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:29.826751 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78ad8e-5580-4096-be5b-7d14f7ee9319 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:29.826856 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78ad8e-5580-4096-be5b-7d14f7ee9319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:29.840095 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:29.846336 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-de78ad8e-5580-4096-be5b-7d14f7ee9319 None None] MFA Rules not processed for user `0c4b2ed5333c45c7b41abab0618b42a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:38:29.848167 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-de78ad8e-5580-4096-be5b-7d14f7ee9319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:29.905535 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1436/2882] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:38:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:38:29.918651 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19a1b7-0a93-4e48-93e0-d422b0810c10 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:29.920214 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2c19a1b7-0a93-4e48-93e0-d422b0810c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:29.995630 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19a1b7-0a93-4e48-93e0-d422b0810c10 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:30.002104 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70ad2f-6d84-46af-a039-b488c9e7d037 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c43d9d0a6264b19a843077a4669ce70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:30.002736 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70ad2f-6d84-46af-a039-b488c9e7d037 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:30.003014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70ad2f-6d84-46af-a039-b488c9e7d037 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:30.003285 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70ad2f-6d84-46af-a039-b488c9e7d037 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:30.011453 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70ad2f-6d84-46af-a039-b488c9e7d037 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:30.013090 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70ad2f-6d84-46af-a039-b488c9e7d037 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:30.021957 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1447/2883] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:30.058005 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78ad8e-5580-4096-be5b-7d14f7ee9319 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:30.060423 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-de78ad8e-5580-4096-be5b-7d14f7ee9319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:30.130860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78ad8e-5580-4096-be5b-7d14f7ee9319 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:30.135043 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5e582-77b5-4911-a32c-679f431818ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97fe9d04ccb445208f3783a8b55cd31e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:30.135693 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5e582-77b5-4911-a32c-679f431818ba service glance] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:30.135974 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5e582-77b5-4911-a32c-679f431818ba service glance] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:30.136249 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5e582-77b5-4911-a32c-679f431818ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:30.138138 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4eb5e582-77b5-4911-a32c-679f431818ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:30.154418 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5e582-77b5-4911-a32c-679f431818ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:30.156602 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5e582-77b5-4911-a32c-679f431818ba service glance] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:30.172151 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1437/2884] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:30.712295 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70ad2f-6d84-46af-a039-b488c9e7d037 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:30.770936 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70ad2f-6d84-46af-a039-b488c9e7d037 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:30.774701 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2913d-9805-4060-9e41-fb56eef20bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:30.775344 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2913d-9805-4060-9e41-fb56eef20bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:30.775619 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2913d-9805-4060-9e41-fb56eef20bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:30.775889 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2913d-9805-4060-9e41-fb56eef20bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:30.777897 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-70e2913d-9805-4060-9e41-fb56eef20bc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:30.795543 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2913d-9805-4060-9e41-fb56eef20bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:30.797030 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2913d-9805-4060-9e41-fb56eef20bc6 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:30.812610 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1448/2885] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:40.166140 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=48 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:40.714945 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5e582-77b5-4911-a32c-679f431818ba service glance] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:40.716469 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4eb5e582-77b5-4911-a32c-679f431818ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:40.783758 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5e582-77b5-4911-a32c-679f431818ba service glance] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:40.788581 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff03dda-61c7-4893-8acb-0f6cdc0aba17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99605c4dd01f48e39a3e29a74114506d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:40.789226 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff03dda-61c7-4893-8acb-0f6cdc0aba17 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:40.789502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff03dda-61c7-4893-8acb-0f6cdc0aba17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:40.789793 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff03dda-61c7-4893-8acb-0f6cdc0aba17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:40.799668 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff03dda-61c7-4893-8acb-0f6cdc0aba17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:40.801128 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff03dda-61c7-4893-8acb-0f6cdc0aba17 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:40.803327 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=87 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:40.811025 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1438/2886] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:40 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:50.806620 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=26 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:38:58.948269 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2913d-9805-4060-9e41-fb56eef20bc6 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:58.949930 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-70e2913d-9805-4060-9e41-fb56eef20bc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:59.026770 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2913d-9805-4060-9e41-fb56eef20bc6 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:59.032232 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99c5be-9763-43bf-9ed2-1044d365d684 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '361ad35021eb43cca46d9b66e6f24ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:59.032992 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99c5be-9763-43bf-9ed2-1044d365d684 service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:59.033340 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99c5be-9763-43bf-9ed2-1044d365d684 service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:59.033684 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99c5be-9763-43bf-9ed2-1044d365d684 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:59.035605 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cb99c5be-9763-43bf-9ed2-1044d365d684 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:38:59.047622 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99c5be-9763-43bf-9ed2-1044d365d684 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:59.049503 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99c5be-9763-43bf-9ed2-1044d365d684 service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:59.060236 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1449/2887] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:38:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:38:59.543906 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff03dda-61c7-4893-8acb-0f6cdc0aba17 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:38:59.740722 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff03dda-61c7-4893-8acb-0f6cdc0aba17 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:38:59.746914 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ee7fa-8983-4e69-bb8b-9cf47b976a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:38:59.747798 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ee7fa-8983-4e69-bb8b-9cf47b976a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:38:59.748073 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ee7fa-8983-4e69-bb8b-9cf47b976a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:38:59.748339 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ee7fa-8983-4e69-bb8b-9cf47b976a11 admin admin] PATH_INFO: `/v3/users/0c4b2ed5333c45c7b41abab0618b42a4` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:38:59.749828 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ee7fa-8983-4e69-bb8b-9cf47b976a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4b2ed5333c45c7b41abab0618b42a4)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:38:59.751754 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ee7fa-8983-4e69-bb8b-9cf47b976a11 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:38:59.804666 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-925ee7fa-8983-4e69-bb8b-9cf47b976a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4b2ed5333c45c7b41abab0618b42a4'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:59.814137 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-925ee7fa-8983-4e69-bb8b-9cf47b976a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4b2ed5333c45c7b41abab0618b42a4'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:59.826400 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-925ee7fa-8983-4e69-bb8b-9cf47b976a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4b2ed5333c45c7b41abab0618b42a4'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:59.827187 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-925ee7fa-8983-4e69-bb8b-9cf47b976a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4b2ed5333c45c7b41abab0618b42a4'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:59.835079 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-925ee7fa-8983-4e69-bb8b-9cf47b976a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4b2ed5333c45c7b41abab0618b42a4'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:38:59.841100 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1439/2888] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:38:59 2022] DELETE /identity/v3/users/0c4b2ed5333c45c7b41abab0618b42a4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:39:00.022496 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99c5be-9763-43bf-9ed2-1044d365d684 service placement] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:39:00.033658 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99c5be-9763-43bf-9ed2-1044d365d684 service placement] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:39:00.093746 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:39:00.094624 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:00.094903 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:00.095183 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4 admin admin] PATH_INFO: `/v3/projects/3a23a2ade63144b2adceae7bdca47e98` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:00.096438 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a23a2ade63144b2adceae7bdca47e98)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:39:00.098398 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:39:00.150952 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a23a2ade63144b2adceae7bdca47e98', 'request_id': 'req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:00.159972 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a23a2ade63144b2adceae7bdca47e98', 'request_id': 'req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:00.165780 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a23a2ade63144b2adceae7bdca47e98', 'request_id': 'req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:00.177560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4 admin admin] The token cache is being invalidate because project 3a23a2ade63144b2adceae7bdca47e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:39:00.177846 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:00.178581 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:00.180216 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1450/2889] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:39:00 2022] DELETE /identity/v3/projects/3a23a2ade63144b2adceae7bdca47e98 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:39:00.184972 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ee7fa-8983-4e69-bb8b-9cf47b976a11 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:39:00.187090 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-925ee7fa-8983-4e69-bb8b-9cf47b976a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:39:00.206043 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ee7fa-8983-4e69-bb8b-9cf47b976a11 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:39:00.267552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4766585-b0f5-4894-aead-5a04aa53f9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:39:00.268344 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4766585-b0f5-4894-aead-5a04aa53f9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:00.268646 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4766585-b0f5-4894-aead-5a04aa53f9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:00.268912 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4766585-b0f5-4894-aead-5a04aa53f9c3 admin admin] PATH_INFO: `/v3/users/35ac2b70ce8f4dadb111f2a8dfdefdb0` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:00.270115 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4766585-b0f5-4894-aead-5a04aa53f9c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ac2b70ce8f4dadb111f2a8dfdefdb0)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:39:00.272048 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4766585-b0f5-4894-aead-5a04aa53f9c3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:39:00.294860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:39:00.324891 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a4766585-b0f5-4894-aead-5a04aa53f9c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ac2b70ce8f4dadb111f2a8dfdefdb0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:00.334921 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a4766585-b0f5-4894-aead-5a04aa53f9c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ac2b70ce8f4dadb111f2a8dfdefdb0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:00.347707 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a4766585-b0f5-4894-aead-5a04aa53f9c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ac2b70ce8f4dadb111f2a8dfdefdb0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:00.348363 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a4766585-b0f5-4894-aead-5a04aa53f9c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ac2b70ce8f4dadb111f2a8dfdefdb0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:00.355293 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a4766585-b0f5-4894-aead-5a04aa53f9c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ac2b70ce8f4dadb111f2a8dfdefdb0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:00.361510 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1440/2890] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:39:00 2022] DELETE /identity/v3/users/35ac2b70ce8f4dadb111f2a8dfdefdb0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:39:00.538935 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:39:00.540542 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:39:00.562584 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a4ea0-9f40-40f8-ae96-b4996b27bcb4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:39:00.581504 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:39:00.623737 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faff66-467e-47cc-9148-e895496d9ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:39:00.624729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faff66-467e-47cc-9148-e895496d9ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:00.625014 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faff66-467e-47cc-9148-e895496d9ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:00.625289 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faff66-467e-47cc-9148-e895496d9ef3 admin admin] PATH_INFO: `/v3/projects/afed6d31b5fd4ab6b87724d00acb9dde` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:00.626526 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3faff66-467e-47cc-9148-e895496d9ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afed6d31b5fd4ab6b87724d00acb9dde)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:39:00.628472 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3faff66-467e-47cc-9148-e895496d9ef3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:39:00.683172 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3faff66-467e-47cc-9148-e895496d9ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afed6d31b5fd4ab6b87724d00acb9dde', 'request_id': 'req-c3faff66-467e-47cc-9148-e895496d9ef3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:00.692947 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3faff66-467e-47cc-9148-e895496d9ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afed6d31b5fd4ab6b87724d00acb9dde', 'request_id': 'req-c3faff66-467e-47cc-9148-e895496d9ef3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:00.698943 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3faff66-467e-47cc-9148-e895496d9ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afed6d31b5fd4ab6b87724d00acb9dde', 'request_id': 'req-c3faff66-467e-47cc-9148-e895496d9ef3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:00.711010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3faff66-467e-47cc-9148-e895496d9ef3 admin admin] The token cache is being invalidate because project afed6d31b5fd4ab6b87724d00acb9dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:39:00.711296 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3faff66-467e-47cc-9148-e895496d9ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:00.711944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3faff66-467e-47cc-9148-e895496d9ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:00.713562 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1451/2891] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:39:00 2022] DELETE /identity/v3/projects/afed6d31b5fd4ab6b87724d00acb9dde => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:39:00.718767 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e41da0-edd5-4655-bc9d-11b2cfbbadf9 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:00.719254 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e41da0-edd5-4655-bc9d-11b2cfbbadf9 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:00.719354 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e41da0-edd5-4655-bc9d-11b2cfbbadf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:00.738021 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c8e41da0-edd5-4655-bc9d-11b2cfbbadf9 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:39:00.739210 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c8e41da0-edd5-4655-bc9d-11b2cfbbadf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:39:00.799058 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1441/2892] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 03:39:00.806744 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9a998-24c2-4d80-b1b8-b1bd0f475b04 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:00.807038 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9a998-24c2-4d80-b1b8-b1bd0f475b04 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:00.807320 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9a998-24c2-4d80-b1b8-b1bd0f475b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:00.827001 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-17a9a998-24c2-4d80-b1b8-b1bd0f475b04 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:39:00.828584 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-17a9a998-24c2-4d80-b1b8-b1bd0f475b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:39:00.838141 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1452/2893] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:39:00.842676 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e41da0-edd5-4655-bc9d-11b2cfbbadf9 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:39:00.852512 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e41da0-edd5-4655-bc9d-11b2cfbbadf9 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:39:00.857599 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365fb65-5b9b-4b3b-a8bd-27f4d037fcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:39:00.858244 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365fb65-5b9b-4b3b-a8bd-27f4d037fcff admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:00.858523 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365fb65-5b9b-4b3b-a8bd-27f4d037fcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:00.858951 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365fb65-5b9b-4b3b-a8bd-27f4d037fcff admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:00.859681 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365fb65-5b9b-4b3b-a8bd-27f4d037fcff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 03:39:00.859980 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365fb65-5b9b-4b3b-a8bd-27f4d037fcff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:39:00.861605 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365fb65-5b9b-4b3b-a8bd-27f4d037fcff admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:39:00.872960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1442/2894] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Jul 12 03:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 03:39:00.877390 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9a998-24c2-4d80-b1b8-b1bd0f475b04 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:39:00.886991 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9a998-24c2-4d80-b1b8-b1bd0f475b04 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:39:00.892729 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc8438-4049-4989-91ee-6c0b23eac0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:39:00.893388 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc8438-4049-4989-91ee-6c0b23eac0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:00.893666 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc8438-4049-4989-91ee-6c0b23eac0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:00.893939 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc8438-4049-4989-91ee-6c0b23eac0e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:00.894634 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc8438-4049-4989-91ee-6c0b23eac0e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:39:00.896560 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc8438-4049-4989-91ee-6c0b23eac0e8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:39:00.925194 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1453/2895] 10.222.0.26 () {60 vars in 1152 bytes} [Tue Jul 12 03:39:00 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:39:00.931552 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365fb65-5b9b-4b3b-a8bd-27f4d037fcff admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:39:00.942616 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365fb65-5b9b-4b3b-a8bd-27f4d037fcff admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:39:01.017740 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60987f-9666-46a5-91c9-d2bd72935516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:39:01.018436 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60987f-9666-46a5-91c9-d2bd72935516 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:01.018706 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60987f-9666-46a5-91c9-d2bd72935516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:01.018968 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60987f-9666-46a5-91c9-d2bd72935516 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:01.019639 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60987f-9666-46a5-91c9-d2bd72935516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:39:01.021690 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60987f-9666-46a5-91c9-d2bd72935516 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:39:01.043214 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1443/2896] 10.222.0.26 () {60 vars in 1143 bytes} [Tue Jul 12 03:39:00 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 03:39:01.048114 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc8438-4049-4989-91ee-6c0b23eac0e8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:39:01.064207 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc8438-4049-4989-91ee-6c0b23eac0e8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:39:01.073307 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a3476-ce5e-4b64-a26e-6527f83f3b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:39:01.074166 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a3476-ce5e-4b64-a26e-6527f83f3b4b admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:01.074500 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a3476-ce5e-4b64-a26e-6527f83f3b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:01.074875 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a3476-ce5e-4b64-a26e-6527f83f3b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:01.076094 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a3476-ce5e-4b64-a26e-6527f83f3b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:39:01.078476 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a3476-ce5e-4b64-a26e-6527f83f3b4b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:39:01.089602 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1454/2897] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:39:01.093874 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60987f-9666-46a5-91c9-d2bd72935516 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:39:01.105221 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60987f-9666-46a5-91c9-d2bd72935516 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:39:01.110703 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd53df-6bbd-4d64-8a0f-412c8ec5bd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:39:01.111392 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd53df-6bbd-4d64-8a0f-412c8ec5bd55 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:01.111671 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd53df-6bbd-4d64-8a0f-412c8ec5bd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:01.111938 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd53df-6bbd-4d64-8a0f-412c8ec5bd55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:01.112699 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd53df-6bbd-4d64-8a0f-412c8ec5bd55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:39:01.114333 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd53df-6bbd-4d64-8a0f-412c8ec5bd55 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:39:01.126011 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1444/2898] 10.222.0.26 () {58 vars in 1121 bytes} [Tue Jul 12 03:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 03:39:01.130351 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a3476-ce5e-4b64-a26e-6527f83f3b4b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:39:01.140947 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a3476-ce5e-4b64-a26e-6527f83f3b4b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:39:01.146212 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d3f73-0199-4e34-aa8f-81bc5714cee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:39:01.147098 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d3f73-0199-4e34-aa8f-81bc5714cee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:01.147378 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d3f73-0199-4e34-aa8f-81bc5714cee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:01.147653 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d3f73-0199-4e34-aa8f-81bc5714cee0 admin admin] PATH_INFO: `/v3/projects/8165f13138b7486badd5826c9f6c4821/users/ab2f14a3740c4636a0385aa71caaea4e/roles/713f175e9435403f9e39528c805bd956` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:01.163270 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d3f73-0199-4e34-aa8f-81bc5714cee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8165f13138b7486badd5826c9f6c4821, user_id=ab2f14a3740c4636a0385aa71caaea4e, role_id=713f175e9435403f9e39528c805bd956)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:39:01.165955 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d3f73-0199-4e34-aa8f-81bc5714cee0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:39:01.181248 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1455/2899] 10.222.0.26 () {60 vars in 1482 bytes} [Tue Jul 12 03:39:01 2022] PUT /identity/v3/projects/8165f13138b7486badd5826c9f6c4821/users/ab2f14a3740c4636a0385aa71caaea4e/roles/713f175e9435403f9e39528c805bd956 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:39:01.191762 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3244ee-ea0d-47d8-a8e8-24732fbb7ac3 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:01.192049 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3244ee-ea0d-47d8-a8e8-24732fbb7ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:01.192322 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3244ee-ea0d-47d8-a8e8-24732fbb7ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:01.199039 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:39:01.222542 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-dc3244ee-ea0d-47d8-a8e8-24732fbb7ac3 None None] MFA Rules not processed for user `ab2f14a3740c4636a0385aa71caaea4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:39:01.223737 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-dc3244ee-ea0d-47d8-a8e8-24732fbb7ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:39:01.295983 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1445/2900] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:39:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:39:01.307640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d3f73-0199-4e34-aa8f-81bc5714cee0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:39:01.309702 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-718d3f73-0199-4e34-aa8f-81bc5714cee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:39:01.373185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:39:01.379988 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d3f73-0199-4e34-aa8f-81bc5714cee0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:39:01.384943 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f47a6-8c76-4375-b173-4869f1488f8b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97fe9d04ccb445208f3783a8b55cd31e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:39:01.385822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f47a6-8c76-4375-b173-4869f1488f8b service glance] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:01.386086 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f47a6-8c76-4375-b173-4869f1488f8b service glance] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:01.386368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f47a6-8c76-4375-b173-4869f1488f8b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:01.395640 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f47a6-8c76-4375-b173-4869f1488f8b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:39:01.397113 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f47a6-8c76-4375-b173-4869f1488f8b service glance] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:39:01.406078 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1456/2901] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:39:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:39:11.292748 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=30 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:39:11.402160 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:39:14.828355 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3244ee-ea0d-47d8-a8e8-24732fbb7ac3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:39:14.893266 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3244ee-ea0d-47d8-a8e8-24732fbb7ac3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:39:14.897825 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f5c6c-df75-4bb9-8c5e-f88fff75b6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:39:14.898732 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f5c6c-df75-4bb9-8c5e-f88fff75b6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:14.899027 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f5c6c-df75-4bb9-8c5e-f88fff75b6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:14.899277 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f5c6c-df75-4bb9-8c5e-f88fff75b6c6 admin admin] PATH_INFO: `/v3/users/ab2f14a3740c4636a0385aa71caaea4e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:14.900475 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f5c6c-df75-4bb9-8c5e-f88fff75b6c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2f14a3740c4636a0385aa71caaea4e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:39:14.902550 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f5c6c-df75-4bb9-8c5e-f88fff75b6c6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:39:14.955985 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-734f5c6c-df75-4bb9-8c5e-f88fff75b6c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2f14a3740c4636a0385aa71caaea4e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:14.964693 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-734f5c6c-df75-4bb9-8c5e-f88fff75b6c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2f14a3740c4636a0385aa71caaea4e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:14.978410 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-734f5c6c-df75-4bb9-8c5e-f88fff75b6c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2f14a3740c4636a0385aa71caaea4e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:14.979089 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-734f5c6c-df75-4bb9-8c5e-f88fff75b6c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2f14a3740c4636a0385aa71caaea4e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:14.987071 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-734f5c6c-df75-4bb9-8c5e-f88fff75b6c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2f14a3740c4636a0385aa71caaea4e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:14.992948 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1446/2902] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:39:14 2022] DELETE /identity/v3/users/ab2f14a3740c4636a0385aa71caaea4e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:39:14.997410 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786757f-931b-44c2-90c3-a9e374b1e6c8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:14.997903 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786757f-931b-44c2-90c3-a9e374b1e6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:14.998010 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786757f-931b-44c2-90c3-a9e374b1e6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:15.015944 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c786757f-931b-44c2-90c3-a9e374b1e6c8 None None] MFA Rules not processed for user `91f07a0a44be4b2f8401d0649c1ba808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 03:39:15.017191 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c786757f-931b-44c2-90c3-a9e374b1e6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:39:15.080716 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1457/2903] 10.222.0.26 () {58 vars in 957 bytes} [Tue Jul 12 03:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 03:39:15.091328 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f5c6c-df75-4bb9-8c5e-f88fff75b6c6 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:39:15.092801 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-734f5c6c-df75-4bb9-8c5e-f88fff75b6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:39:15.164590 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f5c6c-df75-4bb9-8c5e-f88fff75b6c6 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:39:15.168860 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd2ead-7df8-43e7-bc91-a89c4f8bbd97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2908efc19944583810abceb4c5d8d5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:39:15.169507 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd2ead-7df8-43e7-bc91-a89c4f8bbd97 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:15.170107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd2ead-7df8-43e7-bc91-a89c4f8bbd97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:15.170107 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd2ead-7df8-43e7-bc91-a89c4f8bbd97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:15.179763 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd2ead-7df8-43e7-bc91-a89c4f8bbd97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:39:15.181241 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd2ead-7df8-43e7-bc91-a89c4f8bbd97 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:39:15.194707 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1447/2904] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 03:39:15.485079 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786757f-931b-44c2-90c3-a9e374b1e6c8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:39:15.486753 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c786757f-931b-44c2-90c3-a9e374b1e6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:39:15.500173 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786757f-931b-44c2-90c3-a9e374b1e6c8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:39:15.506514 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:39:15.507483 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:15.507835 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:15.508180 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00 admin admin] PATH_INFO: `/v3/projects/8165f13138b7486badd5826c9f6c4821` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:15.509792 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8165f13138b7486badd5826c9f6c4821)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:39:15.511957 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:39:15.562862 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8165f13138b7486badd5826c9f6c4821', 'request_id': 'req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:15.571028 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8165f13138b7486badd5826c9f6c4821', 'request_id': 'req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:15.578051 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8165f13138b7486badd5826c9f6c4821', 'request_id': 'req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:15.590471 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00 admin admin] The token cache is being invalidate because project 8165f13138b7486badd5826c9f6c4821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:39:15.590688 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:15.591315 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:15.593376 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1458/2905] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:39:15 2022] DELETE /identity/v3/projects/8165f13138b7486badd5826c9f6c4821 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 03:39:20.662921 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd2ead-7df8-43e7-bc91-a89c4f8bbd97 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:39:20.664561 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f7cd2ead-7df8-43e7-bc91-a89c4f8bbd97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:39:20.678976 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd2ead-7df8-43e7-bc91-a89c4f8bbd97 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:39:20.698403 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:39:20.739396 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9c771-3c26-409d-a1fe-b55f0484cfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:39:20.740192 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9c771-3c26-409d-a1fe-b55f0484cfc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:20.740473 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9c771-3c26-409d-a1fe-b55f0484cfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:20.740777 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9c771-3c26-409d-a1fe-b55f0484cfc5 admin admin] PATH_INFO: `/v3/users/0ad58a62e6024e20a5fe2a520260cfd3` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:20.742017 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9c771-3c26-409d-a1fe-b55f0484cfc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad58a62e6024e20a5fe2a520260cfd3)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:39:20.743964 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9c771-3c26-409d-a1fe-b55f0484cfc5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:39:20.791056 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6fd9c771-3c26-409d-a1fe-b55f0484cfc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad58a62e6024e20a5fe2a520260cfd3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:20.799043 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6fd9c771-3c26-409d-a1fe-b55f0484cfc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad58a62e6024e20a5fe2a520260cfd3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:20.811185 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6fd9c771-3c26-409d-a1fe-b55f0484cfc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad58a62e6024e20a5fe2a520260cfd3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:20.811946 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6fd9c771-3c26-409d-a1fe-b55f0484cfc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad58a62e6024e20a5fe2a520260cfd3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:20.819525 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6fd9c771-3c26-409d-a1fe-b55f0484cfc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad58a62e6024e20a5fe2a520260cfd3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:20.828240 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1448/2906] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:39:20 2022] DELETE /identity/v3/users/0ad58a62e6024e20a5fe2a520260cfd3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:39:21.007185 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:39:21.008695 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:39:21.025338 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24b75b-1e68-4e6d-8ce0-74c69889bf00 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:39:21.085368 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb97e07-c456-4120-8185-f245245b3ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:39:21.086230 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb97e07-c456-4120-8185-f245245b3ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:21.086509 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb97e07-c456-4120-8185-f245245b3ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:21.086782 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb97e07-c456-4120-8185-f245245b3ffe admin admin] PATH_INFO: `/v3/projects/bc4dc40b42a545a88e4c1dfc24e04237` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:21.087996 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb97e07-c456-4120-8185-f245245b3ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc4dc40b42a545a88e4c1dfc24e04237)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:39:21.089976 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb97e07-c456-4120-8185-f245245b3ffe admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:39:21.122822 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:39:21.140284 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0fb97e07-c456-4120-8185-f245245b3ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc4dc40b42a545a88e4c1dfc24e04237', 'request_id': 'req-0fb97e07-c456-4120-8185-f245245b3ffe'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:21.148317 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0fb97e07-c456-4120-8185-f245245b3ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc4dc40b42a545a88e4c1dfc24e04237', 'request_id': 'req-0fb97e07-c456-4120-8185-f245245b3ffe'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:21.154063 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0fb97e07-c456-4120-8185-f245245b3ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc4dc40b42a545a88e4c1dfc24e04237', 'request_id': 'req-0fb97e07-c456-4120-8185-f245245b3ffe'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:21.165761 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0fb97e07-c456-4120-8185-f245245b3ffe admin admin] The token cache is being invalidate because project bc4dc40b42a545a88e4c1dfc24e04237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:39:21.166050 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0fb97e07-c456-4120-8185-f245245b3ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:21.166758 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0fb97e07-c456-4120-8185-f245245b3ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:21.168636 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1459/2907] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:39:21 2022] DELETE /identity/v3/projects/bc4dc40b42a545a88e4c1dfc24e04237 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:39:21.172771 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9c771-3c26-409d-a1fe-b55f0484cfc5 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:39:21.174430 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6fd9c771-3c26-409d-a1fe-b55f0484cfc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:39:21.196300 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9c771-3c26-409d-a1fe-b55f0484cfc5 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:39:21.257168 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f7c48-dfd4-4c5f-aedd-389eb9b76209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:39:21.257960 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f7c48-dfd4-4c5f-aedd-389eb9b76209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:21.258233 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f7c48-dfd4-4c5f-aedd-389eb9b76209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:21.258480 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f7c48-dfd4-4c5f-aedd-389eb9b76209 admin admin] PATH_INFO: `/v3/users/b22f2f4ffe8e438d83bd8541f3420ff8` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:21.259665 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f7c48-dfd4-4c5f-aedd-389eb9b76209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b22f2f4ffe8e438d83bd8541f3420ff8)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:39:21.261593 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f7c48-dfd4-4c5f-aedd-389eb9b76209 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:39:21.309227 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:39:21.312263 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-446f7c48-dfd4-4c5f-aedd-389eb9b76209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b22f2f4ffe8e438d83bd8541f3420ff8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:21.321792 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-446f7c48-dfd4-4c5f-aedd-389eb9b76209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b22f2f4ffe8e438d83bd8541f3420ff8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:21.335168 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-446f7c48-dfd4-4c5f-aedd-389eb9b76209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b22f2f4ffe8e438d83bd8541f3420ff8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:21.336112 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-446f7c48-dfd4-4c5f-aedd-389eb9b76209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b22f2f4ffe8e438d83bd8541f3420ff8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:21.343374 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-446f7c48-dfd4-4c5f-aedd-389eb9b76209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b22f2f4ffe8e438d83bd8541f3420ff8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:21.349422 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1449/2908] 10.222.0.26 () {58 vars in 1223 bytes} [Tue Jul 12 03:39:21 2022] DELETE /identity/v3/users/b22f2f4ffe8e438d83bd8541f3420ff8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:39:21.527403 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb97e07-c456-4120-8185-f245245b3ffe admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:39:21.529023 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0fb97e07-c456-4120-8185-f245245b3ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:39:21.542671 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb97e07-c456-4120-8185-f245245b3ffe admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:39:21.604680 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae40011-8b51-4bc0-a7a3-59b9f5eb0719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91f07a0a44be4b2f8401d0649c1ba808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75f65be69d944055b21e27b7afc48f60', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:39:21.605543 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae40011-8b51-4bc0-a7a3-59b9f5eb0719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:39:21.605817 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae40011-8b51-4bc0-a7a3-59b9f5eb0719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:39:21.606105 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae40011-8b51-4bc0-a7a3-59b9f5eb0719 admin admin] PATH_INFO: `/v3/projects/cde73e0d32264c35baa39cd82d73bc41` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:39:21.607402 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae40011-8b51-4bc0-a7a3-59b9f5eb0719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde73e0d32264c35baa39cd82d73bc41)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:39:21.609427 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae40011-8b51-4bc0-a7a3-59b9f5eb0719 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:39:21.662068 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cae40011-8b51-4bc0-a7a3-59b9f5eb0719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde73e0d32264c35baa39cd82d73bc41', 'request_id': 'req-cae40011-8b51-4bc0-a7a3-59b9f5eb0719'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:21.670344 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cae40011-8b51-4bc0-a7a3-59b9f5eb0719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde73e0d32264c35baa39cd82d73bc41', 'request_id': 'req-cae40011-8b51-4bc0-a7a3-59b9f5eb0719'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:21.680639 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cae40011-8b51-4bc0-a7a3-59b9f5eb0719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde73e0d32264c35baa39cd82d73bc41', 'request_id': 'req-cae40011-8b51-4bc0-a7a3-59b9f5eb0719'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:21.689126 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cae40011-8b51-4bc0-a7a3-59b9f5eb0719 admin admin] The token cache is being invalidate because project cde73e0d32264c35baa39cd82d73bc41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 03:39:21.689417 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cae40011-8b51-4bc0-a7a3-59b9f5eb0719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:21.690106 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cae40011-8b51-4bc0-a7a3-59b9f5eb0719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 03:39:21.691717 dv-cinder-847730-4-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1460/2909] 10.222.0.26 () {58 vars in 1232 bytes} [Tue Jul 12 03:39:21 2022] DELETE /identity/v3/projects/cde73e0d32264c35baa39cd82d73bc41 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 03:39:31.346027 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=4,keystone:SELECT=13,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:39:31.685635 dv-cinder-847730-4-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=13,keystone:SELECT=65,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:41:32.226302 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f7c48-dfd4-4c5f-aedd-389eb9b76209 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 03:41:32.228950 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-446f7c48-dfd4-4c5f-aedd-389eb9b76209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:41:32.325573 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f7c48-dfd4-4c5f-aedd-389eb9b76209 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 03:41:32.415502 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc653c7a-aa75-4aaf-8059-870053be3d78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '361ad35021eb43cca46d9b66e6f24ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd5f89a049d40dc8456bd351f01f603', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 03:41:32.416054 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc653c7a-aa75-4aaf-8059-870053be3d78 service placement] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 03:41:32.416327 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc653c7a-aa75-4aaf-8059-870053be3d78 service placement] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 03:41:32.416629 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc653c7a-aa75-4aaf-8059-870053be3d78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 03:41:32.418600 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fc653c7a-aa75-4aaf-8059-870053be3d78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 03:41:32.431312 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc653c7a-aa75-4aaf-8059-870053be3d78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 03:41:32.432930 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc653c7a-aa75-4aaf-8059-870053be3d78 service placement] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 03:41:32.445708 dv-cinder-847730-4-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1450/2910] 10.222.0.26 () {60 vars in 1365 bytes} [Tue Jul 12 03:41:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 03:41:42.439293 dv-cinder-847730-4-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=58 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}